Sensing & Perception

How robots see and feel the world: cameras, LiDAR, radar, IMUs, force and tactile sensing, and the perception on top.

  1. 01

    Robot Sensors: IMUs, Force/Torque & Proprioception

    How robots sense themselves: MEMS IMUs, 6-axis force/torque sensors, current-based torque estimation, tactile skin, load cells, and sensor fusion.

  2. 02

    LiDAR & Depth Cameras for Robots

    How LiDAR and depth cameras give robots 3D vision: ranging physics, sensor architectures, stereo vs structured light vs ToF, SLAM, and how to pick one.

  3. 03

    Depth Sensing: Stereo, ToF & Structured Light

    The three ways a camera measures depth: stereo disparity, structured light, and time-of-flight, with the geometry, specs, failure modes, and how to pick.

  4. 04

    Machine Vision for Automation

    Design 2D machine-vision systems: sensors, GigE/USB3 cameras, optics, lighting, calibration, classic vs deep-learning inspection, robot guidance.

  5. 05

    Robot Perception & Object Pose Estimation

    How robots find and orient objects: detection, segmentation, 6-DoF pose, tracking, grasp perception, ADD/ADD-S metrics, synthetic data, and bin-picking.

  6. 06

    IMUs & Inertial Navigation

    How MEMS IMUs measure motion, why unaided inertial navigation drifts, and how to read the error specs, run Allan variance, and pick a grade.

  7. 07

    Force/Torque Sensing for Robots

    How robots feel contact: 6-axis F/T sensors, joint torque sensing, series-elastic actuators, the specs that matter, and how to pick and calibrate one.

  8. 08

    Tactile Sensing & Robot E-Skin

    How robots feel: capacitive, piezoresistive, magnetic and optical tactile sensing, slip detection, and the wiring problem behind whole-body e-skin.

  9. 09

    Radar for Robotics

    How mmWave FMCW radar measures range, velocity, and angle for robots, why it sees through dust and fog, and how to pick one.

  10. 10

    Event Cameras (Neuromorphic Vision)

    How event cameras work: the DVS pixel, microsecond latency, huge dynamic range, the event-stream data model, algorithms, and how to select one.

  11. 11

    Ultrasonic & Proximity Sensing

    How robots feel their near field: ultrasonic ranging physics, inductive/capacitive/photoelectric proximity, specs, blind zones, and how to pick one.

  12. 12

    Thermal & Infrared Imaging for Robots

    How thermal cameras let robots see heat: microbolometer physics, NETD and radiometry, the emissivity traps, and where LWIR imaging fits on drones and robots.