Project 03 / Perception

Humanoid RGB-D SLAM

Dense three-dimensional mapping and reliable localization on a moving humanoid using depth perception and proprioceptive odometry.

Dense three-dimensional environment map generated by the humanoid SLAM systemMap / RTAB-Map + InEKF

Mapping from a platform that never stands perfectly still.

Visual odometry on a humanoid is challenged by fast body motion, changing illumination, and the repeated texture of indoor environments. I evaluated multiple RGB-D SLAM methods and then used the base estimator’s proprioceptive odometry to strengthen RTAB-Map.

The resulting pipeline avoided part of the visual system’s feature and lighting dependence while updating faster during dynamic motion. It produced both dense 3D maps and 2D occupancy grids in Choreonoid environments for downstream path planning.

Key contributions

  1. Implemented and compared several RGB-D localization and mapping algorithms.
  2. Replaced visual odometry with higher-rate proprioceptive odometry from the invariant estimator.
  3. Generated dense point-cloud maps and two-dimensional occupancy grids.
  4. Evaluated suitability for humanoid navigation under dynamic motion.
Mapping pipeline in simulation
Three-dimensional map produced during the SLAM evaluation
Dense environment reconstruction
Coordinate frames on the humanoid robot
Robot-camera geometry

Next project / 04

Driver Monitoring System