Complementary Perception for Handheld SLAM

• Published in: IEEE robotics and automation letters Vol. 3; no. 2; pp. 1104 - 1111
• Main Authors: Lowe, Thomas, Soohwan Kim, Cox, Mark
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.04.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithm design and analysis; Algorithms; Component reliability; Feature extraction; field robots; Inertial platforms; Laser radar; Lidar; localization; mapping; Optimization; sensor fusion; Simultaneous localization and mapping; SLAM; Trajectory; Visualization
• ISSN: 2377-3766; 2377-3766
• DOI: 10.1109/LRA.2018.2795651

We present a novel method for mapping general three-dimensional environments, where sufficient geometric or visual information is not everywhere guaranteed and where the device motion is unconstrained as with handheld systems. The continuous-time simultaneous localization and mapping algorithm integrates a lidar, camera, and inertial measurement unit in a complementary fashion whereby all sensors contribute constraints to the optimization. The proposed algorithm is designed to expand the domain of mappable environments and therefore increase the reliability and utility of general purpose mobile mapping. A key component of the proposed algorithm is the incorporation of depth uncertainty into visual features, which is effective for noisy surfaces and allows features with and without depth estimates to be modeled in a unified manner. Results demonstrate a wider mappable domain on challenging environments compared to the state-of-the-art lidar or vision-based localization and mapping algorithms.