Recovering Stable Scale in Monocular SLAM Using Object-Supplemented Bundle Adjustment

• Published in: IEEE transactions on robotics Vol. 34; no. 3; pp. 736 - 747
• Main Authors: Frost, Duncan, Prisacariu, Victor, Murray, David
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.06.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Bundle adjustment; Cameras; Drift; monocular vision; Object detection; object recognition; Odometers; Roads; scale drift; Simultaneous localization and mapping; simultaneous localization and mapping (SLAM); Trajectory
• ISSN: 1552-3098; 1941-0468
• DOI: 10.1109/TRO.2018.2820722

Without knowledge of the absolute baseline between images, the scale of a map from a single-camera simultaneous localization and mapping system is subject to calamitous drift over time. We describe a monocular approach that in addition to point measurements also considers object detections to resolve this scale ambiguity and drift. By placing an expectation on the size of the objects, the scale estimation can be seamlessly integrated into a bundle adjustment. When object observations are available, the local scale of the map is then determined jointly with the camera pose in local adjustments. Unlike many previous visual odometry methods, our approach does not impose restrictions such as constant camera height or planar roadways, and is therefore more widely applicable. We evaluate our approach on the KITTI data set and show that it reduces scale drift over long-range outdoor sequences with a total length of 40 km. As the scale of objects is known absolutely, metric accuracy is obtained for all sequences. Qualitative evaluation is also performed on video footage from a hand-held camera.