Dense visual-inertial odometry for tracking of aggressive motions

We propose a sliding window-based dense visual-inertial fusion method for real-time tracking of challenging aggressive motions. Our method combines recent advances in direct dense visual odometry, inertial measurement unit (IMU) preintegration, and graph-based optimization. At the front-end, direct...

Full description

Saved in:
Bibliographic Details
Published in2015 IEEE International Conference on Robotics and Biomimetics (ROBIO) pp. 576 - 583
Main Authors Yonggen Ling, Shaojie Shen
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.12.2015
Subjects
Cameras
Measurement uncertainty
Optimization
Reliability
Robot sensing systems
Tracking
Visualization
Online AccessGet full text

Cover

More Information
Summary:We propose a sliding window-based dense visual-inertial fusion method for real-time tracking of challenging aggressive motions. Our method combines recent advances in direct dense visual odometry, inertial measurement unit (IMU) preintegration, and graph-based optimization. At the front-end, direct dense visual odometry provides camera pose tracking that is resistant to motion blur. At the back-end, a sliding window optimization-based fusion framework with efficient IMU preintegration generates smooth and high-accuracy state estimates, even with occasional visual tracking failures. A local loop closure that is integrated into the back-end further eliminates drift after extremely aggressive motions. Our system runs real-time at 25 Hz on an off-the-shelf laptop. Experimental results show that our method is able to accurately track motions with angular velocities up to 1000 degrees/s and velocities up to 4 m/s. We also compare our method with state-of-the-art systems, such as Google Tango, and show superior performance during challenging motions. We show that our method achieves reliable tracking results, even if we throw the sensor suite during experiments.
DOI:10.1109/ROBIO.2015.7418830