Direct Sparse Odometry

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 40; no. 3; pp. 611 - 625
• Main Authors: Engel, Jakob, Koltun, Vladlen, Cremers, Daniel
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.03.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: 3D reconstruction; Cameras; Computational modeling; Geometry; Nonlinear response; Odometers; Optimization; Photometry; Pixels; Probabilistic models; Response functions; Robustness; SLAM; Smoothness; State of the art; structure from motion; Three-dimensional displays; Vignetting; Visual odometry; Visualization
• ISSN: 0162-8828; 1939-3539; 2160-9292
• DOI: 10.1109/TPAMI.2017.2658577

Direct Sparse Odometry (DSO) is a visual odometry method based on a novel, highly accurate sparse and direct structure and motion formulation. It combines a fully direct probabilistic model (minimizing a photometric error) with consistent, joint optimization of all model parameters, including geometry-represented as inverse depth in a reference frame-and camera motion. This is achieved in real time by omitting the smoothness prior used in other direct methods and instead sampling pixels evenly throughout the images. Since our method does not depend on keypoint detectors or descriptors, it can naturally sample pixels from across all image regions that have intensity gradient, including edges or smooth intensity variations on essentially featureless walls. The proposed model integrates a full photometric calibration, accounting for exposure time, lens vignetting, and non-linear response functions. We thoroughly evaluate our method on three different datasets comprising several hours of video. The experiments show that the presented approach significantly outperforms state-of-the-art direct and indirect methods in a variety of real-world settings, both in terms of tracking accuracy and robustness.