Robust Variational Reconstruction from Multiple Views

• Published in: Image Analysis pp. 173 - 182
• Main Authors: Slesareva, Natalia, Bühler, Thomas, Hagenburg, Kai Uwe, Weickert, Joachim, Bruhn, Andrés, Karni, Zachi, Seidel, Hans-Peter
• Format: Book Chapter
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg
• Series: Lecture Notes in Computer Science
• Subjects: computer vision; multi-view reconstruction; partial differential equations; structure from motion; variational methods
• ISBN: 9783540730392; 3540730397
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-540-73040-8_18

Recovering a 3-D scene from multiple 2-D views is indispensable for many computer vision applications ranging from free viewpoint video to face recognition. Ideally the recovered depth map should be dense, piecewise smooth with fine level of details, and the recovery procedure shall be robust with respect to outliers and global illumination changes. We present a novel variational approach that satisfies these needs. Our model incorporates robust penalisation in the data term and anisotropic regularisation in the smoothness term. In order to render the data term robust with respect to global illumination changes, a gradient constancy assumption is applied to logarithmically transformed input data. Focussing on translational camera motion and considering small baseline distances between the different camera positions, we reconstruct a common disparity map that allows to track image points throughout the entire sequence. Experiments on synthetic image data demonstrate the favourable performance of our novel method.