Bundled depth-map merging for multi-view stereo

• Published in: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition pp. 2769 - 2776
• Main Authors: Jianguo Li, Li, E, Yurong Chen, Lin Xu, Yimin Zhang
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2010
• Subjects: Algorithm design and analysis; Clouds; Design methodology; Image reconstruction; Merging; Multicore processing; Optimization methods; Robustness; Solid modeling; Stereo image processing
• ISBN: 1424469848; 9781424469840
• ISSN: 1063-6919; 1063-6919
• DOI: 10.1109/CVPR.2010.5540004

Depth-map merging is one typical technique category for multi-view stereo (MVS) reconstruction. To guarantee accuracy, existing algorithms usually require either sub-pixel level stereo matching precision or continuous depth-map estimation. The merging of inaccurate depth-maps remains a challenging problem. This paper introduces a bundle optimization method for robust and accurate depth-map merging. In the method, depth-maps are generated using DAISY feature, followed by two stages of bundle optimization. The first stage optimizes the track of connected stereo matches to generate initial 3D points. The second stage optimizes the position and normals of 3D points. High quality point cloud is then meshed as geometric models. The proposed method can be easily parallelizable on multi-core processors. Middlebury evaluation shows that it is one of the most efficient methods among non-GPU algorithms, yet still keeps very high accuracy. We also demonstrate the effectiveness of the proposed algorithm on various real-world, high-resolution, self-calibrated data sets including objects with complex details, objects with large area of highlight, and objects with non-Lambertian surface.