Reconstruction of depth and normals from interreflections

• Published in: 2013 IEEE International Conference on Image Processing pp. 2557 - 2561
• Main Authors: Binh-Son Hua, Tian-Tsong Ng, Kok-Lim Low
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2013
• Subjects: depth reconstruction; light transport; normal reconstruction; shape from interreflections
• ISSN: 1522-4880; 2381-8549
• DOI: 10.1109/ICIP.2013.6738527

While geometry reconstruction has been extensively studied, several shortcomings still exist. First, traditional geometry reconstruction methods such as geometric or photometric stereo only recover either surface depth or normals. Second, such methods require calibration. Third, such methods cannot recover accurate geometry in the presence of interreflections. In order to address these problems in a single system, we propose an approach to reconstruct geometry from light transport data. Specifically, we investigate the problem of geometry reconstruction from interreflections in a light transport matrix. We show that by solving a system of polynomial equations derived directly from the interreflection matrix, both surface depth and normals can be fully reconstructed. Our system does not require projector-camera calibration, but only make use of a calibration object such as a checkerboard in the scene to pre-determine a few known points to simplify the polynomial solver. Our experimental results show that our system is able to reconstruct accurate geometry from interreflections up to a certain noise level. Our system is easy to set up in practice.