Consistent Stereo-Assisted Absolute Phase Unwrapping Methods for Structured Light Systems

• Published in: IEEE journal of selected topics in signal processing Vol. 6; no. 5; pp. 411 - 424
• Main Authors: Garcia, Ricardo R., Zakhor, Avideh
• Format: Journal Article
• Language: English
• Published: IEEE 01.09.2012
• Subjects: Cameras; Depth reconstruction; dynamic scene capture; Image reconstruction; Labeling; Minimization; Noise; phase unwrapping; stereo; structured light (SL); Three dimensional displays
• ISSN: 1932-4553; 1941-0484
• DOI: 10.1109/JSTSP.2012.2195157

Phase shifted sinusoidal patterns have proven to be effective in structured light systems, which typically consist of a camera and projector. They offer low decoding complexity, require as few as three projection frames per reconstruction, and are well suited for capturing dynamic scenes. In these systems, depth is reconstructed by determining the phase projected onto each pixel in the camera and establishing correspondences between camera and projector pixels. Typically, multiple periods are projected within the set of sinusoidal patterns, thus requiring phase unwrapping on the phase image before correspondences can be established. A second camera can be added to the structured light system to help with phase unwrapping. In this work, we present two consistent phase unwrapping methods for two-camera stereo structured light systems. The first method enforces viewpoint consistency by phase unwrapping in the projector domain. Loopy belief propagation is run over the graph of projector pixels to select pixel correspondences between the left and right camera that align in 3-D space and are spatially smooth in each 2-D image. The second method enforces temporal consistency by unwrapping across space and time. We combine a quality guided phase unwrapping approach with absolute phase estimates from the stereo cameras to solve for the absolute phase of connected regions. We present results for both methods to show their effectiveness on real world scenes.