Trilateral filter construction for depth map upsampling

• Published in: IVMSP 2013 pp. 1 - 4
• Main Authors: Jaekwang Kim, Jaeho Lee, Seungryong Han, Dowan Kim, Jongsul Min, Changick Kim
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2013
• Subjects: Color; Depth map upsampling; fusion camera system; Image color analysis; Image edge detection; Image resolution; Kernel; Sensors; TOF depth sensor; trilateral filter; Vectors
• DOI: 10.1109/IVMSPW.2013.6611911

In recent years, fusion camera systems that consist of color cameras and Time-of-Flight (TOF) depth sensors have been popularly used due to its depth sensing capability at real-time frame rates. However, captured depth maps are limited in low resolution compared to the corresponding color images due to physical limitation of the TOF depth sensor. Although many algorithms have been proposed, they still yield erroneous results, especially when boundaries of the depth map and the color image are not aligned. We therefore propose a novel kernel regression framework to generate the high quality depth map. Our proposed filter is based on the vector pointing homogeneous pixels that represents the unit vector toward similar neighbors in the local region. The vectors are used to detect misaligned regions between color edges and depth edges. Experimental comparisons with other data fusion techniques prove the superiority of the proposed algorithm.