An efficient hole-filling method based on depth map in 3D view generation

• Main Authors: Liang, Haitao, Su, Xiu, Liu, Yilin, Xu, Huaiyuan, Wang, Yi, Chen, Xiaodong
• Format: Conference Proceeding
• Language: English
• Published: SPIE 12.01.2018
• ISBN: 1510617515; 9781510617513
• ISSN: 0277-786X
• DOI: 10.1117/12.2293301

New virtual view is synthesized through depth image based rendering(DIBR) using a single color image and its associated depth map in 3D view generation. Holes are unavoidably generated in the 2D to 3D conversion process. We propose a hole-filling method based on depth map to address the problem. Firstly, we improve the process of DIBR by proposing a one-to-four (OTF) algorithm. The “z-buffer” algorithm is used to solve overlap problem. Then, based on the classical patch-based algorithm of Criminisi et al., we propose a hole-filling algorithm using the information of depth map to handle the image after DIBR. In order to improve the accuracy of the virtual image, inpainting starts from the background side. In the calculation of the priority, in addition to the confidence term and the data term, we add the depth term. In the search for the most similar patch in the source region, we define the depth similarity to improve the accuracy of searching. Experimental results show that the proposed method can effectively improve the quality of the 3D virtual view subjectively and objectively.