DIBR-Synthesized Image Quality Assessment With Texture and Depth Information

• Published in: Frontiers in neuroscience Vol. 15; p. 761610
• Main Authors: Wang, Guangcheng, Shi, Quan, Shao, Yeqin, Tang, Lijuan
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 03.11.2021; Frontiers Media S.A
• Subjects: Algorithms; colorfulness; depth structure; depth-image-based-rendering; Design; Image processing; image quality assessment; Morphology; Neuroscience; Quality control; texture structure; Wavelet transforms
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2021.761610

Accurately predicting the quality of depth-image-based-rendering (DIBR) synthesized images is of great significance in promoting DIBR techniques. Recently, many DIBR-synthesized image quality assessment (IQA) algorithms have been proposed to quantify the distortion that existed in texture images. However, these methods ignore the damage of DIBR algorithms on the depth structure of DIBR-synthesized images and thus fail to accurately evaluate the visual quality of DIBR-synthesized images. To this end, this paper presents a DIBR-synthesized image quality assessment metric with Texture and Depth Information, dubbed as TDI. TDI predicts the quality of DIBR-synthesized images by jointly measuring the synthesized image's colorfulness, texture structure, and depth structure. The design principle of our TDI includes two points: (1) DIBR technologies bring color deviation to DIBR-synthesized images, and so measuring colorfulness can effectively predict the quality of DIBR-synthesized images. (2) In the hole-filling process, DIBR technologies introduce the local geometric distortion, which destroys the texture structure of DIBR-synthesized images and affects the relationship between the foreground and background of DIBR-synthesized images. Thus, we can accurately evaluate DIBR-synthesized image quality through a joint representation of texture and depth structures. Experiments show that our TDI outperforms the competing state-of-the-art algorithms in predicting the visual quality of DIBR-synthesized images.