A Generative Adversarial Network to Denoise Depth Maps for Quality Improvement of DIBR-Synthesized Stereoscopic Images

• Published in: Journal of electrical engineering & technology Vol. 16; no. 4; pp. 2201 - 2210
• Main Authors: Zhang, Chuang, Sun, Xian-wen, Xu, Jiawei, Huang, Xiao-yu, Yu, Gui-yue, Park, Seop Hyeong
• Format: Journal Article
• Language: English
• Published: Singapore Springer Singapore 01.07.2021; 대한전기학회
• Subjects: Electrical Engineering; Electrical Machines and Networks; Electronics and Microelectronics; Engineering; Instrumentation; Original Article; Power Electronics; 전기공학; Generative adversarial networks; Stereoscopic image quality assessment; Depth image-based rendering; Depth map denoising
• ISSN: 1975-0102; 2093-7423
• DOI: 10.1007/s42835-021-00728-2

Depth map quality is an important factor that affects the quality of synthesized stereoscopic images in stereoscopic visual communication systems using the depth image-based rendering (DIBR) technique. This paper proposes a method using a generative adversarial network (GAN) to denoise depth maps corrupted by several types of distortion. The generative network of the proposed GAN builds on convolutional layers, residual layers, and transposed convolutional layers with symmetric skip connections. The discriminative network of the proposed GAN is designed as a convolutional neural network. The generative network for denoising depth maps is trained with cropped depth maps where distortion is applied. Objective and subjective assessment of denoised depth maps and DIBR-synthesized stereoscopic images demonstrate that the proposed GAN effectively reduces the distortion in the depth maps and improves the quality of DIBR-synthesized stereoscopic images.