Convolutional neural network-based depth image artifact removal

In 3D video coding and depth-based image rendering, the distortion of the compressed depth image often leads to wrong 3D warpping. In this paper, by generalizing the recent work of convolutional neural network (CNN)-based depth image up-sampling, we propose a CNN-based depth image artifact removal s...

Full description

Saved in:
Bibliographic Details
Published in2017 IEEE International Conference on Image Processing (ICIP) pp. 2438 - 2442
Main Authors Zhao, Lijun, Liang, Jie, Bai, Huihui, Wang, Anhong, Zhao, Yao
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.09.2017
Subjects
3D video coding
CNN
Color
depth filtering
Feature extraction
Image coding
Image color analysis
Image resolution
joint filtering
Three-dimensional displays
Training
Online AccessGet full text

Cover

More Information
Summary:In 3D video coding and depth-based image rendering, the distortion of the compressed depth image often leads to wrong 3D warpping. In this paper, by generalizing the recent work of convolutional neural network (CNN)-based depth image up-sampling, we propose a CNN-based depth image artifact removal scheme, where both the compressed depth and color images are used to enhance the depth accuracy. The proposed CNN has two sub-networks: joint depth-color sub-network and joint depth sub-network. During the depth and color feature extraction, the gradient of the depth image is used as the input to color image, while the gradient of color image is used as the input of depth feature extraction. Such an exchange of gradient information improves the learned features. Experimental results in terms of both objective and subjective quality of the depth and color images verify the efficiency of the proposed method.
ISSN:2381-8549
DOI:10.1109/ICIP.2017.8296720