Quality-controlled view interpolation for multiview video

• Published in: 2011 18th IEEE International Conference on Image Processing pp. 1805 - 1808
• Main Authors: Makar, M., Yao-Chung Lin, Ngai-Man Cheung, Pang, D., Girod, B.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2011
• Subjects: Complexity theory; Conferences; Decoding; Encoding; Image coding; Interpolation; multiview video; video quality; Visualization
• ISBN: 1457713047; 9781457713040
• ISSN: 1522-4880; 2381-8549
• DOI: 10.1109/ICIP.2011.6115814

Multiview video coding systems are characterized by their high encoding complexity. In this paper, we propose to reduce the encoding complexity by omitting frames at the encoder in a pattern that keeps the ability to reconstruct an interpolated version of each omitted frame, by motion-compensated and inter-view interpolation. Since our goal is maintaining good visual quality, we propose a method to estimate the quality of the interpolated frames at the decoder by transmitting a small amount of error control information in lieu of an omitted frame. This information is obtained from a projection of the frame on a suitable low-dimensional basis. The projection coefficients can be compressed by conventional techniques or, more efficiently, by Slepian-Wolf coding. Based on the quality estimate, the decoder can adaptively detect the interpolation technique that results in better visual quality. Moreover, it can suppress occasional frames for which interpolation yields noticeable artifacts. Experimental results demonstrate that our approach eliminates most interpolation artifacts and achieves much better visual quality at a very small increase in bit-rate.