Embedding Novel Views in a Single JPEG Image

We propose a novel approach for embedding novel views in a single JPEG image while preserving the perceptual fidelity of the modified JPEG image and the restored novel views. We adopt the popular novel view synthesis representation of multiplane images (MPIs). Our model first encodes 32 MPI layers (...

Full description

Saved in:
Bibliographic Details
Published in2021 IEEE/CVF International Conference on Computer Vision (ICCV) pp. 14499 - 14507
Main Authors Wu, Yue, Meng, Guotao, Chen, Qifeng
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.10.2021
Subjects
Codes
Computer vision
Convolution
Image and video synthesis
Image coding
Image color analysis
Prediction methods
Transform coding
Online AccessGet full text

Cover

More Information
Summary:We propose a novel approach for embedding novel views in a single JPEG image while preserving the perceptual fidelity of the modified JPEG image and the restored novel views. We adopt the popular novel view synthesis representation of multiplane images (MPIs). Our model first encodes 32 MPI layers (totally 128 channels) into a 3-channel JPEG image that can be decoded for MPIs to render novel views, with an embedding capacity of 1024 bits per pixel. We conducted experiments on public datasets with different novel view synthesis methods, and the results show that the proposed method can restore high-fidelity novel views from a slightly modified JPEG image. Furthermore, our method is robust to JPEG compression, color adjusting, and cropping. Our source code will be publicly available.
ISSN:2380-7504
DOI:10.1109/ICCV48922.2021.01425