Object Image Relighting through Patch Match Warping and Color Transfer

• Published in: 2016 International Conference on Virtual Reality and Visualization (ICVRV) pp. 235 - 241
• Main Authors: Xin Jin, Yulu Tian, Ningning Liu, Chaochen Ye, Jingying Chi, Xiaodong Li, Geng Zhao
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2016
• Subjects: Business; Chemicals; Color transfer; Economics; Illumination transfer; Image based relighting; Image color analysis; Lighting; Object relighting; Patch match; Virtual reality; Visualization
• DOI: 10.1109/ICVRV.2016.46

In this paper, we propose a novel method for image based object relighting through patch match warping and color transfer. According to our method, a pair of reference object images (A and B), without any knowledge of the 3D geometry or material information of the input object image, are needed. The input image has similar illumination condition as that of the reference image A. The reference image B has the target illumination condition. We first modify the color of the reference object images according to the color of the input object image. Then the modified reference image A is warped to the input image using the image patch match. The reference B has the same warping to that of A. At last, the illumination of the reference B is transferred to the input image through a local and global transfer model learned from the warped reference B and A. We test our method on the ALOI dataset (Amsterdam Library of Object Images) and acquire convincing relit result on numerous input and reference object images with different illumination conditions.