Selective Light Field Refocusing for Camera Arrays Using Bokeh Rendering and Superresolution

• Published in: IEEE signal processing letters Vol. 26; no. 1; pp. 204 - 208
• Main Authors: Wang, Yingqian, Yang, Jungang, Guo, Yulan, Xiao, Chao, An, Wei
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.01.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Arrays; Bokeh; camera array; Cameras; Depth of field; depth of field (DoF); Image filters; Image reconstruction; Lenses; light field (LF); refocusing; Regularization; Rendering (computer graphics); Signal resolution; Spatial resolution; State of the art; superresolution (SR); Visualization
• ISSN: 1070-9908; 1558-2361
• DOI: 10.1109/LSP.2018.2885213

Camera arrays provide spatial and angular information within a single snapshot. With refocusing methods, focal planes can be altered after exposure. In this letter, we propose a light field refocusing method to improve the imaging quality of camera arrays. In our method, the disparity is first estimated. Then, the unfocused region (bokeh) is rendered by using a depth-based anisotropic filter. Finally, the refocused image is produced by a reconstruction-based superresolution approach where the bokeh image is used as a regularization term. Our method can selectively refocus images with focused region being superresolved and bokeh being esthetically rendered. Our method also enables postadjustment of depth of field. We conduct experiments on both public and self-developed datasets. Our method achieves superior visual performance with acceptable computational cost as compared to the other state-of-the-art methods.