Roundness-Preserving Warping for Aesthetic Enhancement-Based Stereoscopic Image Editing

• Published in: IEEE transactions on circuits and systems for video technology Vol. 31; no. 4; pp. 1463 - 1477
• Main Authors: Chai, Xiongli, Shao, Feng, Jiang, Qiuping, Ho, Yo-Sung
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.04.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation; aesthetic enhancement; Aesthetics; Delaunay triangular mesh; depth adaptation; Distortion; Editing; Image enhancement; Image quality; Optimization; Roundness; Semantics; Shape; Stereo image processing; Stereoscopic image editing; Stereoscopy; Strain; Three-dimensional displays; Visualization; Warping; warping optimization
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2020.3010181

Image editing is an effective solution to adapt contents for different applications. In this paper, we present a roundness-preserving warping model for stereoscopic image editing, in which energy constraints from image quality energy, aesthetics energy and depth adaptation energy are involved in the framework to solve the optimization. Specifically, to preserve object roundness during warping, the relationship between object's shape and disparity is established and is applied for depth adaptation. Different from the existing stereoscopic image editing methods, the main innovations of our method are to achieve a tradeoff in balancing information loss and reducing semantic distortion while providing a novel death adaptation model for recomposition and retargeting applications. Experimental results demonstrate the effectiveness of our method in enhancing the aesthetics of stereoscopic images.