Saliency-aware geodesic video object segmentation

• Published in: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp. 3395 - 3402
• Main Authors: Wenguan Wang, Jianbing Shen, Porikli, Fatih
• Format: Conference Proceeding Journal Article
• Language: English
• Published: IEEE 01.06.2015
• Subjects: Color; Computational modeling; Computer vision; Construction; Dynamics; Estimation; Image edge detection; Indicators; Mathematical models; Object segmentation; Pattern recognition; Segmentation; Spatiotemporal phenomena; Yttrium
• ISSN: 1063-6919; 1063-6919
• DOI: 10.1109/CVPR.2015.7298961

We introduce an unsupervised, geodesic distance based, salient video object segmentation method. Unlike traditional methods, our method incorporates saliency as prior for object via the computation of robust geodesic measurement. We consider two discriminative visual features: spatial edges and temporal motion boundaries as indicators of foreground object locations. We first generate framewise spatiotemporal saliency maps using geodesic distance from these indicators. Building on the observation that foreground areas are surrounded by the regions with high spatiotemporal edge values, geodesic distance provides an initial estimation for foreground and background. Then, high-quality saliency results are produced via the geodesic distances to background regions in the subsequent frames. Through the resulting saliency maps, we build global appearance models for foreground and background. By imposing motion continuity, we establish a dynamic location model for each frame. Finally, the spatiotemporal saliency maps, appearance models and dynamic location models are combined into an energy minimization framework to attain both spatially and temporally coherent object segmentation. Extensive quantitative and qualitative experiments on benchmark video dataset demonstrate the superiority of the proposed method over the state-of-the-art algorithms.