Salient Object Detection: A Discriminative Regional Feature Integration Approach

• Published in: International journal of computer vision Vol. 123; no. 2; pp. 251 - 268
• Main Authors: Wang, Jingdong, Jiang, Huaizu, Yuan, Zejian, Cheng, Ming-Ming, Hu, Xiaowei, Zheng, Nanning
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.06.2017; Springer; Springer Nature B.V
• Subjects: Artificial Intelligence; Computer Imaging; Computer Science; Image Processing and Computer Vision; Machine learning; Object recognition; Pattern Recognition; Pattern Recognition and Graphics; Salience; Systems integration; Vision; Vision systems; Salient object detection; Data-driven
• ISSN: 0920-5691; 1573-1405
• DOI: 10.1007/s11263-016-0977-3

Feature integration provides a computational framework for saliency detection, and a lot of hand-crafted integration rules have been developed. In this paper, we present a principled extension, supervised feature integration, which learns a random forest regressor to discriminatively integrate the saliency features for saliency computation. In addition to contrast features, we introduce regional object-sensitive descriptors: the objectness descriptor characterizing the common spatial and appearance property of the salient object, and the image-specific backgroundness descriptor characterizing the appearance of the background of a specific image, which are shown more important for estimating the saliency. To the best of our knowledge, our supervised feature integration framework is the first successful approach to perform the integration over the saliency features for salient object detection, and outperforms the integration approach over the saliency maps. Together with fusing the multi-level regional saliency maps to impose the spatial saliency consistency, our approach significantly outperforms state-of-the-art methods on seven benchmark datasets. We also discuss several followup works which jointly learn the representation and the saliency map using deep learning.