Personalized Image Semantic Segmentation

• Published in: Proceedings / IEEE International Conference on Computer Vision pp. 10529 - 10539
• Main Authors: Zhang, Yu, Zhang, Chang-Bin, Jiang, Peng-Tao, Cheng, Ming-Ming, Mao, Feng
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2021
• Subjects: Codes; Computer vision; Correlation; Datasets and evaluation; grouping and shape; Image segmentation; Segmentation; Semantics
• DOI: 10.1109/ICCV48922.2021.01038

Semantic segmentation models trained on public datasets have achieved great success in recent years. However, these models didn't consider the personalization issue of segmentation though it is important in practice. In this paper, we address the problem of personalized image segmentation. The objective is to generate more accurate segmentation results on unlabeled personalized images by investigating the data's personalized traits. To open up future research in this area, we collect a large dataset containing various users' personalized images called PSS (Personalized Semantic Segmentation). We also survey some recent researches related to this problem and report their performance on our dataset. Furthermore, by observing the correlation among a user's personalized images, we propose a baseline method that incorporates the inter-image context when segmenting certain images. Extensive experiments show that our method outperforms the existing methods on the proposed dataset. The code and the PSS dataset are available at https://mmcheng.net/pss/.