Weakly Supervised Pedestrian Segmentation for Person Re-Identification

• Published in: IEEE transactions on circuits and systems for video technology Vol. 33; no. 3; p. 1
• Main Authors: Jin, Ziqi, Xie, Jinheng, Wu, Bizhu, Shen, Linlin
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.03.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Datasets; Feature extraction; Image contrast; Image segmentation; Labels; Legged locomotion; Lips; mask-based augmentation; Re-Identification; Semantics; Task analysis; Training; weakly supervised segmentation
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2022.3210476

Person re-identification (RelD) is an important problem in intelligent surveillance and public security. Among all the solutions to this problem, existing mask-based methods first use a well-pretrained segmentation model to generate a foreground mask, in order to exclude the background from ReID. Then they perform the RelD task directly on the segmented pedestrian image. However, such a process requires extra datasets with pixel-level semantic labels. In this paper, we propose a Weakly Supervised Pedestrian Segmentation (WSPS) framework to produce the foreground mask directly from the RelD datasets. In contrast, our WSPS only requires image-level subject ID labels. To better utilize the pedestrian mask, we also propose the Image Synthesis Augmentation (ISA) technique to further augment the dataset. Experiments show that the features learned from our proposed framework are robust and discriminative. Compared with the baseline, the mAP of our framework is about 4.4%, 11.7%, and 4.0% higher on three widely used datasets including Market-1501, CUHK03, and MSMT17. The code will be available soon.