Adversarial Learning-based Data Augmentation for Rotation-robust Human Tracking

• Published in: ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) pp. 1942 - 1946
• Main Authors: Chen, Kexin, Zhou, Xue, Zhou, Qidong, Xu, Hongbing
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2019
• Subjects: GAN-based data augmentation; Hard positives; Human tracking; Multi-domain network; Out-of-plane rotation
• ISSN: 2379-190X
• DOI: 10.1109/ICASSP.2019.8683451

This paper analyzes the diversity deficiency of positive training samples used to fine-tune CNN-based tracking networks, especially when confronted with large pose changes and out-of-plane rotation challenges. Therefore, we present a novel adversarial learning-based hard positives generation method and embed it into the multi-domain network (MDNet)-based tracking framework. Instead of adopting the dense sampling strategy to generate monotonous positive samples, we cast it as a cross-domain image transformation problem, which is designed to be able to generate hard positive samples with more diversity and some degree of motion blur and pose direction changes. Experimental results on tracking benchmark demonstrate the effectiveness and robustness of our proposed method compared with the state-of-art trackers.