Adaptive Gait Feature Learning Using Mixed Gait Sequence

• Published in: IEEE transaction on neural networks and learning systems Vol. 36; no. 1; pp. 1545 - 1554
• Main Authors: Chen, Yifan, Zhao, Yang, Li, Xuelong
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2025
• Subjects: Algorithms; Cameras; Data mining; Data models; Feature distance alignment (FDA); Feature extraction; Gait - physiology; Gait recognition; GSM; Humans; Legged locomotion; Machine Learning; multigranularity feature; Neural Networks, Computer; Pattern Recognition, Automated - methods; spatiotemporal gait feature
• ISSN: 2162-237X; 2162-2388; 2162-2388
• DOI: 10.1109/TNNLS.2023.3331050

Gait recognition has become a mainstream technology for identification, as it can recognize the identity of subjects from a distance without any cooperation. However, when subjects wear coats (CL) or backpacks (BG), their gait silhouette will be occluded, which will lose some gait information and bring great difficulties to the identification. Another important challenge in gait recognition is that the gait silhouette of the same subject captured by different camera angles varies greatly, which will cause the same subject to be misidentified as different individuals under different camera angles. In this article, we try to overcome these problems from three aspects: data augmentation, feature extraction, and feature refinement. Correspondingly, we propose gait sequence mixing (GSM), multigranularity feature extraction (MFE), and feature distance alignment (FDA). GSM is a method that belongs to data enhancement, which uses the gait sequences in NM to assist in learning the gait sequences in BG or CL, thus reducing the influence of lost gait information in abnormal gait sequences (BG or CL). MFE explores and fuses different granularity features of gait sequences from different scales, and it can learn as much useful information as possible from incomplete gait silhouettes. FDA refines the extracted gait features with the help of the distribution of gait features in real world and makes them more discriminative, thus reducing the influence of various camera angles. Extensive experiments demonstrate that our method has better results than some state-of-the-art methods on CASIA-B and mini-OUMVLP. We also embed the GSM module and FDA module into some state-of-the-art methods, and the recognition accuracy of these methods is greatly improved.