On Input/Output Architectures for Convolutional Neural Network-Based Cross-View Gait Recognition

• Published in: IEEE transactions on circuits and systems for video technology Vol. 29; no. 9; pp. 2708 - 2719
• Main Authors: Takemura, Noriko, Makihara, Yasushi, Muramatsu, Daigo, Echigo, Tomio, Yagi, Yasushi
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.09.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial neural networks; Convolution; Convolutional neural network; cross-view; Displacement; Gait recognition; Matching; Mathematical analysis; Network architecture; Neural networks; Performance evaluation; Probes; Robustness
• DOI: 10.1109/TCSVT.2017.2760835
• ISSN: 1051-8215

In this paper, we discuss input/output architectures for convolutional neural network (CNN)-based cross-view gait recognition. For this purpose, we consider two aspects: verification versus identification and the tradeoff between spatial displacements caused by subject difference and view difference. More specifically, we use the Siamese network with a pair of inputs and contrastive loss for verification and a triplet network with a triplet of inputs and triplet ranking loss for identification. The aforementioned CNN architectures are insensitive to spatial displacement, because the difference between a matching pair is calculated at the last layer after passing through the convolution and max pooling layers; hence, they are expected to work relatively well under large view differences. By contrast, because it is better to use the spatial displacement to its best advantage because of the subject difference under small view differences, we also use CNN architectures where the difference between a matching pair is calculated at the input level to make them more sensitive to spatial displacement. We conducted experiments for cross-view gait recognition and confirmed that the proposed architectures outperformed the state-of-the-art benchmarks in accordance with their suitable situations of verification/identification tasks and view differences.