A cascade fusion scheme for gait and cumulative foot pressure image recognition

• Published in: Pattern recognition Vol. 45; no. 10; pp. 3603 - 3610
• Main Authors: Zheng, Shuai, Huang, Kaiqi, Tan, Tieniu, Tao, Dacheng
• Format: Journal Article
• Language: English
• Published: Kidlington Elsevier Ltd 01.10.2012; Elsevier
• Subjects: Applied sciences; Cascades; Exact sciences and technology; Foot pressure image; Forensic engineering; Gait; Galleries; Grounds; Human recognition; Information, signal and communications theory; Pattern recognition; Recognition; Retrieval; Signal and communications theory; Signal processing; Signal representation. Spectral analysis; Signal, noise; Telecommunications and information theory; Gait; Foot pressure image; Human recognition; Biometrics; Performance evaluation; Multistage method; Image recognition; Pedestrian; Forensic aspect; Pattern recognition; Canonical correlation; Canonical analysis; Image analysis; Correlation analysis; Image sequence; Limb; Automatic recognition; Biomedical engineering
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2012.03.008

Cumulative foot pressure images represent the 2D ground reaction force during one gait cycle. Biomedical and forensic studies show that humans can be distinguished by unique limb movement patterns and ground reaction force. Considering continuous gait pose images and corresponding cumulative foot pressure images, this paper presents a cascade fusion scheme to represent the potential connections between them and proposes a two-modality fusion based recognition system. The proposed scheme contains two stages: (1) given cumulative foot pressure images, canonical correlation analysis is employed to retrieve corresponding gait pose image candidates in gallery dataset; (2) pedestrian recognition is achieved via small samples matching between retrieved gait pose images and unlabeled ones. The proposed fusion recognition system is not only insensitive to slight changes of environment and the individual users, but also can be extended to multiple biometrics retrieval. Experimental results are conducted on the CASIA gait–footprint dataset, which contains cumulative foot pressure images and its corresponding gait pose image sequence from 88 subjects. Evaluation results suggest the effectiveness of the proposed scheme compared to other related approaches. ► New recognition problem with gait and cumulative foot pressure is presented. ► A CCA-based cascade fusion scheme is developed to address the proposed problem. ► Correlation between the two walking patterns is proved to be effective in recognition.