Integration of multiscale fusion of residual neural network with 2-D gramian angular fields for lower limb movement recognition based on multi-channel sEMG signals

• Published in: Biomedical signal processing and control Vol. 99; p. 106807
• Main Authors: Zhou, Hao, Feng, Ruliang, Peng, Yinghu, Jin, Dingxun, Li, Xiaohui, Shou, Dahua, Li, Guanglin, Wang, Lin
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.01.2025
• Subjects: Gramian angular fields; Lower limb movement recognition; Multiscale feature fusion; Surface electromyography; Gramian angular fields; Surface electromyography; Multiscale feature fusion; Lower limb movement recognition
• DOI: 10.1016/j.bspc.2024.106807
• ISSN: 1746-8094

•A Multi-channel sEMG-driven lower limb movement recognition (LLMR) method was proposed based on Gramian Angular Fields (GAF) and multiscale fusion of Residual Neural Network (MS-ResNet).•Experimental analysis investigated the impact of the convolutional kernel size (k × k) in Stream 2 of MS-ResNet and the number of muscles involved on recognition performance.•The proposed method was compared with those of the related studies in the recognition performance.•This method provides a viable solution for developing more efficient and reliable lower limb movement recognition systems. The human lower limb movements recognition (LLMR) plays a pivotal role in active lower limb exoskeleton robots. Employing surface electromyography (sEMG) signals for LLMR allows for the convenient, rapid and stable capture of signal variations, facilitating efficient identification of lower limb motion patterns. However, current sEMG-based LLMR methods face challenges such as incomplete feature extraction, limited contextual information and restricted feature extraction scales during feature extraction. This paper proposed a LLMR method based on Gramian Angular Fields (GAF) and multiscale fusion of Residual Neural Network (MS-ResNet). The denoised sEMG time series was transformed into Gramian Angular Difference Field (GADF) matrix based on GAF. The MS-ResNet model, incorporating ResNet and multiscale feature fusion concepts, was proposed to comprehensively capture global and local information through different-scale feature extraction and fusion, so as to improve recognition performance. sEMG signals from 11 muscles of the preferred leg of 15 healthy subjects were recorded during six common lower limb movements. Experimental analysis investigated the impact of the convolutional kernel size (k × k) in Stream 2 of MS-ResNet and the number of muscles involved on recognition performance. The study revealed that selecting k as 13, coupled with 11 muscles, yielded optimal model performance with the average cross-individual recognition accuracy reaching 97.62 %, demonstrating the model’s efficiency in LLMR. This method could provide a viable solution for developing more efficient and reliable LLMR systems, applicable to lower limb exoskeleton robots and intelligent prosthetics.