Cross-Modality Self-Attention and Fusion-Based Neural Network for Lower Limb Locomotion Mode Recognition

• Published in: IEEE transactions on automation science and engineering Vol. 22; pp. 5411 - 5424
• Main Authors: Zhao, Changchen, Liu, Kai, Zheng, Hao, Song, Wenbo, Pei, Zhongcai, Chen, Weihai
• Format: Journal Article
• Language: English
• Published: IEEE 2025
• Subjects: Accuracy; Cross-modality interaction; Electromyography; Feature extraction; Fuses; locomotion mode recognition; lower limb; neural network; Neural networks; Representation learning; self-attention; Stairs

Although there are many wearable sensors that make the acquisition of multi-modality data easier, effective feature extraction and fusion of the data is still challenging for lower limb locomotion mode recognition. In this article, a novel neural network is proposed for accurate prediction of five c...