A Transformer-based Multi-task Learning Framework for Myoelectric Pattern Recognition Supporting Muscle Force Estimation

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 31; p. 1
• Main Authors: Li, Xinhui, Zhang, Xu, Zhang, Liwei, Chen, Xiang, Zhou, Ping
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Classification; Control systems; Electrodes; Electromyography; Estimation; Force; Gesture recognition; Interfaces; Learning; multi-task learning; Muscle contraction; muscle force estimation; Muscles; Myoelectric control; Myoelectric pattern recognition; Myoelectricity; Pattern recognition; Prostheses; Robust control; Task analysis; transformer model; Transformers; varying muscle strengths
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2023.3298797

Simultaneous implementation of myoelectric pattern recognition and muscle force estimation is highly demanded in building natural gestural interfaces but a challenging task due to the gesture classification accuracy degradation under varying muscle strengths. To address this problem, a novel method using transformer-based multi-task learning (MTL-Transformer) for the prediction of both myoelectric patterns and corresponding muscle strengths was proposed to describe the inherent characteristics of an individual gesture pattern under different force conditions, thereby improving the accuracy of myoelectric pattern recognition. In addition, the transformer model enabled the characterization of long-term temporal correlations to ensure precise and smooth estimation of the muscle force. The performance of the proposed MTL-Transformer framework was evaluated via experiments of classifying eleven hand gestures and estimating the corresponding muscle force simultaneously, using high-density surface electromyogram (HD-sEMG) recordings from forearm flexor muscles of eleven intact-limbed subjects. The MTL-Transformer framework yielded high classification accuracy (98.70±1.21%) and low root mean square deviation (12.59±2.76%), and outperformed other two common temporally modelling methods significantly ( p < 0.05) in terms of both improved gesture recognition accuracies and reduced muscle force estimation errors. The MTL-Transformer framework is demonstrated as an effective solution for simultaneous implementation of myoelectric pattern recognition and muscle force estimation. This study promotes the development of robust and smooth myoelectric control systems, with wide applications in gestural interfaces, prosthetic and orthotic control.