A BERT Based Method for Continuous Estimation of Cross-Subject Hand Kinematics From Surface Electromyographic Signals

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 31; pp. 87 - 96
• Main Authors: Lin, Chuang, Chen, Xingjian, Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong
• Format: Journal Article
• Language: English
• Published: United States IEEE 2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; BERT; Biomechanical Phenomena; Bit error rate; Coders; Convolution; Correlation coefficient; Correlation coefficients; cross-subjects; Electromyography; Electromyography - methods; Estimation; Feature extraction; Hand; hands kinematics; hard sample mining; Humans; Kinematics; Long short-term memory; Man-machine interfaces; Motion estimation; Movement; Performance evaluation; Performance measurement; sEMG; Transformers
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2022.3216528

Estimation of hand kinematics from surface electromyographic (sEMG) signals provides a non-invasive human-machine interface. This approach is usually subject-specific, so that the training on one individual does not generalise to different subjects. In this paper, we propose a method based on Bidirectional Encoder Representation from Transformers (BERT) structure to predict the movement of hands from the root mean square (RMS) feature of the sEMG signal following <inline-formula> <tex-math notation="LaTeX">\mu </tex-math></inline-formula>-law normalization. The method was tested for within-subject and cross-subject conditions. We trained the model with two hard sample mining methods, Gradient Harmonizing Mechanism (GHM) and Online Hard Sample Mining (OHEM). The proposed method was compared with classic approaches, including long short-term memory (LSTM) and Temporal Convolutional Network (TCN) as well as a recent method called Long Exposure Convolutional Memory Network (LE-ConvMN). Correlation coefficient (CC), normalized root mean square error (NRMSE) and time costs were used as performance metrics. Our method (sBERT-OHEM) achieved state-of-the-art performance in cross-subject evaluation as well as high performance in subject-specific tests on the Ninapro dataset. The above tests are based on the same randomly selected 10 subjects. Generally, in the cross-subject situation, with the increasing of the subjects' number, it unavoidably leads to the decline of the performance. While the performance of our method on 38 subjects was significantly higher than the other methods on 10 subjects in cross-subject conditions, which further verified the advantage of our methods.