Spectral Image-Based Multiday Surface Electromyography Classification of Hand Motions Using CNN for Human–Computer Interaction

• Published in: IEEE sensors journal Vol. 22; no. 21; pp. 20676 - 20683
• Main Authors: Qureshi, Muhammad Farrukh, Mushtaq, Zohaib, Rehman, Muhammad Zia ur, Kamavuako, Ernest Nlandu
• Format: Journal Article
• Language: English
• Published: New York The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 01.11.2022
• Subjects: Accuracy; Amputation; Artificial neural networks; Electromyography; Human-computer interface; Image classification; Myoelectric control; Myoelectricity; Pattern recognition; Performance evaluation; Performance measurement; Prostheses; Robust control
• ISSN: 1530-437X; 1558-1748
• DOI: 10.1109/JSEN.2022.3204121

Physiological signals such as electromyography (EMG) have been used in human–computer interaction (HCI) for medical applications. Wearable prostheses, such as robotic limbs, have seen a surge in popularity because of technological advancements in myoelectric interfaces. In spite of encouraging achievements with pattern-recognition-based control systems, user acceptability of prosthetic hands still needs improvement in control robustness. The purpose of this research is to compare multiday surface EMG (sEMG) recordings and measure the performance of convolutional neural network (CNN) to enhance myoelectric control. The performance metrics used in this study are accuracy, macro weighted precision (MWP), macro weighted recall (MWR), and macro [Formula Omitted]-score for eight able-bodied (healthy and nondisabled) and four amputee subjects. Using Mel-spectrogram-based sEMG data from both the able-bodied (healthy and nondisabled) and amputee participants, our proposed CNN has achieved a mean classification accuracy of 99.42% ± 0.42% and 98.00% ± 0.58% for the able-bodied (healthy and nondisabled) and amputee subjects for the within-day analysis, respectively. The proposed CNN outperformed other classifiers ([Formula Omitted]) in the between-day analysis for twofold (65.88% ± 10.1% and 58.37% ± 9.11%) and for sevenfold validation (88.73% ± 1.43% and 77.35% ± 2.72%) using sEMG recordings from the able-bodied (healthy and nondisabled) and amputee subjects, respectively. The proposed CNN is compared with the pretrained transfer learning (TL) models and has achieved higher accuracy with lower computational cost. The results demonstrate that CNN can considerably increase the effectiveness of the pattern recognition myoelectric control schemes and can extract deep information from EMG data.