A Hybrid Multimodal Fusion Framework for sEMG-ACC-Based Hand Gesture Recognition

• Published in: IEEE sensors journal Vol. 23; no. 3; pp. 2773 - 2782
• Main Authors: Duan, Shengcai, Wu, Le, Xue, Bo, Liu, Aiping, Qian, Ruobing, Chen, Xun
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.02.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accelerometer (ACC); Accelerometers; attention; Convolution; Data models; Feature extraction; Gesture recognition; Intermodal; Kernel; Learning; metric learning; multimodal fusion; myoelectric control; Performance enhancement; Robustness; Sensors

Hand gesture recognition (HGR) based on surface electromyogram (sEMG) and accelerometer (ACC) signals has attracted increasing attention. The design of an effective multimodal fusion strategy plays a vital role. Existing studies fuse sEMG and ACC either in a low-level data space or in a high-level d...