An Exosuit System With Bidirectional Hand Support for Bilateral Assistance Based on Dynamic Gesture Recognition

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 32; pp. 3147 - 3156
• Main Authors: Tang, Zhichuan, Zhu, Zhihao, Lv, Shengye, Hong, Xuanyu, Peng, Yuxin, Chen, Nuo
• Format: Journal Article
• Language: English
• Published: United States IEEE 2024
• Subjects: Activities of Daily Living; Adult; Algorithms; bilateral assistance; Cables; Electromyography; Exoskeleton Device; Exoskeletons; Exosuits; Feasibility Studies; Feature extraction; Female; Gesture recognition; Gestures; Hand - physiology; Hardware; Humans; Long short term memory; Male; Neural Networks, Computer; Pattern Recognition, Automated - methods; Software; Young Adult
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2024.3449338

Hand motor impairment has seriously affected the daily life of the elderly. We developed an electromyography (EMG) exosuit system with bidirectional hand support for bilateral coordination assistance based on a dynamic gesture recognition model using graph convolutional network (GCN) and long short-term memory network (LSTM). The system included a hardware subsystem and a software subsystem. The hardware subsystem included an exosuit jacket, a backpack module, an EMG recognition module, and a bidirectional support glove. The software subsystem based on the dynamic gesture recognition model was designed to identify dynamic and static gestures by extracting the spatio-temporal features of the patient's EMG signals and to control glove movement. The offline training experiment built the gesture recognition models for each subject and evaluated the feasibility of the recognition model; the online control experiments verified the effectiveness of the exosuit system. The experimental results showed that the proposed model achieve a gesture recognition rate of 96.42% <inline-formula> <tex-math notation="LaTeX">\pm ~3.26 </tex-math></inline-formula>%, which is higher than the other three traditional recognition models. All subjects successfully completed two daily tasks within a short time and the success rate of bilateral coordination assistance are 88.75% and 86.88%. The exosuit system can effectively help patients by bidirectional hand support strategy for bilateral coordination assistance in daily tasks, and the proposed method can be applied to various limb assistance scenarios.