Recognition of Upper Limb Action Intention Based on IMU

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 5; p. 1954
• Main Authors: Cui, Jian-Wei, Li, Zhi-Gang, Du, Han, Yan, Bing-Yan, Lu, Pu-Dong
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 02.03.2022; MDPI
• Subjects: 10-fold cross-validation; Accuracy; action intention recognition of upper limb; Algorithms; Amputation; Design; dividing motion unit; Electromyography - methods; Hand; inertial sensor; Intention; Machine learning; Neural networks; Neural Networks, Computer; Prostheses; prosthetic hand control; Sensors; Upper Extremity; Beijing China; China; prosthetic hand control; 10-fold cross-validation; dividing motion unit; inertial sensor; action intention recognition of upper limb
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22051954

Using motion information of the upper limb to control the prosthetic hand has become a hotspot of current research. The operation of the prosthetic hand must also be coordinated with the user’s intention. Therefore, identifying action intention of the upper limb based on motion information of the upper limb is key to controlling the prosthetic hand. Since a wearable inertial sensor bears the advantages of small size, low cost, and little external environment interference, we employ an inertial sensor to collect angle and angular velocity data during movement of the upper limb. Aiming at the action classification for putting on socks, putting on shoes and tying shoelaces, this paper proposes a recognition model based on the Dynamic Time Warping (DTW) algorithm of the motion unit. Based on whether the upper limb is moving, the complete motion data are divided into several motion units. Considering the delay associated with controlling the prosthetic hand, this paper only performs feature extraction on the first motion unit and the second motion unit, and recognizes action on different classifiers. The experimental results reveal that the DTW algorithm based on motion unit bears a higher recognition rate and lower running time. The recognition rate reaches as high as 99.46%, and the average running time measures 8.027 ms. In order to enable the prosthetic hand to understand the grasping intention of the upper limb, this paper proposes a Generalized Regression Neural Network (GRNN) model based on 10-fold cross-validation. The motion state of the upper limb is subdivided, and the static state is used as the sign of controlling the prosthetic hand. This paper applies a 10-fold cross-validation method to train the neural network model to find the optimal smoothing parameter. In addition, the recognition performance of different neural networks is compared. The experimental results show that the GRNN model based on 10-fold cross-validation exhibits a high accuracy rate, capable of reaching 98.28%. Finally, the two algorithms proposed in this paper are implemented in an experiment of using the prosthetic hand to reproduce an action, and the feasibility and practicability of the algorithm are verified by experiment.