CNN Confidence Estimation for Rejection-Based Hand Gesture Classification in Myoelectric Control

• Published in: IEEE transactions on human-machine systems Vol. 52; no. 1; pp. 99 - 109
• Main Authors: Bao, Tianzhe, Zaidi, Syed Ali Raza, Xie, Sheng Quan, Yang, Pengfei, Zhang, Zhi-Qiang
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.02.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial neural networks; Classification; Conditional probability; Convolutional neural network (CNN); Convolutional neural networks; Electromyography; Entropy; Estimation; Gesture recognition; hand gesture classification; Linear programming; model confidence; Myoelectric control; Myoelectricity; Neural networks; Optimization; Performance evaluation; Probability; Rejection rate; rejection strategy; surface electromyography (sEMG); Task analysis
• ISSN: 2168-2291; 2168-2305
• DOI: 10.1109/THMS.2021.3123186

Convolutional neural networks (CNNs) have been widely utilized to identify hand gestures from surface electromyography (sEMG) signals. However, due to the nonstationary characteristics of sEMG, the classification accuracy usually degrades significantly in the daily living environment involving complex hand movements. To further improve the reliability of a classifier, unconfident classifications are expected to be identified and rejected. In this study, we propose a novel approach to estimate the probability of correctness for each classification. Specifically, a confidence estimation model is established to generate confidence scores (ConfScore) based on posterior probabilities of CNN, and an objective function is designed to train the parameters of this model. In addition, a comprehensive metric that combines the true acceptance rate (TAR) and the true rejection rate (TRR) is proposed to evaluate the rejection performance of ConfScore, so that the tradeoff between system security and control lag could be fully considered. The effectiveness of ConfScore is verified using data from public databases and our online platform. The experimental results illustrate that ConfScore can better reflect the correctness of CNN classifications than traditional confidence features, i.e., maximum posterior probability and entropy of the probability vector. Moreover, the rejection performance is observed to be less sensitive to variations in rejection thresholds.