A novel EEG decoding method for a facial-expression-based BCI system using the combined convolutional neural network and genetic algorithm

• Published in: Frontiers in neuroscience Vol. 16; p. 988535
• Main Authors: Li, Rui, Liu, Di, Li, Zhijun, Liu, Jinli, Zhou, Jincao, Liu, Weiping, Liu, Bo, Fu, Weiping, Alhassan, Ahmad Bala
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 13.09.2022; Frontiers Media S.A
• Subjects: Accuracy; Algorithms; Brain; brain computer interface; Classification; Computer applications; convolutional neural network (CNN); Deep learning; Discriminant analysis; EEG; Electroencephalography; facial expression; genetic algorithm; Implants; Methods; Neural networks; Neuroscience; Optimization; Rehabilitation; Wavelet transforms
• DOI: 10.3389/fnins.2022.988535
• ISSN: 1662-453X; 1662-4548

Multiple types of brain-control systems have been applied in the field of rehabilitation. As an alternative scheme for balancing user fatigue and the classification accuracy of brain–computer interface (BCI) systems, facial-expression-based brain control technologies have been proposed in the form of novel BCI systems. Unfortunately, existing machine learning algorithms fail to identify the most relevant features of electroencephalogram signals, which further limits the performance of the classifiers. To address this problem, an improved classification method is proposed for facial-expression-based BCI (FE-BCI) systems, using a convolutional neural network (CNN) combined with a genetic algorithm (GA). The CNN was applied to extract features and classify them. The GA was used for hyperparameter selection to extract the most relevant parameters for classification. To validate the superiority of the proposed algorithm used in this study, various experimental performance results were systematically evaluated, and a trained CNN-GA model was constructed to control an intelligent car in real time. The average accuracy across all subjects was 89.21 ± 3.79%, and the highest accuracy was 97.71 ± 2.07%. The superior performance of the proposed algorithm was demonstrated through offline and online experiments. The experimental results demonstrate that our improved FE-BCI system outperforms the traditional methods.