E2ENNet: An end-to-end neural network for emotional brain-computer interface

• Published in: Frontiers in computational neuroscience Vol. 16; p. 942979
• Main Authors: Han, Zhichao, Chang, Hongli, Zhou, Xiaoyan, Wang, Jihao, Wang, Lili, Shao, Yongbin
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 12.08.2022; Frontiers Media S.A
• Subjects: Accuracy; Brain; Classification; Computer applications; Datasets; Deep learning; depthwise separable convolution; EEG; Electrodes; electroencephalogram (EEG); Electroencephalography; emotional brain-computer interface; Emotions; Experiments; Implants; long short-term memory; Mental disorders; Neural networks; neurocognitive; Neuroscience
• ISSN: 1662-5188; 1662-5188
• DOI: 10.3389/fncom.2022.942979

Objectve: Emotional brain-computer interface can recognize or regulate human emotions for workload detection and auxiliary diagnosis of mental illness. However, the existing EEG emotion recognition is carried out step by step in feature engineering and classification, resulting in high engineering complexity and limiting practical applications in traditional EEG emotion recognition tasks. We propose an end-to-end neural network, i.e., E2ENNet. Methods: Baseline removal and sliding window slice used for preprocessing of the raw EEG signal, convolution blocks extracted features, LSTM network obtained the correlations of features, and the softmax function classified emotions. Results: Extensive experiments in subject-dependent experimental protocol are conducted to evaluate the performance of the proposed E2ENNet, achieves state-of-the-art accuracy on three public datasets, i.e., 96.28% of 2-category experiment on DEAP dataset, 98.1% of 2-category experiment on DREAMER dataset, and 41.73% of 7-category experiment on MPED dataset. Conclusion: Experimental results show that E2ENNet can directly extract more discriminative features from raw EEG signals. Significance: This study provides a methodology for implementing a plug-and-play emotional brain-computer interface system.