The multiscale 3D convolutional network for emotion recognition based on electroencephalogram

• Published in: Frontiers in neuroscience Vol. 16; p. 872311
• Main Authors: Su, Yun, Zhang, Zhixuan, Li, Xuan, Zhang, Bingtao, Ma, Huifang
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 15.08.2022; Frontiers Media S.A
• Subjects: 3D CNN; Accuracy; Arousal; BCI; Brain research; Classification; Datasets; Deep learning; EEG; Electrodes; Electroencephalography; emotion recognition; Emotions; Interfaces; Machine learning; Methods; Neural networks; Neuroscience; Physiology; spatiotemporal features
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2022.872311

Emotion recognition based on EEG (electroencephalogram) has become a research hotspot in the field of brain-computer interfaces (BCI). Compared with traditional machine learning, the convolutional neural network model has substantial advantages in automatic feature extraction in EEG-based emotion recognition. Motivated by the studies that multiple smaller scale kernels could increase non-linear expression than a larger scale, we propose a 3D convolutional neural network model with multiscale convolutional kernels to recognize emotional states based on EEG signals. We select more suitable time window data to carry out the emotion recognition of four classes (low valence vs. low arousal, low valence vs. high arousal, high valence vs. low arousal, and high valence vs. high arousal). The results using EEG signals in the DEAP and SEED-IV datasets show accuracies for our proposed emotion recognition network model (ERN) of 95.67 and 89.55%, respectively. The experimental results demonstrate that the proposed approach is potentially useful for enhancing emotional experience in BCI.