Cross-Subject EEG Emotion Recognition With Self-Organized Graph Neural Network

• Published in: Frontiers in neuroscience Vol. 15; p. 611653
• Main Authors: Li, Jingcong, Li, Shuqi, Pan, Jiahui, Wang, Fei
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 09.06.2021; Frontiers Media S.A
• Subjects: Asymmetry; Cognitive ability; cross-subject; Datasets; EEG; Electroencephalography; emotion recognition; Emotions; Experiments; graph construction; graph neural network; Graph representations; Machine learning; Nervous system; Neural networks; Neuroscience; Neurosciences; SEED dataset
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2021.611653

As a physiological process and high-level cognitive behavior, emotion is an important subarea in neuroscience research. Emotion recognition across subjects based on brain signals has attracted much attention. Due to individual differences across subjects and the low signal-to-noise ratio of EEG signals, the performance of conventional emotion recognition methods is relatively poor. In this paper, we propose a self-organized graph neural network (SOGNN) for cross-subject EEG emotion recognition. Unlike the previous studies based on pre-constructed and fixed graph structure, the graph structure of SOGNN are dynamically constructed by self-organized module for each signal. To evaluate the cross-subject EEG emotion recognition performance of our model, leave-one-subject-out experiments are conducted on two public emotion recognition datasets, SEED and SEED-IV. The SOGNN is able to achieve state-of-the-art emotion recognition performance. Moreover, we investigated the performance variances of the models with different graph construction techniques or features in different frequency bands. Furthermore, we visualized the graph structure learned by the proposed model and found that part of the structure coincided with previous neuroscience research. The experiments demonstrated the effectiveness of the proposed model for cross-subject EEG emotion recognition.