STGATE: Spatial-temporal graph attention network with a transformer encoder for EEG-based emotion recognition

• Published in: Frontiers in human neuroscience Vol. 17; p. 1169949
• Main Authors: Li, Jingcong, Pan, Weijian, Huang, Haiyun, Pan, Jiahui, Wang, Fei
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Research Foundation 13.04.2023; Frontiers Media S.A
• Subjects: Accuracy; Attention; Brain research; deep learning; EEG; EEG-based emotion classification; Electroencephalography; Emotions; graph neural network; Graph representations; Human Neuroscience; Human-computer interaction; Memory; Nervous system; Neural networks; Neurosciences; Physiology; transformer encoder; deep learning; EEG-based emotion classification; graph neural network; EEG; transformer encoder
• ISSN: 1662-5161; 1662-5161
• DOI: 10.3389/fnhum.2023.1169949

Electroencephalogram (EEG) is a crucial and widely utilized technique in neuroscience research. In this paper, we introduce a novel graph neural network called the spatial-temporal graph attention network with a transformer encoder (STGATE) to learn graph representations of emotion EEG signals and improve emotion recognition performance. In STGATE, a transformer-encoder is applied for capturing time-frequency features which are fed into a spatial-temporal graph attention for emotion classification. Using a dynamic adjacency matrix, the proposed STGATE adaptively learns intrinsic connections between different EEG channels. To evaluate the cross-subject emotion recognition performance, leave-one-subject-out experiments are carried out on three public emotion recognition datasets, i.e., SEED, SEED-IV, and DREAMER. The proposed STGATE model achieved a state-of-the-art EEG-based emotion recognition performance accuracy of 90.37% in SEED, 76.43% in SEED-IV, and 76.35% in DREAMER dataset, respectively. The experiments demonstrated the effectiveness of the proposed STGATE model for cross-subject EEG emotion recognition and its potential for graph-based neuroscience research.