An Efficient Graph Learning System for Emotion Recognition Inspired by the Cognitive Prior Graph of EEG Brain Network

• Published in: IEEE transaction on neural networks and learning systems Vol. 36; no. 4; pp. 7130 - 7144
• Main Authors: Li, Cunbo, Tang, Tian, Pan, Yue, Yang, Lei, Zhang, Shuhan, Chen, Zhaojin, Li, Peiyang, Gao, Dongrui, Chen, Huafu, Li, Fali, Yao, Dezhong, Cao, Zehong, Xu, Peng
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.04.2025
• Subjects: Adult; Affective computing; Algorithms; Attention - physiology; Brain - physiology; Brain modeling; Cognition; Cognition - physiology; cognition-inspired learning; electroencephalogram (EEG) brain networks; Electroencephalography; Electroencephalography - methods; Emotion recognition; Emotions - physiology; Feature extraction; graph neural network; Humans; Learning systems; Machine Learning; Neural Networks, Computer; Pattern Recognition, Automated - methods
• DOI: 10.1109/TNNLS.2024.3405663
• ISSN: 2162-237X; 2162-2388

Benefiting from the high-temporal resolution of electroencephalogram (EEG), EEG-based emotion recognition has become one of the hotspots of affective computing. For EEG-based emotion recognition systems, it is crucial to utilize state-of-the-art learning strategies to automatically learn emotion-related brain cognitive patterns from emotional EEG signals, and the learned stable cognitive patterns effectively ensure the robustness of the emotion recognition system. In this work, to realize the efficient decoding of emotional EEG, we propose a graph learning system [Graph Convolutional Network framework with Brain network initial inspiration and Fused attention mechanism (BF-GCN)] inspired by the brain cognitive mechanism to automatically learn graph patterns from emotional EEG and improve the performance of EEG emotion recognition. In the proposed BF-GCN, three graph branches, i.e., cognition-inspired functional graph branch, data-driven graph branch, and fused common graph branch, are first elaborately designed to automatically learn emotional cognitive graph patterns from emotional EEG signals. And then, the attention mechanism is adopted to further capture the brain activation graph patterns that are related to emotion cognition to achieve an efficient representation of emotional EEG signals. Essentially, the proposed BF-CGN model is a cognition-inspired graph learning neural network model, which utilizes the spectral graph filtering theory in the automatic learning and extracting of emotional EEG graph patterns. To evaluate the performance of the BF-GCN graph learning system, we conducted subject-dependent and subject-independent experiments on two public datasets, i.e., SEED and SEED-IV. The proposed BF-GCN graph learning system has achieved 97.44% (SEED) and 89.55% (SEED-IV) in subject-dependent experiments, and the results in subject-independent experiments have achieved 92.72% (SEED) and 82.03% (SEED-IV), respectively. The state-of-the-art performance indicates that the proposed BF-GCN graph learning system has a robust performance in EEG-based emotion recognition, which provides a promising direction for affective computing.