Generalized Contrastive Partial Label Learning for Cross-Subject EEG-Based Emotion Recognition

• Published in: IEEE transactions on instrumentation and measurement Vol. 73; pp. 1 - 11
• Main Authors: Li, Wei, Fan, Lingmin, Shao, Shitong, Song, Aiguo
• Format: Journal Article
• Language: English
• Published: New York IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Affective computing; Brain modeling; Contrastive learning; Data models; Distillation; domain generalization; electroencephalogram (EEG); Electroencephalography; Emotion recognition; Emotions; Feature extraction; Labels; Machine learning; partial label learning (PLL); Phase locked loops; Self assessment; self-distillation; Training
• ISSN: 0018-9456; 1557-9662
• DOI: 10.1109/TIM.2024.3398103

Electroencephalogram (EEG)-based emotion recognition has become a hot topic in affective computing. However, due to the challenges of intersubject variability and label ambiguity of EEG data, existing research often suffers from poor performance. This limitation significantly hampers the practical application of cross-subject EEG-based emotion recognition. To overcome these challenges, we propose a novel and effective partial label learning (PLL) method, named generalized contrastive PLL (GCPL). By performing label disambiguation, GCPL can uncover the authentic emotion label from the multiple ambiguous emotions reported in the self-assessment of each subject. By integrating contrastive learning with domain generalization seamlessly, GCPL can extract the class-discriminative and domain-invariant features in spite of intersubject variability. Besides, by employing self-distillation, GCPL can mitigate the overfitting problem caused by the limited data size. Experimental results on the SEED, SEED-IV, MPED, and FACED datasets demonstrate the effectiveness of GCPL in cross-subject EEG-based emotion recognition.