Emotion recognition with multiple physiological parameters based on ensemble learning

• Published in: Scientific reports Vol. 15; no. 1; pp. 19869 - 12
• Main Authors: Liao, Yilong, Gao, Yuan, Wang, Fang, Zhang, Li, Xu, Zhenrong, Wu, Yifan
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 06.06.2025; Nature Publishing Group; Nature Portfolio
• Subjects: 631/477; 639/166/985; 639/705/117; Adult; Artificial intelligence; Cosine annealing warm restart; Data processing; EEG; Electroencephalography; Emotion recognition; Emotions - physiology; Ensemble Learning; Female; Galvanic skin response; Galvanic Skin Response - physiology; Heart rate; Heart Rate - physiology; Humanities and Social Sciences; Humans; Learning; Long short-term memory; Machine Learning; Male; multidisciplinary; Multiple physiological parameters; Neural networks; Neural Networks, Computer; Physiology; Science; Science (multidisciplinary); Skin Temperature - physiology; Young Adult; Emotion recognition; Data processing; Multiple physiological parameters; Ensemble learning; Cosine annealing warm restart
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-025-96616-0

Emotion recognition is a key research area in artificial intelligence, playing a critical role in enhancing human-computer interaction and optimizing user experience design. This study explores the application and effectiveness of ensemble learning methods for emotion recognition based on multiple physiological parameters. A dataset was systematically constructed by preprocessing data from electroencephalogram (EEG), galvanic skin response (GSR), skin temperature (ST), and heart rate (HR) collected from 38 subjects while watching short videos. We proposed a hybrid model framework combining Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks, trained and optimized using a random seed initialization strategy and a cosine annealing warm restart strategy. To further enhance performance, various strategies were designed and evaluated. The results showed that applying advanced preprocessing techniques significantly improved data quality, while the hybrid model effectively leveraged the advantages of both CNN and LSTM. Incorporating the cosine annealing warm restart strategy further boosted model performance. Using a soft voting ensemble method, the proposed approach achieved a 96.21% accuracy rate in classifying seven emotions—calm, happy, disgust, surprise, anger, sad, and fear, indicating its ability to accurately capture emotional responses to short videos. This study presents an innovative approach to emotion recognition using multiple physiological parameters, demonstrating the potential of ensemble learning for complex tasks. It offers valuable insights for the development of effective applications.