Study on Driver Cross-Subject Emotion Recognition Based on Raw Multi-Channels EEG Data

• Published in: Electronics (Basel) Vol. 12; no. 11; p. 2359
• Main Authors: Wang, Zhirong, Chen, Ming, Feng, Guofu
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 23.05.2023
• Subjects: Ablation; Accuracy; Artificial neural networks; Automobile drivers; Behavior; Brain research; Channels; Datasets; Deep learning; Electroencephalography; Emotion recognition; Emotional factors; Emotions; Experiments; Human behavior; Information technology; Laboratories; Model accuracy; Neural networks; Object recognition (Computers); Pattern recognition; Physiology; Psychological aspects; Smart cities; Traffic accidents; Traffic accidents & safety; China
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics12112359

In our life, emotions often have a profound impact on human behavior, especially for drivers, as negative emotions can increase the risk of traffic accidents. As such, it is imperative to accurately discern the emotional states of drivers in order to preemptively address and mitigate any negative emotions that may otherwise manifest and compromise driving behavior. In contrast to many current studies that rely on complex and deep neural network models to achieve high accuracy, this research aims to explore the potential of achieving high recognition accuracy using shallow neural networks through restructuring the structure and dimensions of the data. In this study, we propose an end-to-end convolutional neural network (CNN) model called simply ameliorated CNN (SACNN) to address the issue of low accuracy in cross-subject emotion recognition. We extracted features and converted dimensions of EEG signals from the SEED dataset from the BCMI Laboratory to construct 62-dimensional data, and obtained the optimal model configuration through ablation experiments. To further improve recognition accuracy, we selected the top 10 channels with the highest accuracy by separately training the EEG data of each of the 62 channels. The results showed that the SACNN model achieved an accuracy of 88.16% based on raw cross-subject data, and an accuracy of 91.85% based on EEG channel data from the top 10 channels. In addition, we explored the impact of the position of the BN and dropout layers on the model through experiments, and found that a targeted shallow CNN model performed better than deeper and larger perceptual field CNN models. Furthermore, we discuss herein the future issues and challenges of driver emotion recognition in promising smart city applications.