Continuous Music-Emotion Recognition Based on Electroencephalogram

• Published in: IEICE Transactions on Information and Systems Vol. E99.D; no. 4; pp. 1234 - 1241
• Main Authors: THAMMASAN, Nattapong, MORIYAMA, Koichi, FUKUI, Ken-ichi, NUMAO, Masayuki
• Format: Journal Article
• Language: English; Japanese
• Published: The Institute of Electronics, Information and Communication Engineers 2016
• Subjects: Algorithms; Classification; electroencephalogram; Electroencephalography; emotion; Emotions; Fractal analysis; Music; Oscillations; Recognition
• ISSN: 0916-8532; 1745-1361
• DOI: 10.1587/transinf.2015EDP7251

Research on emotion recognition using electroencephalogram (EEG) of subjects listening to music has become more active in the past decade. However, previous works did not consider emotional oscillations within a single musical piece. In this research, we propose a continuous music-emotion recognition approach based on brainwave signals. While considering the subject-dependent and changing-over-time characteristics of emotion, our experiment included self-reporting and continuous emotion annotation in the arousal-valence space. Fractal dimension (FD) and power spectral density (PSD) approaches were adopted to extract informative features from raw EEG signals and then we applied emotion classification algorithms to discriminate binary classes of emotion. According to our experimental results, FD slightly outperformed PSD approach both in arousal and valence classification, and FD was found to have the higher correlation with emotion reports than PSD. In addition, continuous emotion recognition during music listening based on EEG was found to be an effective method for tracking emotional reporting oscillations and provides an opportunity to better understand human emotional processes.