Feature Extraction and Selection for Emotion Recognition from Electrodermal Activity

• Published in: IEEE transactions on affective computing Vol. 12; no. 4; pp. 857 - 869
• Main Authors: Shukla, Jainendra, Barreda-Angeles, Miguel, Oliver, Joan, Nandi, G. C., Puig, Domenec
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.10.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Arousal; Classification; Cognition; Discrete wavelet transforms; EDA; Emotion recognition; Emotions; Feature extraction; Feature recognition; feature selection; Frequency-domain analysis; Indexing; Machine learning; Mutual information; Optimization; Time-domain analysis; valence
• ISSN: 1949-3045; 1949-3045
• DOI: 10.1109/TAFFC.2019.2901673

Electrodermal activity (EDA) is indicative of psychological processes related to human cognition and emotions. Previous research has studied many methods for extracting EDA features; however, their appropriateness for emotion recognition has been tested using a small number of distinct feature sets and on different, usually small, data sets. In the current research, we reviewed 25 studies and implemented 40 different EDA features across time, frequency and time-frequency domains on the publicly available AMIGOS dataset. We performed a systematic comparison of these EDA features using three feature selection methods, Joint Mutual Information (JMI), Conditional Mutual Information Maximization (CMIM) and Double Input Symmetrical Relevance (DISR) and machine learning techniques. We found that approximately the same numbers of features are required to obtain the optimal accuracy for the arousal recognition and the valence recognition. Also, the subject-dependent classification results were significantly higher than the subject-independent classification for both arousal and valence recognition. Statistical features related to the Mel-Frequency Cepstral Coefficients (MFCC) were explored for the first time for the emotion recognition from EDA signals and they outperformed all other feature groups, including the most commonly used Skin Conductance Response (SCR) related features.