Subject-Independent Odor Pleasantness Classification Using Brain and Peripheral Signals

• Published in: IEEE transactions on affective computing Vol. 7; no. 4; pp. 422 - 434
• Main Authors: Kroupi, Eleni, Vesin, Jean-Marc, Ebrahimi, Touradj
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.10.2016; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Audio data; Brain models; Classification; EEG; Electrocardiography; Electrodes; Electroencephalography; fusion; Heart rate variability; Multimedia; Multimedia communication; odor pleasantness; Odors; Olfactory; Wasserstein distance
• DOI: 10.1109/TAFFC.2015.2496310
• ISSN: 1949-3045

Enhanced sensation of reality from multimedia contents can be achieved by creating realistic multimedia environments, using visual, auditory, and olfactory information. Although the affective information from video and audio has been extensively studied, the olfactory sense has received less attention. A way to assess human experience from audio, video or odors, is by investigating physiological signals. In this study, 23 subjects experienced pleasant, unpleasant, and neutral odors while their electroencephalogram (EEG), and electrocardiogram (ECG) were recorded. Two independent three-class classifiers were trained and tested, using EEG or ECG features. The results reveal a significant increase in the classification performance when EEG features were used (Cohen's kappa k = 0.44 ± 0.14; p <; 0.001). The results also indicate that it is possible to automatically classify the perception of unpleasant odors using EEG signals, but the classification performance decreases significantly when classifying between pleasant and neutral odors. Among the EEG features, the Wasserstein distance metric estimated between trial and baseline power achieved the highest classification performance. Features from ECG signals did not result in a significantly non-random performance.