Recognizing emotions induced by wearable haptic vibration using noninvasive electroencephalogram

• Published in: Frontiers in neuroscience Vol. 17; p. 1219553
• Main Authors: Wang, Xin, Xu, Baoguo, Zhang, Wenbin, Wang, Jiajin, Deng, Leying, Ping, Jingyu, Hu, Cong, Li, Huijun
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Research Foundation 06.07.2023; Frontiers Media S.A
• Subjects: affective computing; affective haptics; Auditory stimuli; Communication; Datasets; Design; EEG; electroencephalogram; Electroencephalography; emotion recognition; Emotions; Entropy; Experiments; Haptics; Neural networks; Neuroscience; Physiology; Sensory integration; Visual stimuli; wearable haptic vibration; affective haptics; affective computing; wearable haptic vibration; emotion recognition; electroencephalogram
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2023.1219553

The integration of haptic technology into affective computing has led to a new field known as affective haptics. Nonetheless, the mechanism underlying the interaction between haptics and emotions remains unclear. In this paper, we proposed a novel haptic pattern with adaptive vibration intensity and rhythm according to the volume, and applied it into the emotional experiment paradigm. To verify its superiority, the proposed haptic pattern was compared with an existing haptic pattern by combining them with conventional visual–auditory stimuli to induce emotions (joy, sadness, fear, and neutral), and the subjects’ EEG signals were collected simultaneously. The features of power spectral density (PSD), differential entropy (DE), differential asymmetry (DASM), and differential caudality (DCAU) were extracted, and the support vector machine (SVM) was utilized to recognize four target emotions. The results demonstrated that haptic stimuli enhanced the activity of the lateral temporal and prefrontal areas of the emotion-related brain regions. Moreover, the classification accuracy of the existing constant haptic pattern and the proposed adaptive haptic pattern increased by 7.71 and 8.60%, respectively. These findings indicate that flexible and varied haptic patterns can enhance immersion and fully stimulate target emotions, which are of great importance for wearable haptic interfaces and emotion communication through haptics.