Sensor and Feature Level Fusion of Thermal Image and ECG Signals in Recognizing Human Emotions

Recent studies on recognition of various emotion labels concentrated on speech signals, text, visual images and anatomical variables. The proposed system combines the features of ECG which are extracted using empirical mode decomposition and features of thermal images which are extracted from Gray L...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of innovative technology and exploring engineering Vol. 9; no. 2S; pp. 78 - 82
Format Journal Article
LanguageEnglish
Published 31.12.2019
Online AccessGet full text

Cover

More Information
Summary:Recent studies on recognition of various emotion labels concentrated on speech signals, text, visual images and anatomical variables. The proposed system combines the features of ECG which are extracted using empirical mode decomposition and features of thermal images which are extracted from Gray Level Co-occurrence Matrix (GLCM) viz energy, contrast, homogeneity and correlation. ECG is acquired from AD8232 module and thermal images from FLUKE TiS20. Data of ECG and thermal images are acquired simultaneously from a subject and database consists of data from 40 subjects in age group of 20 years to 40 years from Hassan, Karnataka, India. Here different labels of emotions have been classified based on K-nearest neighbor decision rule. This system yielded highest accuracy for disgust and lowest for anger using ECG and highest accuracy for disgust and surprise and least for sad.
ISSN:2278-3075
2278-3075
DOI:10.35940/ijitee.B1054.1292S19