Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects

Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data...

Full description

Saved in:
Bibliographic Details
Published inScientific reports Vol. 11; no. 1; pp. 12059 - 12
Main Authors Sonkusare, Saurabh, Breakspear, Michael, Pang, Tianji, Nguyen, Vinh Thai, Frydman, Sascha, Guo, Christine Cong, Aburn, Matthew J.
Format Journal Article
LanguageEnglish
Published London Nature Publishing Group UK 08.06.2021
Nature Publishing Group
Nature Portfolio
Subjects
631/378
631/378/1959
631/378/1959/1315
631/477/2811
Cheek
Conductance
Emotions
Heart rate
Humanities and Social Sciences
multidisciplinary
Nose
Physiological responses
Physiology
Psychophysiological measures
Science
Science (multidisciplinary)
Spatial analysis
Online AccessGet full text

Cover

More Information
Summary:Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a novel application of motion correction and the results of spatial independent component analysis of the thermal data. Three distinct spatial components are recovered associated with the nose, the cheeks and respiration. We first benchmark this methodology against a traditional nose-tip region-of-interest based technique showing an expected similarity of signals extracted by these methods. We then show significant correlation of all the physiological responses across subjects, including the thermal signals, suggesting common dynamic shifts in emotional state induced by the movie. In sum, this study introduces an innovative approach to analyse facial IRI data and highlights the potential of thermal imaging to robustly capture emotion-related changes induced by ecological stimuli.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ISSN:2045-2322
2045-2322
DOI:10.1038/s41598-021-91578-5