ThermICA: Novel Approach for a Multivariate Analysis of Facial Thermal Responses

• Published in: IEEE transactions on biomedical engineering Vol. 72; no. 4; pp. 1237 - 1247
• Main Authors: Gioia, Federica, Greco, Alberto, Callara, Alejandro Luis, Vanello, Nicola, Scilingo, Enzo Pasquale, Citi, Luca
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.04.2025; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adult; Biomedical engineering; Biomedical monitoring; Blind source separation; Clinical medicine; contactless monitoring; Correlation; Face - physiology; Female; Humans; Independent component analysis; Infrared analysis; Infrared imaging; infrared thermography; Male; Monitoring; Multivariate Analysis; Perspiration; Physiology; Protocols; Psychophysiology; Recording; Respiration; Signal analysis; Signal Processing, Computer-Assisted; Skin; Skin temperature; Skin Temperature - physiology; Temperature measurement; Temperature sensors; Thermal analysis; Thermal imaging; Thermography; Thermography - methods; Young Adult
• ISSN: 0018-9294; 1558-2531; 1558-2531
• DOI: 10.1109/TBME.2024.3486628

Objective: Infrared Thermography (IRT) has been used to monitor skin temperature variation in a contactless manner, in both clinical medicine and psychophysiology. Here, we introduce a new methodology to obtain information about autonomic correlates related to perspiration, peripheral vasomotility, and respiration from infrared recordings. Methods: Our approach involves a model-based decomposition of facial thermograms using Independent Component Analysis (ICA) and an ad-hoc preprocessing procedure. We tested our approach on 30 healthy volunteers whose psychophysiological state was stimulated as part of an experimental protocol. Results: Within-subject ICA analysis identified three independent components demonstrating correlations with the reference physiological signals. Moreover, a linear combination of independent components effectively predicted each physiological signal, achieving median correlations of 0.9 for electrodermal activity, 0.8 for respiration, and 0.73 for photoplethysmography peaks envelope. In addition, we performed a cross-validated inter-subject analysis, which allows to predict physiological signals from facial thermograms of unseen subjects. Conclusions/Significance: Our findings validate the efficacy of features extracted from both original and thermal-derived signals for differentiating experimental conditions. This outcome emphasizes the sensitivity and promise of our approach, advocating for expanded investigations into thermal imaging within biomedical signal analysis. It underscores its potential for enhancing objective assessments of emotional states.