Analysis of Facial Occlusion Challenge in Thermal Images for Human Affective State Recognition

Several studies have been conducted using both visual and thermal facial images to identify human affective states. Despite the advantages of thermal facial images in recognizing spontaneous human affects, few studies have focused on facial occlusion challenges in thermal images, particularly eyegla...

Full description

Saved in:
Bibliographic Details
Published inSensors (Basel, Switzerland) Vol. 23; no. 7; p. 3513
Main Authors Al Qudah, Mustafa, Mohamed, Ahmad, Lutfi, Syaheerah
Format Journal Article
LanguageEnglish
Published Switzerland MDPI AG 27.03.2023
MDPI
Subjects
Accuracy
affects
Algorithms
Classification
Datasets
emotion
Emotions
eyeglass
Eyeglasses
Eyewear
Face - diagnostic imaging
Facial Expression
Forehead
Hair
Heat detection
Humans
Mouth
Occlusion
recognition
Respiration
Temperature
thermal
Thermal imaging
recognition
thermal
affects
emotion
eyeglass
occlusion
Online AccessGet full text

Cover

More Information
Summary:Several studies have been conducted using both visual and thermal facial images to identify human affective states. Despite the advantages of thermal facial images in recognizing spontaneous human affects, few studies have focused on facial occlusion challenges in thermal images, particularly eyeglasses and facial hair occlusion. As a result, three classification models are proposed in this paper to address the problem of thermal occlusion in facial images, with six basic spontaneous emotions being classified. The first proposed model in this paper is based on six main facial regions, including the forehead, tip of the nose, cheeks, mouth, and chin. The second model deconstructs the six main facial regions into multiple subregions to investigate the efficacy of subregions in recognizing the human affective state. The third proposed model in this paper uses selected facial subregions, free of eyeglasses and facial hair (beard, mustaches). Nine statistical features on apex and onset thermal images are implemented. Furthermore, four feature selection techniques with two classification algorithms are proposed for a further investigation. According to the comparative analysis presented in this paper, the results obtained from the three proposed modalities were promising and comparable to those of other studies.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1424-8220
1424-8220
DOI:10.3390/s23073513