Real-time Facial Expression Recognition to Enhance Emotional Intelligence in Autism

The ability to interpret emotions from facial expressions is essential in social interaction. However, these abilities are complex for individuals with autism spectrum disorder (ASD). This study aims to develop a real-time human facial expression recognition system on a mobile phone application to h...

Full description

Saved in:
Bibliographic Details
Published inProcedia computer science Vol. 234; pp. 222 - 229
Main Authors Sholikah, Rizka Wakhidatus, Ginasrdi, R V Hari, Nugroho, Stefanus Lionel Carlo, Ghozali, Khakim, Indrawanti, Annisaa Sri
Format Journal Article
LanguageEnglish
Published Elsevier B.V 2024
Subjects
Facial expression recognition
real-time, mobile app, VGG-16, autism
Facial expression recognition
real-time, mobile app, VGG-16, autism
Online AccessGet full text

Cover

More Information
Summary:The ability to interpret emotions from facial expressions is essential in social interaction. However, these abilities are complex for individuals with autism spectrum disorder (ASD). This study aims to develop a real-time human facial expression recognition system on a mobile phone application to help individuals with ASD. The expression recognition model was developed using the FER-2013 dataset with the VGG-16 architecture. The experimental results show that the model obtained from the VGG-16 architecture can produce the best accuracy and average F1 scores with 0.91 and 0.91, respectively. We also experiment with three individuals with ASD, resulting in increasing interest in learning the expression.
ISSN:1877-0509
1877-0509
DOI:10.1016/j.procs.2024.02.169