Exploring the application domains of ML-based facial emotion recognition systems: Framework, techniques and challenges

Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication and are complemented by other gestures like eye contact, hand movement, etc. This is the direct method of communication of human emotions an...

Full description

Saved in:
Bibliographic Details
Published inAIP conference proceedings Vol. 2919; no. 1
Main Authors Rani, Sita, Bhambri, Pankaj, Kaur, Jaskiran, Sangwan, Yashwant Singh
Format Journal Article Conference Proceeding
LanguageEnglish
Published Melville American Institute of Physics 25.03.2024
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication and are complemented by other gestures like eye contact, hand movement, etc. This is the direct method of communication of human emotions and intent. In this paper, the authors present the Facial Emotion Recognition (FER) framework and a brief survey of various FER techniques. It also presents the various phases of the FER system i.e., face detection, pre-processing, feature extraction, and classification. Various FER databases like JAFFE, YALE, MUG, etc. are also summarized in terms of the number of emotions, number of images, and resolution. The importance of the domain in other related subject areas like medicine, neuroscience, psychology, decision science, gaming, mental research, etc., is also introduced. The authors explored the application areas of FER techniques. The authors also present the various challenges faced in the real-time implementation of FER models. Finally, the paper is concluded by discussing future research directions.
AbstractList Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication and are complemented by other gestures like eye contact, hand movement, etc. This is the direct method of communication of human emotions and intent. In this paper, the authors present the Facial Emotion Recognition (FER) framework and a brief survey of various FER techniques. It also presents the various phases of the FER system i.e., face detection, pre-processing, feature extraction, and classification. Various FER databases like JAFFE, YALE, MUG, etc. are also summarized in terms of the number of emotions, number of images, and resolution. The importance of the domain in other related subject areas like medicine, neuroscience, psychology, decision science, gaming, mental research, etc., is also introduced. The authors explored the application areas of FER techniques. The authors also present the various challenges faced in the real-time implementation of FER models. Finally, the paper is concluded by discussing future research directions.
Author Rani, Sita
Bhambri, Pankaj
Kaur, Jaskiran
Sangwan, Yashwant Singh
Author_xml – sequence: 1
  givenname: Sita
  surname: Rani
  fullname: Rani, Sita
  organization: Department of Computer Science & Engineering, Guru Nanak Dev Engineering College
– sequence: 2
  givenname: Pankaj
  surname: Bhambri
  fullname: Bhambri, Pankaj
  email: pkbhambri@gmail.com
  organization: Department of Information Technology, Guru Nanak Dev Engineering College
– sequence: 3
  givenname: Jaskiran
  surname: Kaur
  fullname: Kaur, Jaskiran
  email: jaskirankaur899@gmail.com
  organization: Department of Information Technology, Guru Nanak Dev Engineering College
– sequence: 4
  givenname: Yashwant Singh
  surname: Sangwan
  fullname: Sangwan, Yashwant Singh
  email: yssangwan@gmail.com
  organization: Department of Computer Science, Govt. College
BookMark eNotkMtOwzAQRS1UJNrCgj-wxA6RYjtO7LBDVQtIRWxAYhdNHCd1Sexgp0D_nvSxmlkc3Zl7JmhkndUIXVMyoySN75MZoZLLhJ2hMU0SGomUpiM0JiTjEePx5wWahLAhhGVCyDH6Wfx1jfPG1rhfawxd1xgFvXEWl64FYwN2FX5dRQUEXeIKlIEG69YdEK-Vq6057GEXet2GB7z00Opf57_ucK_V2prvrQ4YbInVGppG21qHS3ReQRP01WlO0cdy8T5_jlZvTy_zx1XU0VSyKFECNE9ZpYByUjKiYy6LjJdxKrkqCikqUaiMyKwCSbgUQynggjDFyjihNJ6im2Nu593-jT7fuK23w8l8EJAxMjgSA3V7pIIy_aF83nnTgt_llOR7r3mSn7zG_2QJbMo
CODEN APCPCS
ContentType Journal Article
Conference Proceeding
Copyright Author(s)
2024 Author(s). Published by AIP Publishing.
Copyright_xml – notice: Author(s)
– notice: 2024 Author(s). Published by AIP Publishing.
DBID 8FD
H8D
L7M
DOI 10.1063/5.0184852
DatabaseName Technology Research Database
Aerospace Database
Advanced Technologies Database with Aerospace
DatabaseTitle Technology Research Database
Aerospace Database
Advanced Technologies Database with Aerospace
DatabaseTitleList Technology Research Database

DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 1551-7616
Editor Khanna, Ashish
Bashir, Ali Kashif
Kaushik, Achal
Gupta, Deepak
Editor_xml – sequence: 1
  givenname: Ashish
  surname: Khanna
  fullname: Khanna, Ashish
  organization: Maharaja Agrasen Institute of Technology
– sequence: 2
  givenname: Deepak
  surname: Gupta
  fullname: Gupta, Deepak
  organization: Maharaja Agrasen Institute of Technology
– sequence: 3
  givenname: Ali Kashif
  surname: Bashir
  fullname: Bashir, Ali Kashif
  organization: Manchester Metropolitan University
– sequence: 4
  givenname: Achal
  surname: Kaushik
  fullname: Kaushik, Achal
  organization: Bhagwan Parshuram Institute of Technology
ExternalDocumentID acp
Genre Conference Proceeding
GroupedDBID -~X
23M
5GY
AAAAW
AABDS
AAEUA
AAPUP
AAYIH
ABJNI
ACBRY
ACZLF
ADCTM
AEJMO
AFATG
AFHCQ
AGKCL
AGLKD
AGMXG
AGTJO
AHSDT
AJJCW
ALEPV
ALMA_UNASSIGNED_HOLDINGS
ATXIE
AWQPM
BPZLN
F5P
FDOHQ
FFFMQ
HAM
M71
M73
RIP
RQS
SJN
~02
8FD
ABJGX
ADMLS
H8D
L7M
ID FETCH-LOGICAL-p1682-5c7ae462fca140d20e348b94d3684cbb87f7bc9089fa80487977a4702c2d35113
ISSN 0094-243X
IngestDate Mon Jun 30 05:26:34 EDT 2025
Fri Jun 21 00:10:34 EDT 2024
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License Published by AIP Publishing.
0094-243X/2024/2919/090008/9/$30.00
LinkModel OpenURL
MeetingName SECOND INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2022)
MergedId FETCHMERGED-LOGICAL-p1682-5c7ae462fca140d20e348b94d3684cbb87f7bc9089fa80487977a4702c2d35113
Notes ObjectType-Conference Proceeding-1
SourceType-Conference Papers & Proceedings-1
content type line 21
OpenAccessLink https://pubs.aip.org/aip/acp/article-pdf/doi/10.1063/5.0184852/19846943/090008_1_5.0184852.pdf
PQID 2979201557
PQPubID 2050672
PageCount 9
ParticipantIDs scitation_primary_10_1063_5_0184852
proquest_journals_2979201557
PublicationCentury 2000
PublicationDate 20240325
PublicationDateYYYYMMDD 2024-03-25
PublicationDate_xml – month: 03
  year: 2024
  text: 20240325
  day: 25
PublicationDecade 2020
PublicationPlace Melville
PublicationPlace_xml – name: Melville
PublicationTitle AIP conference proceedings
PublicationYear 2024
Publisher American Institute of Physics
Publisher_xml – name: American Institute of Physics
References Zhao, Zhang (c8) 2016; 33
Tsai, Chang (c30) 2018; 22
Dalvi, Rathod, Patil, Gite, Kotecha (c10) 2021; 9
Rajan, Chenniappan, Devaraj, Madian (c20) 2019; 13
Nigam, Singh, Misra (c33) 2018; 77
Barman, Dutta (c35) 2021; 145
Revina, Emmanuel (c1) 2021; 33
Khattak, Asghar, Ali, Batool (c3) 2022; 81
Rani (c13) 2021; 9
Uçar, Demir, Güzeliş (c27) 2016; 27
Perveen, Ahmad, Khan, Khalid, Qadri (c2) 2016; 5
Canal (c4) 2022; 582
Siddiqi, Ali, Sattar, Khan, Lee (c25) 2014; 31
Kim, Poulose, Han (c7) 2021; 21
Nazir, Jan, Sajjad (c32) 2018; 21
Happy, Routray (c26) 2014; 6
Youssif, Asker (c9) 2011; 4
Makhmudkhujaev, Abdullah-Al-Wadud, Iqbal, Ryu, Chae (c34) 2019; 74
Kumar, Bhuyan, Chakraborty (c28) 2016; 10
Song, Tao, Liu, Li, Zhou (c23) 2009; 40
Pareek (c18) 2022; 2022
Sridhar, Pareek, Kalidoss, Jamal, Shukla, Nuagah (c19) 2022; 2022
Banerjee (c14) 2022; 14
Ryu, Rivera, Kim, Chae (c31) 2017; 26
Arunachalam (c12) 2021; 32
References_xml – volume: 33
  start-page: 505
  year: 2016
  ident: c8
  article-title: A review on facial expression recognition: feature extraction and classification
  publication-title: IETE Technical Review
– volume: 31
  start-page: 277
  year: 2014
  ident: c25
  article-title: Depth camera-based facial expression recognition system using multilayer scheme
  publication-title: IETE Technical Review
– volume: 33
  start-page: 619
  year: 2021
  ident: c1
  article-title: A survey on human face expression recognition techniques
  publication-title: Journal of King Saud University-Computer and Information Sciences
– volume: 40
  start-page: 779
  year: 2009
  ident: c23
  article-title: Image ratio features for facial expression recognition application
  publication-title: IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
– volume: 9
  start-page: 165806
  year: 2021
  ident: c10
  article-title: A Survey of AI-Based Facial Emotion Recognition: Features, ML & DL Techniques, Age-Wise Datasets and Future Directions
  publication-title: IEEE Access
– volume: 145
  start-page: 254
  year: 2021
  ident: c35
  article-title: Facial expression recognition using distance and shape signature features
  publication-title: Pattern Recognition Letters
– volume: 2022
  year: 2022
  ident: c18
  article-title: Predicting the Spread of Vessels in Initial Stage Cervical Cancer through Radiomics Strategy Based on Deep Learning Approach
  publication-title: Advances in Materials Science and Engineering
– volume: 5
  year: 2016
  ident: c2
  article-title: Facial expression recognition through machine learning
  publication-title: International Journal of Scientific & Technology Research
– volume: 10
  start-page: 567
  year: 2016
  ident: c28
  article-title: Extraction of informative regions of a face for facial expression recognition
  publication-title: IET Computer Vision
– volume: 21
  start-page: 2026
  year: 2021
  ident: c7
  article-title: The extensive usage of the facial image threshing machine for facial emotion recognition performance
  publication-title: Sensors
– volume: 582
  start-page: 593
  year: 2022
  ident: c4
  article-title: A survey on facial emotion recognition techniques: A state-of-the-art literature review
  publication-title: Information Sciences
– volume: 14
  year: 2022
  ident: c14
  article-title: A Machine-Learning Approach for Prediction of Water Contamination Using Latitude, Longitude, and Elevation
  publication-title: Water (Switzerland)
– volume: 74
  start-page: 1
  year: 2019
  ident: c34
  article-title: Facial expression recognition with local prominent directional pattern
  publication-title: Signal Processing: Image Communication
– volume: 4
  year: 2011
  ident: c9
  article-title: Automatic facial expression recognition system based on geometric and appearance features
  publication-title: Computer and Information Science
– volume: 22
  start-page: 4389
  year: 2018
  ident: c30
  article-title: Facial expression recognition using a combination of multiple facial features and support vector machine
  publication-title: Soft computing
– volume: 9
  start-page: 150060
  year: 2021
  ident: c13
  article-title: Amalgamation of Advanced Technologies for Sustainable Development of Smart City Environment: A Review
  publication-title: IEEE Access
– volume: 21
  start-page: 539
  year: 2018
  ident: c32
  article-title: Facial expression recognition using histogram of oriented gradients based transformed features
  publication-title: Cluster Computing
– volume: 2022
  year: 2022
  ident: c19
  article-title: Optimal medical image size reduction model creation using recurrent neural network and GenPSOWVQ
  publication-title: Journal of healthcare engineering
– volume: 26
  start-page: 6006
  year: 2017
  ident: c31
  article-title: Local directional ternary pattern for facial expression recognition
  publication-title: IEEE Transactions on Image Processing
– volume: 6
  start-page: 1
  year: 2014
  ident: c26
  article-title: Automatic facial expression recognition using features of salient facial patches
  publication-title: IEEE transactions on Affective Computing
– volume: 81
  start-page: 1649
  year: 2022
  ident: c3
  article-title: An efficient deep learning technique for facial emotion recognition
  publication-title: Multimedia Tools and Applications
– volume: 32
  start-page: 1241
  year: 2021
  ident: c12
  article-title: Synovial sarcoma classification technique using support vector machine and structure features
  publication-title: Intelligent Automation & Soft Computing
– volume: 77
  start-page: 28725
  year: 2018
  ident: c33
  article-title: Efficient facial expression recognition using histogram of oriented gradients in wavelet domain
  publication-title: Multimedia Tools and Applications
– volume: 13
  start-page: 1031
  year: 2019
  ident: c20
  article-title: Facial expression recognition techniques: a comprehensive survey
  publication-title: IET Image Processing
– volume: 27
  start-page: 131
  year: 2016
  ident: c27
  article-title: A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering
  publication-title: Neural Computing and Applications
SSID ssj0029778
Score 2.3492856
Snippet Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication...
SourceID proquest
scitation
SourceType Aggregation Database
Publisher
SubjectTerms Communication
Emotion recognition
Emotions
Face recognition
Feature extraction
Human motion
Verbal communication
Title Exploring the application domains of ML-based facial emotion recognition systems: Framework, techniques and challenges
URI http://dx.doi.org/10.1063/5.0184852
https://www.proquest.com/docview/2979201557
Volume 2919
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnZ3PT9swFMetrQhtN8aYxgaTJXZj3lL_iB1uCKjY1DIkWqm3KP4RiQMtgsJhfz3PseOkAk3aLlEURVb0Po79bH_fewh9zawdMpkJUsPcRHiVD4ly0hErpM4qXjChfbzz5CI_n_FfczHviiA20SUr_d38eTGu5H-owjPg6qNk_4FsahQewD3whSsQhutzxi9ONcc_L71wvE0W271z3-8LndDOu5m9M-tDu7yproMSbjImfkqzvgSP30Z3ocDPYZIYwX3I-9yo6EatqstDSplgQ8Zn01ZoWdtUoNyrqkIAck_HXy3WFQuNJtX09xBhbUgobwr6wmQSR1AxJDIPAZTtEEuLOC72OtOzsRucJTC4z6KquAppbdfzY1_8Lkez8bicns2nr9EGZVLxAdo4Pp2Mr9IiG_zZMPvGT2uzSeXsR2p6bTXxBlyNoHroORbTLbTThVziy0TvHXrlFttoM9riPXpMCDEgxD2EOCLEyxq3CHFAiCNC3EOII8IjnAB-wx0-DPhwh28HzUZn05NzEktmkNthDmslYWTleE5rU8HK2dLMMa50wS3LFTdaK1lLbfxZb10pGLwlmKviMqOGWn-kzD6gwWK5cB8RlvDfsrp23CnNTWY1eMeFFswoTZXJxC7aa41Yxn_ivgTzF9S74XIXHSTDlrchc0rZKB5yVooykvj090Y-o7dd79xDg9Xdg9sHJ3Clv0TuT_BgYtE
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=AIP+conference+proceedings&rft.atitle=Exploring+the+application+domains+of+ML-based+facial+emotion+recognition+systems%3A+Framework%2C+techniques+and+challenges&rft.date=2024-03-25&rft.pub=American+Institute+of+Physics&rft.issn=0094-243X&rft.eissn=1551-7616&rft.volume=2919&rft.issue=1&rft_id=info:doi/10.1063%2F5.0184852&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0094-243X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0094-243X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0094-243X&client=summon