Exploring the application domains of ML-based facial emotion recognition systems: Framework, techniques and challenges
Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication and are complemented by other gestures like eye contact, hand movement, etc. This is the direct method of communication of human emotions an...
Saved in:
Published in | AIP conference proceedings Vol. 2919; no. 1 |
---|---|
Main Authors | , , , |
Format | Journal Article Conference Proceeding |
Language | English |
Published |
Melville
American Institute of Physics
25.03.2024
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication and are complemented by other gestures like eye contact, hand movement, etc. This is the direct method of communication of human emotions and intent. In this paper, the authors present the Facial Emotion Recognition (FER) framework and a brief survey of various FER techniques. It also presents the various phases of the FER system i.e., face detection, pre-processing, feature extraction, and classification. Various FER databases like JAFFE, YALE, MUG, etc. are also summarized in terms of the number of emotions, number of images, and resolution. The importance of the domain in other related subject areas like medicine, neuroscience, psychology, decision science, gaming, mental research, etc., is also introduced. The authors explored the application areas of FER techniques. The authors also present the various challenges faced in the real-time implementation of FER models. Finally, the paper is concluded by discussing future research directions. |
---|---|
AbstractList | Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication and are complemented by other gestures like eye contact, hand movement, etc. This is the direct method of communication of human emotions and intent. In this paper, the authors present the Facial Emotion Recognition (FER) framework and a brief survey of various FER techniques. It also presents the various phases of the FER system i.e., face detection, pre-processing, feature extraction, and classification. Various FER databases like JAFFE, YALE, MUG, etc. are also summarized in terms of the number of emotions, number of images, and resolution. The importance of the domain in other related subject areas like medicine, neuroscience, psychology, decision science, gaming, mental research, etc., is also introduced. The authors explored the application areas of FER techniques. The authors also present the various challenges faced in the real-time implementation of FER models. Finally, the paper is concluded by discussing future research directions. |
Author | Rani, Sita Bhambri, Pankaj Kaur, Jaskiran Sangwan, Yashwant Singh |
Author_xml | – sequence: 1 givenname: Sita surname: Rani fullname: Rani, Sita organization: Department of Computer Science & Engineering, Guru Nanak Dev Engineering College – sequence: 2 givenname: Pankaj surname: Bhambri fullname: Bhambri, Pankaj email: pkbhambri@gmail.com organization: Department of Information Technology, Guru Nanak Dev Engineering College – sequence: 3 givenname: Jaskiran surname: Kaur fullname: Kaur, Jaskiran email: jaskirankaur899@gmail.com organization: Department of Information Technology, Guru Nanak Dev Engineering College – sequence: 4 givenname: Yashwant Singh surname: Sangwan fullname: Sangwan, Yashwant Singh email: yssangwan@gmail.com organization: Department of Computer Science, Govt. College |
BookMark | eNotkMtOwzAQRS1UJNrCgj-wxA6RYjtO7LBDVQtIRWxAYhdNHCd1Sexgp0D_nvSxmlkc3Zl7JmhkndUIXVMyoySN75MZoZLLhJ2hMU0SGomUpiM0JiTjEePx5wWahLAhhGVCyDH6Wfx1jfPG1rhfawxd1xgFvXEWl64FYwN2FX5dRQUEXeIKlIEG69YdEK-Vq6057GEXet2GB7z00Opf57_ucK_V2prvrQ4YbInVGppG21qHS3ReQRP01WlO0cdy8T5_jlZvTy_zx1XU0VSyKFECNE9ZpYByUjKiYy6LjJdxKrkqCikqUaiMyKwCSbgUQynggjDFyjihNJ6im2Nu593-jT7fuK23w8l8EJAxMjgSA3V7pIIy_aF83nnTgt_llOR7r3mSn7zG_2QJbMo |
CODEN | APCPCS |
ContentType | Journal Article Conference Proceeding |
Copyright | Author(s) 2024 Author(s). Published by AIP Publishing. |
Copyright_xml | – notice: Author(s) – notice: 2024 Author(s). Published by AIP Publishing. |
DBID | 8FD H8D L7M |
DOI | 10.1063/5.0184852 |
DatabaseName | Technology Research Database Aerospace Database Advanced Technologies Database with Aerospace |
DatabaseTitle | Technology Research Database Aerospace Database Advanced Technologies Database with Aerospace |
DatabaseTitleList | Technology Research Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Physics |
EISSN | 1551-7616 |
Editor | Khanna, Ashish Bashir, Ali Kashif Kaushik, Achal Gupta, Deepak |
Editor_xml | – sequence: 1 givenname: Ashish surname: Khanna fullname: Khanna, Ashish organization: Maharaja Agrasen Institute of Technology – sequence: 2 givenname: Deepak surname: Gupta fullname: Gupta, Deepak organization: Maharaja Agrasen Institute of Technology – sequence: 3 givenname: Ali Kashif surname: Bashir fullname: Bashir, Ali Kashif organization: Manchester Metropolitan University – sequence: 4 givenname: Achal surname: Kaushik fullname: Kaushik, Achal organization: Bhagwan Parshuram Institute of Technology |
ExternalDocumentID | acp |
Genre | Conference Proceeding |
GroupedDBID | -~X 23M 5GY AAAAW AABDS AAEUA AAPUP AAYIH ABJNI ACBRY ACZLF ADCTM AEJMO AFATG AFHCQ AGKCL AGLKD AGMXG AGTJO AHSDT AJJCW ALEPV ALMA_UNASSIGNED_HOLDINGS ATXIE AWQPM BPZLN F5P FDOHQ FFFMQ HAM M71 M73 RIP RQS SJN ~02 8FD ABJGX ADMLS H8D L7M |
ID | FETCH-LOGICAL-p1682-5c7ae462fca140d20e348b94d3684cbb87f7bc9089fa80487977a4702c2d35113 |
ISSN | 0094-243X |
IngestDate | Mon Jun 30 05:26:34 EDT 2025 Fri Jun 21 00:10:34 EDT 2024 |
IsDoiOpenAccess | false |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 1 |
Language | English |
License | Published by AIP Publishing. 0094-243X/2024/2919/090008/9/$30.00 |
LinkModel | OpenURL |
MeetingName | SECOND INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2022) |
MergedId | FETCHMERGED-LOGICAL-p1682-5c7ae462fca140d20e348b94d3684cbb87f7bc9089fa80487977a4702c2d35113 |
Notes | ObjectType-Conference Proceeding-1 SourceType-Conference Papers & Proceedings-1 content type line 21 |
OpenAccessLink | https://pubs.aip.org/aip/acp/article-pdf/doi/10.1063/5.0184852/19846943/090008_1_5.0184852.pdf |
PQID | 2979201557 |
PQPubID | 2050672 |
PageCount | 9 |
ParticipantIDs | scitation_primary_10_1063_5_0184852 proquest_journals_2979201557 |
PublicationCentury | 2000 |
PublicationDate | 20240325 |
PublicationDateYYYYMMDD | 2024-03-25 |
PublicationDate_xml | – month: 03 year: 2024 text: 20240325 day: 25 |
PublicationDecade | 2020 |
PublicationPlace | Melville |
PublicationPlace_xml | – name: Melville |
PublicationTitle | AIP conference proceedings |
PublicationYear | 2024 |
Publisher | American Institute of Physics |
Publisher_xml | – name: American Institute of Physics |
References | Zhao, Zhang (c8) 2016; 33 Tsai, Chang (c30) 2018; 22 Dalvi, Rathod, Patil, Gite, Kotecha (c10) 2021; 9 Rajan, Chenniappan, Devaraj, Madian (c20) 2019; 13 Nigam, Singh, Misra (c33) 2018; 77 Barman, Dutta (c35) 2021; 145 Revina, Emmanuel (c1) 2021; 33 Khattak, Asghar, Ali, Batool (c3) 2022; 81 Rani (c13) 2021; 9 Uçar, Demir, Güzeliş (c27) 2016; 27 Perveen, Ahmad, Khan, Khalid, Qadri (c2) 2016; 5 Canal (c4) 2022; 582 Siddiqi, Ali, Sattar, Khan, Lee (c25) 2014; 31 Kim, Poulose, Han (c7) 2021; 21 Nazir, Jan, Sajjad (c32) 2018; 21 Happy, Routray (c26) 2014; 6 Youssif, Asker (c9) 2011; 4 Makhmudkhujaev, Abdullah-Al-Wadud, Iqbal, Ryu, Chae (c34) 2019; 74 Kumar, Bhuyan, Chakraborty (c28) 2016; 10 Song, Tao, Liu, Li, Zhou (c23) 2009; 40 Pareek (c18) 2022; 2022 Sridhar, Pareek, Kalidoss, Jamal, Shukla, Nuagah (c19) 2022; 2022 Banerjee (c14) 2022; 14 Ryu, Rivera, Kim, Chae (c31) 2017; 26 Arunachalam (c12) 2021; 32 |
References_xml | – volume: 33 start-page: 505 year: 2016 ident: c8 article-title: A review on facial expression recognition: feature extraction and classification publication-title: IETE Technical Review – volume: 31 start-page: 277 year: 2014 ident: c25 article-title: Depth camera-based facial expression recognition system using multilayer scheme publication-title: IETE Technical Review – volume: 33 start-page: 619 year: 2021 ident: c1 article-title: A survey on human face expression recognition techniques publication-title: Journal of King Saud University-Computer and Information Sciences – volume: 40 start-page: 779 year: 2009 ident: c23 article-title: Image ratio features for facial expression recognition application publication-title: IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) – volume: 9 start-page: 165806 year: 2021 ident: c10 article-title: A Survey of AI-Based Facial Emotion Recognition: Features, ML & DL Techniques, Age-Wise Datasets and Future Directions publication-title: IEEE Access – volume: 145 start-page: 254 year: 2021 ident: c35 article-title: Facial expression recognition using distance and shape signature features publication-title: Pattern Recognition Letters – volume: 2022 year: 2022 ident: c18 article-title: Predicting the Spread of Vessels in Initial Stage Cervical Cancer through Radiomics Strategy Based on Deep Learning Approach publication-title: Advances in Materials Science and Engineering – volume: 5 year: 2016 ident: c2 article-title: Facial expression recognition through machine learning publication-title: International Journal of Scientific & Technology Research – volume: 10 start-page: 567 year: 2016 ident: c28 article-title: Extraction of informative regions of a face for facial expression recognition publication-title: IET Computer Vision – volume: 21 start-page: 2026 year: 2021 ident: c7 article-title: The extensive usage of the facial image threshing machine for facial emotion recognition performance publication-title: Sensors – volume: 582 start-page: 593 year: 2022 ident: c4 article-title: A survey on facial emotion recognition techniques: A state-of-the-art literature review publication-title: Information Sciences – volume: 14 year: 2022 ident: c14 article-title: A Machine-Learning Approach for Prediction of Water Contamination Using Latitude, Longitude, and Elevation publication-title: Water (Switzerland) – volume: 74 start-page: 1 year: 2019 ident: c34 article-title: Facial expression recognition with local prominent directional pattern publication-title: Signal Processing: Image Communication – volume: 4 year: 2011 ident: c9 article-title: Automatic facial expression recognition system based on geometric and appearance features publication-title: Computer and Information Science – volume: 22 start-page: 4389 year: 2018 ident: c30 article-title: Facial expression recognition using a combination of multiple facial features and support vector machine publication-title: Soft computing – volume: 9 start-page: 150060 year: 2021 ident: c13 article-title: Amalgamation of Advanced Technologies for Sustainable Development of Smart City Environment: A Review publication-title: IEEE Access – volume: 21 start-page: 539 year: 2018 ident: c32 article-title: Facial expression recognition using histogram of oriented gradients based transformed features publication-title: Cluster Computing – volume: 2022 year: 2022 ident: c19 article-title: Optimal medical image size reduction model creation using recurrent neural network and GenPSOWVQ publication-title: Journal of healthcare engineering – volume: 26 start-page: 6006 year: 2017 ident: c31 article-title: Local directional ternary pattern for facial expression recognition publication-title: IEEE Transactions on Image Processing – volume: 6 start-page: 1 year: 2014 ident: c26 article-title: Automatic facial expression recognition using features of salient facial patches publication-title: IEEE transactions on Affective Computing – volume: 81 start-page: 1649 year: 2022 ident: c3 article-title: An efficient deep learning technique for facial emotion recognition publication-title: Multimedia Tools and Applications – volume: 32 start-page: 1241 year: 2021 ident: c12 article-title: Synovial sarcoma classification technique using support vector machine and structure features publication-title: Intelligent Automation & Soft Computing – volume: 77 start-page: 28725 year: 2018 ident: c33 article-title: Efficient facial expression recognition using histogram of oriented gradients in wavelet domain publication-title: Multimedia Tools and Applications – volume: 13 start-page: 1031 year: 2019 ident: c20 article-title: Facial expression recognition techniques: a comprehensive survey publication-title: IET Image Processing – volume: 27 start-page: 131 year: 2016 ident: c27 article-title: A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering publication-title: Neural Computing and Applications |
SSID | ssj0029778 |
Score | 2.3492856 |
Snippet | Human facial expressions are one of the important techniques of non-verbal communication. Facial expressions are the most tender signs for larger communication... |
SourceID | proquest scitation |
SourceType | Aggregation Database Publisher |
SubjectTerms | Communication Emotion recognition Emotions Face recognition Feature extraction Human motion Verbal communication |
Title | Exploring the application domains of ML-based facial emotion recognition systems: Framework, techniques and challenges |
URI | http://dx.doi.org/10.1063/5.0184852 https://www.proquest.com/docview/2979201557 |
Volume | 2919 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnZ3PT9swFMetrQhtN8aYxgaTJXZj3lL_iB1uCKjY1DIkWqm3KP4RiQMtgsJhfz3PseOkAk3aLlEURVb0Po79bH_fewh9zawdMpkJUsPcRHiVD4ly0hErpM4qXjChfbzz5CI_n_FfczHviiA20SUr_d38eTGu5H-owjPg6qNk_4FsahQewD3whSsQhutzxi9ONcc_L71wvE0W271z3-8LndDOu5m9M-tDu7yproMSbjImfkqzvgSP30Z3ocDPYZIYwX3I-9yo6EatqstDSplgQ8Zn01ZoWdtUoNyrqkIAck_HXy3WFQuNJtX09xBhbUgobwr6wmQSR1AxJDIPAZTtEEuLOC72OtOzsRucJTC4z6KquAppbdfzY1_8Lkez8bicns2nr9EGZVLxAdo4Pp2Mr9IiG_zZMPvGT2uzSeXsR2p6bTXxBlyNoHroORbTLbTThVziy0TvHXrlFttoM9riPXpMCDEgxD2EOCLEyxq3CHFAiCNC3EOII8IjnAB-wx0-DPhwh28HzUZn05NzEktmkNthDmslYWTleE5rU8HK2dLMMa50wS3LFTdaK1lLbfxZb10pGLwlmKviMqOGWn-kzD6gwWK5cB8RlvDfsrp23CnNTWY1eMeFFswoTZXJxC7aa41Yxn_ivgTzF9S74XIXHSTDlrchc0rZKB5yVooykvj090Y-o7dd79xDg9Xdg9sHJ3Clv0TuT_BgYtE |
linkProvider | EBSCOhost |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=AIP+conference+proceedings&rft.atitle=Exploring+the+application+domains+of+ML-based+facial+emotion+recognition+systems%3A+Framework%2C+techniques+and+challenges&rft.date=2024-03-25&rft.pub=American+Institute+of+Physics&rft.issn=0094-243X&rft.eissn=1551-7616&rft.volume=2919&rft.issue=1&rft_id=info:doi/10.1063%2F5.0184852&rft.externalDBID=NO_FULL_TEXT |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0094-243X&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0094-243X&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0094-243X&client=summon |