Toward Personalized Emotion Recognition: A Face Recognition Based Attention Method for Facial Emotion Recognition

This paper aims to address the subject-dependent challenge of the facial emotion recognition (FER) task. To accomplish this, we propose a novel face recognition based attention FER (FRA-FER) framework which propagates subtle face recognition (FR) features through the FER network. Particularly, first...

Full description

Saved in:
Bibliographic Details
Published in2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021) pp. 1 - 5
Main Authors Shahabinejad, Mostafa, Wang, Yang, Yu, Yuanhao, Tang, Jin, Li, Jiani
Format Conference Proceeding
LanguageEnglish
Published IEEE 15.12.2021
Subjects
Conferences
Convolutional neural networks
Emotion recognition
Face recognition
Gesture recognition
Task analysis
Online AccessGet full text

Cover

More Information
Summary:This paper aims to address the subject-dependent challenge of the facial emotion recognition (FER) task. To accomplish this, we propose a novel face recognition based attention FER (FRA-FER) framework which propagates subtle face recognition (FR) features through the FER network. Particularly, first a spatial attention map from the feature maps of an FR convolutional neural network (CNN) is created and then it is fused into the FER-CNN. By doing this FR feature propagation, the FER network is personalized as it takes the advantage of the FR features learned from large-scale face recognition datasets. Experiments on the two challenging datasets AffectNet and AFEW demonstrate the superiority of our proposed FRA-FER network to the state-of-the-art work.
DOI:10.1109/FG52635.2021.9666982