Facial expression recognition based on deep learning

• Published in: Computer methods and programs in biomedicine Vol. 215; p. 106621
• Main Authors: Ge, Huilin, Zhu, Zhiyu, Dai, Yuewei, Wang, Biao, Wu, Xuedong
• Format: Journal Article
• Language: English
• Published: Ireland Elsevier B.V 01.03.2022
• Subjects: 3D face depth information; Algorithms; Convolutional neural network; Deep Learning; Facial Expression; Facial expression recognition; Facial Recognition; Humans; Neural Networks, Computer; Target detection; Deep learning; Facial expression recognition; 3D face depth information; Convolutional neural network; Target detection
• ISSN: 0169-2607; 1872-7565
• DOI: 10.1016/j.cmpb.2022.106621

•Autonomous driving, virtual reality and all kinds of robots integrated into our life rely on facial expression recognition technology.•Facial expression recognition and computer vision is based on deep learning technology and convolutional neural network.•Whether it is two-stage target detection or single-stage target detection, performance of algorithm is measured by detection speed and accuracy.•Large variety of training data with accurate expression tags can fundamentally improve expression recognition rate. Facial expression recognition technology will play an increasingly important role in our daily life. Autonomous driving, virtual reality and all kinds of robots integrated into our life depend on the development of facial expression recognition technology. Many tasks in the field of computer vision are based on deep learning technology and convolutional neural network. The paper proposes an occluded expression recognition model based on the generated countermeasure network. The model is divided into two modules, namely, occluded face image restoration and face recognition. Firstly, this paper summarizes the research status of deep facial expression recognition methods in recent ten years and the development of related facial expression database. Then, the current facial expression recognition methods based on deep learning are divided into two categories: Static facial expression recognition and dynamic facial expression recognition. The two methodswill be introduced and summarized respectively. Aiming at the advanced deep expression recognition algorithms in the field, the performance of these algorithms on common expression databases is compared, and the strengths and weaknesses of these algorithms are analyzed in detail. As the task of facial expression recognition is gradually transferred from the controlled laboratory environment to the challenging real-world environment, with the rapid development of deep learning technology, deep neural network can learn discriminative features, and is gradually applied to automatic facial expression recognition task. The current deep facial expression recognition system is committed to solve the following two problems: (1) Overfitting due to lack of sufficient training data; (2) In the real world environment, other variables that have nothing to do with expression bring interference problems. From the perspective of algorithm, combining other expression models, such as facial action unit model and pleasure arousal dimension model, as well as other multimodal models, such as audio mode, 3D face depth information and human physiological information, can make expression recognition more practical.