Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network

• Published in: Neurocomputing (Amsterdam) Vol. 333; pp. 231 - 239
• Main Authors: Ji, Yanli, Hu, Yuhan, Yang, Yang, Shen, Fumin, Shen, Heng Tao
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 14.03.2019
• Subjects: Cross-domain recognition; Deep learning; Facial expression recognition; ICID fusion network; Deep learning; Facial expression recognition; Cross-domain recognition; ICID fusion network
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2018.12.037

•We propose a novel feature fusion network for cross-domain facial expression recognition.•The proposed network consists of an Intra-category Common feature representation channel (IC) and an Inter-category Distinguishing feature representation channel (ID) for facial expression representation.•The IC channel learns the common features of intra-category facial expressions, and the ID channel learns the characteristic features of different categories.•We designed evaluate the performance of the ICID fusion network in two ways, multiple-to-single cross-domain recognition, and single-to-single cross-domain recognition.•Compared with state-of-the-art results, the proposed ICID fusion network got a significant improvement on recognition results. Facial expression recognition is crucial for various human-robot interaction applications, which requires facial expression analysis having a broad generalization. However, existing researches focus on the recognition in databases containing a limited number of samples. In this paper, we propose a novel feature fusion network for facial expression recognition in a cross-domain manner in order to realize the facial expression recognition in extensive scenarios. The proposed network consists of an Intra-category Common feature representation (IC) channel and an Inter-category Distinction feature representation (ID) channel for facial expression representation, and finally combine learned features of the two channels for facial expression recognition in cross databases. The IC channel learns the common features of intra-category facial expressions, and the ID channel learns the characteristic features of different categories. We evaluate the proposed approach in various experiment settings for cross-domain recognition, and achieves the state-of-the-art performances. We also evaluate the proposed approach for expression recognition in single databases, and also obtains the outstanding performance in the CK+, MMI, SFEW and RAF databases.