SFR-Net: sample-aware and feature refinement network for cross-domain micro-expression recognition

• Published in: Optoelectronics letters Vol. 19; no. 7; pp. 437 - 442
• Main Authors: Liu, Jing, Ji, Xinyu, Wang, Mengmeng
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.07.2023; Springer Nature B.V
• Subjects: Algorithms; Decoders; Emotions; Lasers; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; A
• ISSN: 1673-1905; 1993-5013
• DOI: 10.1007/s11801-023-3021-1

Over the past several decades, micro-expression recognition (MER) has become a growing concern for scientific community. As the filming conditions vary from database to database, previous single-domain MER methods generally exhibit severe performance drop when applied to another database. To deal with this pressing problem, in this paper, a sample-aware and feature refinement network (SFR-Net) is proposed, which combines domain adaptation with deep metric learning to extract intrinsic features of micro-expressions for accurate recognition. With the help of decoders, siamese networks increasingly refine shared features relevant to emotions while exclusive features irrelevant to emotions are gradually obtained by private networks. In order to achieve promising performance, we further design sample-aware loss to constrain the feature distribution in the high-dimensional feature space. Experimental results show the proposed algorithm can effectively mitigate the diversity among different micro-expression databases, and achieve better generalization performance compared with state-of-the-art methods.