Foreground Feature Attention Module Based on Unsupervised Saliency Detector for Few-Shot Learning

• Published in: IEEE access Vol. 9; pp. 51179 - 51188
• Main Authors: Kong, Zhengmin, Fu, Zhuolin, Xiong, Feng, Zhang, Chenggang
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: classification; Complexity theory; Datasets; Deep learning; Detectors; Feature extraction; Few-shot learning; foreground feature; Image enhancement; Machine learning; Modules; Neural networks; Object recognition; Prototypes; Salience; Sensors; Task analysis; Task complexity; Training; unsupervised saliency detector
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2021.3069581

In recent years, few-shot learning is proposed to solve the problem of lacking samples in deep learning. However, previous works are mainly concentrated on optimizing neural network structures or augmenting the dataset while ignoring the local relationship of the images. Considering that humans pay more attention to the foreground or prominent features of the images during image recognition, we proposed the foreground feature attention module (FFAM) based on an unsupervised saliency detector for few-shot learning. The FFAM consists of two parts: the foreground extraction module and the features attention module. More specifically, we first extract the foreground images by Robust Background Detector (RBD), one of the best unsupervised saliency detectors. Secondly, we employ the same embedding module to extract the features of both original images and foreground images. Finally, we introduce three improvements to enhance the foreground features and make our network focus on the foreground features without losing background information. Our proposed FFAM is more sensitive to the foreground features than previous approaches. Hence, it effectively recognizes those images with similar backgrounds. Extensive experiments are conducted on miniImagenet and tieredImagenet datasets. It is demonstrated that our proposed FFAM greatly improves the accuracy performance over baseline systems for both one-shot and few-shot classification tasks without increasing the network complexity.