Generalized Zero-Shot Space Target Recognition Based on Global-Local Visual Feature Embedding Network

• Published in: Remote sensing (Basel, Switzerland) Vol. 15; no. 21; p. 5156
• Main Authors: Zhang, Yuanpeng, Guan, Jingye, Wang, Haobo, Li, Kaiming, Luo, Ying, Zhang, Qun
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.11.2023
• Subjects: Accuracy; Classification; Deep learning; Design; Embedding; high-resolution range profile (HRRP) sequence; Knowledge; Machine learning; micromotion; Neural networks; radar recognition; Semantics; space targets; Target recognition; Teaching methods; Visual discrimination; zero-shot learning (ZSL)
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs15215156

Existing deep learning-based space target recognition methods rely on abundantly labeled samples and are not capable of recognizing samples from unseen classes without training. In this article, based on generalized zero-shot learning (GZSL), we propose a space target recognition framework to simultaneously recognize space targets from both seen and unseen classes. First, we defined semantic attributes to describe the characteristics of different categories of space targets. Second, we constructed a dual-branch neural network, termed the global-local visual feature embedding network (GLVFENet), which jointly learns global and local visual features to obtain discriminative feature representations, thereby achieving GZSL for space targets with higher accuracy. Specifically, the global visual feature embedding subnetwork (GVFE-Subnet) calculates the compatibility score by measuring the cosine similarity between the projection of global visual features in the semantic space and various semantic vectors, thereby obtaining global visual embeddings. The local visual feature embedding subnetwork (LVFE-Subnet) introduces soft space attention, and an encoder discovers the semantic-guided local regions in the image to then generate local visual embeddings. Finally, the visual embeddings from both branches were combined and matched with semantics. The calibrated stacking method is introduced to achieve GZSL recognition of space targets. Extensive experiments were conducted on an electromagnetic simulation dataset of nine categories of space targets, and the effectiveness of our GLVFENet is confirmed.