Adaptive Multi-Proxy for Remote Sensing Image Retrieval

• Published in: Remote sensing (Basel, Switzerland) Vol. 14; no. 21; p. 5615
• Main Authors: Li, Xinyue, Wei, Song, Wang, Jian, Du, Yanling, Ge, Mengying
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.11.2022
• Subjects: Clusters; Data collection; Datasets; Feature extraction; Image retrieval; Information processing; Learning; metric learning; Neural networks; Performance evaluation; Proxies; proxy-based loss; Remote sensing; Semantics; Teaching methods
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs14215615

With the development of remote sensing technology, content-based remote sensing image retrieval has become a research hotspot. Remote sensing image datasets not only contain rich location, semantic and scale information but also have large intra-class differences. Therefore, the key to improving the performance of remote sensing image retrieval is to make full use of the limited sample information to extract more comprehensive class features. In this paper, we propose a proxy-based deep metric learning method and an adaptive multi-proxy framework. First, we propose an intra-cluster sample synthesis strategy with a random factor, which uses the limited samples in batch to synthesize more samples to enhance the network’s learning of unobvious features in the class. Second, we propose an adaptive proxy assignment method to assign multiple proxies according to the cluster of samples within a class, and to determine weights for each proxy according to the cluster scale to accurately and comprehensively measure the sample-class similarity. Finally, we incorporate a rigorous evaluation metric mAP@R and a variety of dataset partitioning methods, and conduct extensive experiments on commonly used remote sensing image datasets.