Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 14; pp. 12429 - 12439
• Main Authors: Chen, Xiaoning, Ma, Mingyang, Li, Yong, Cheng, Wei
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Artificial neural networks; Classification; Collaboration; Collaborative representation classification (CRC); Design; Dictionaries; Feature extraction; feature fusion; Image classification; Kernel; kernel trick; Kernels; Neural networks; Remote sensing; Representations; scene classification; Sensors; Training; Transfer learning
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2021.3130073

Remote sensing scene classification is widely concerned because of its wide applications. Recently, convolutional neural networks (CNNs) have made a significant breakthrough in remote sensing image scene classification. However, the accuracy of using only a fully connected layer of CNNs as a classifier is not satisfied, especially for few-shot remote sensing images. In this article, we propose a feature-fusion-based kernel collaborative representation classification (FF-KCRC) framework for few-shot remote sensing images, which can make full use of the synergy between samples and the similarity between different types of image features to improve the accuracy of scene classification for few-shot remote sensing images. Specifically, we first design an effective feature extraction strategy to obtain more discriminative image features from CNNs, in which transfer learning is used to transfer the weights of pretrained CNNs to alleviate the few-shot training problem. Then, we design the FF-KCRC framework to make full use of the synergy between different categories and fuse the classification of different features, where "kernel trick" is used to address the problem of linear indivisibility. Extensive experiments have been conducted on publicly available remote sensing image datasets, and the results show that the proposed FF-KCRC achieves state-of-the-art results.