Active-Learning-Incorporated Deep Transfer Learning for Hyperspectral Image Classification

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 11; no. 11; pp. 4048 - 4062
• Main Authors: Lin, Jianzhe, Zhao, Liang, Li, Shuying, Ward, Rabab, Wang, Z. Jane
• Format: Journal Article
• Language: English
• Published: IEEE 01.11.2018
• Subjects: Correlation; Hyperspectral image (HSI); Hyperspectral imaging; Neural networks; salient samples; Semantics; supervised classification; Training; transfer learning
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2018.2874225

A hyperspectral image (HSI) includes a vast quantity of samples, a large number of bands, and randomly occurring redundancy. Classifying such complex data is challenging, and its classification performance can be affected significantly by the amount of labeled training samples, as well as the quality, position, and others factors of these samples. Collecting such labeled training samples is labor and time consuming, motivating the idea of taking advantage of labeled samples from other pre-existing related images. Therefore, transfer learning, which can mitigate the semantic gap between existing and new HSIs, has drawn increasing research attention. However, existing transfer learning methods for HSIs (which mainly concentrate on how to overcome the divergence among images) may fail to carefully consider the contents to be transferred and thus limit their performances. In this paper, we present two novel ideas: 1) we, for the first time, introduce an active learning process to initialize the salient samples on the HSI data, which would be transferred later; and 2) we propose constructing and connecting higher level features for the source and target HSI data to further overcome the cross-domain disparity. Different from existing methods, the proposed framework requires no a priori knowledge on the target domain, and it works for both homogeneous and heterogeneous HSI data. Experimental results on three real-world HSIs support the effectiveness of the proposed method for HSI classification.