DF2Net: Differential Feature Fusion Network for Hyperspectral Image Classification

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 17; pp. 10660 - 10673
• Main Authors: Wang, Qingwang, Huang, Jiangbo, Meng, Yuanqin, Shen, Tao
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Advantageous feature differential enhancement fusion (AFDEF); Apexes; Artificial neural networks; Classification; Convolution; Convolutional neural networks; convolutional neural networks (CNNs); Correlation; Data mining; Feature extraction; hypergraph convolutional network; hyperspectral image (HSI) classification; Hyperspectral imaging; Image classification; Information retrieval; Neural networks; Training; Transformers
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2024.3403863

Recently, hybrid networks, combining graph convolutional networks (GCNs) and convolutional neural networks into a unified framework, have garnered significant attention in hyperspectral image (HSI) classification. However, existing hybrid networks have the following limitations. 1) Existing methods primarily utilize simple fusion strategies such as concatenation or direct addition, resulting in the ineffective utilization of advantageous features. 2) Traditional GCNs only consider the relationship between pairs of vertices, limiting their ability to capture complex high-order and long-range correlations. In this work, a novel differential feature fusion network (DF2Net) is proposed for HSI classification. Specifically, DF2Net utilizes two subnetworks to learn features at different abstraction levels: 1) the spectral-spatial hypergraph convolutional network for capturing complex high-order and long-range correlations, and the spectral-spatial convolution network for pixel-level local information extraction. Subsequently, we introduce an advantageous feature differential enhancement fusion module, in which mutual enhancement of advantageous features from different network structures is performed, thereby improving the classification robustness of different regions in HSI. The experiments on four HSI benchmark datasets demonstrate that our DF2Net exhibits superior advantages over state-of-the-art models, particularly when the training samples are limited.