Multiscale Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 15; pp. 4640 - 4652
• Main Authors: Ye, Zhen, Li, Cuiling, Liu, Qingxin, Bai, Lin, Fowler, James E.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial neural networks; Classification; Convolution; Convolutional neural networks (CNNs); Data mining; Feature extraction; feature fusion; Feature maps; hyperspectral image (HSI) classification; Hyperspectral imaging; Image classification; Imagery; Iron; Land cover; multiscale feature extraction; Neural networks; Principal component analysis; Three-dimensional displays; Training
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2022.3179446

Convolutional neural networks have garnered increasing interest for the supervised classification of hyperspectral imagery. However, images with a wide variety ofspatial land-cover sizes can hinder the feature-extraction ability of traditional convolutional networks. Consequently, many approaches intended to extract multiscale features have emerged; these techniques typically extract features in multiple parallel branches using convolutions of differing kernel sizes with concatenation or addition employed to fuse the features resulting from the various branches. In contrast, the present work explores a multiscale spatial-spectral feature-extraction network that operates in a more granular manner. Specifically, in the proposed network, a multibranch structure expands the convolutional receptive fields through the partitioning of input feature maps, applying hierarchical connections across the partitions, crosschannel feature fusion via pointwise convolution, and depthwise three-dimensional (3-D) convolutions for feature extraction. Experimental results reveal that the proposed multiscale spatial-spectral feature-fusion network outperforms other state-of-the-art networks at the supervised classification of hyperspectral imagery while being robust to limited training data.