Open set classification of Hyperspectral images with energy models

Hyperspectral images are rich in spectral data, lending themselves well to pixel-level image classification tasks. Previous studies primarily focus on closed-set classification within the realm of hyperspectral image classification. However, real-world scenarios present the challenge of dealing with...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of remote sensing Vol. 44; no. 24; pp. 7876 - 7888
Main Authors Alwadei, Bashair, Lamine Mekhalfi, Mohamed, Bazi, Yakoub, M Al Rahhal, Mohamad, Zuair, Mansour
Format Journal Article
LanguageEnglish
Published London Taylor & Francis 17.12.2023
Taylor & Francis Ltd
Subjects
Artificial neural networks
attention mechanisms
Classification
Datasets
deep learning
energy score
Feature maps
Hyperspectral image classification
Hyperspectral imaging
Image classification
Neural networks
open set classification
Online AccessGet full text

Cover

More Information
Summary:Hyperspectral images are rich in spectral data, lending themselves well to pixel-level image classification tasks. Previous studies primarily focus on closed-set classification within the realm of hyperspectral image classification. However, real-world scenarios present the challenge of dealing with object classes not encountered during the training phase, a scenario known as open set classification, which has garnered less attention compared to the closed set paradigm. In this paper, we propose a methodology anchored on ConvMixer for tackling open-set classification by utilizing energy-based models. We incorporate a Selective Kernel Attention (SKA) to capture the notion that different feature maps usually correspond to different objects in deep neural networks. Our experimental validation, conducted on two datasets, specifically the WHU-Hi-HanChuan and WHU-Hi-HongHu datasets, showcases promising outcomes of the introduced method.
ISSN:0143-1161
1366-5901
DOI:10.1080/01431161.2023.2288950