Object Tracking in Hyperspectral-Oriented Video with Fast Spatial-Spectral Features

• Published in: Remote sensing (Basel, Switzerland) Vol. 13; no. 10; p. 1922
• Main Authors: Chen, Lulu, Zhao, Yongqiang, Yao, Jiaxin, Chen, Jiaxin, Li, Ning, Chan, Jonathan Cheung-Wai, Kong, Seong G.
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 14.05.2021
• Subjects: Algorithms; Cameras; Clutter; Color; Computer applications; Convolution; Costs; data collection; Datasets; Efficiency; fast spatial-spectral feature; Feature extraction; Fourier transforms; Hyperspectral imaging; hyperspectral surveillance; hyperspectral video tracking; monitoring; on-line update; Real time; real-time spatial-spectral convolution kernel; Remote sensing; Spatial data; Spectra; Surveillance; Tracking
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs13101922

This paper presents a correlation filter object tracker based on fast spatial-spectral features (FSSF) to realize robust, real-time object tracking in hyperspectral surveillance video. Traditional object tracking in surveillance video based only on appearance information often fails in the presence of background clutter, low resolution, and appearance changes. Hyperspectral imaging uses unique spectral properties as well as spatial information to improve tracking accuracy in such challenging environments. However, the high-dimensionality of hyperspectral images causes high computational costs and difficulties for discriminative feature extraction. In FSSF, the real-time spatial-spectral convolution (RSSC) kernel is updated in real time in the Fourier transform domain without offline training to quickly extract discriminative spatial-spectral features. The spatial-spectral features are integrated into correlation filters to complete the hyperspectral tracking. To validate the proposed scheme, we collected a hyperspectral surveillance video (HSSV) dataset consisting of 70 sequences in 25 bands. Extensive experiments confirm the advantages and the efficiency of the proposed FSSF for object tracking in hyperspectral video tracking in challenging conditions of background clutter, low resolution, and appearance changes.