Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

• Published in: IEEE transactions on circuits and systems for video technology p. 1
• Main Authors: Zhang, Xuanyu, Chen, Bin, Zou, Wenzhen, Liu, Shuai, Zhang, Yongbing, Xiong, Ruiqin, Zhang, Jian
• Format: Journal Article
• Language: English
• Published: IEEE 05.06.2024
• Subjects: Apertures; deep unfolding; Hyperspectral imaging; Image reconstruction; Imaging; Lenses; Optimization; progressive content-aware sampling; Relays; Spectral snapshot compressive imaging
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2024.3409421

Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.