Adaptive local sparse representation for compressive hyperspectral imaging

• Published in: Optics and laser technology Vol. 156; p. 108467
• Main Authors: Zhu, Junjie, Zhao, Jufeng, Yu, Jiakai, Cui, Guangmang
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2022
• Subjects: Adaptive dictionary; Compressive spectral imaging; Dual-camera; Adaptive dictionary; Dual-camera; Compressive spectral imaging
• ISSN: 0030-3992; 1879-2545
• DOI: 10.1016/j.optlastec.2022.108467

•The structure and spectral information of RGB observations are fully used.•The structural changes of local image patches in different bands are studied.•The correlation between image patches and RGB observations is studied.•The RGB observations are used to train and guide the selection of dictionaries.•The reconstruction quality is improved and the reconstruction time is reduced. Coded aperture snapshot spectral imaging (CASSI) is an effective way for hyperspectral imaging. In CASSI, the key issue is to accurately and efficiently reconstruct the 3D hyperspectral image from its corresponding coded 2D image. Due to the ill-posed nature, reconstruction errors are inevitable, a feasible solution is to add an RGB camera for complementary sampling to reduce the reconstruction error. In this paper, we investigate the structural changes of local image patches in different bands and their correlation with RGB observation, propose a reconstruction method for dual-camera CASSI system. Specifically, we learn an adaptive dictionary with RGB observation, then use RGB observation to guide the selection of the adaptive dictionary for each local image patch of the reconstruction target, and finally reconstruct the original hyperspectral image through an iterative numerical algorithm. This method fuses the spatial and spectral information obtained from RGB observations into the reconstruction process, experimental results show that the proposed method can greatly improve the reconstruction quality, especially the reconstruction of the details, and reduce more time compared with past dictionary-based reconstruction methods.