Hyperspectral and multispectral image fusion techniques for high resolution applications: a review

• Published in: Earth science informatics Vol. 14; no. 4; pp. 1685 - 1705
• Main Authors: Sara, Dioline, Mandava, Ajay Kumar, Kumar, Arun, Duela, Shiny, Jude, Anitha
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.12.2021; Springer Nature B.V
• Subjects: Agriculture; Algorithms; Classification; Computer vision; Data collection; Deep learning; Earth and Environmental Science; Earth Sciences; Earth System Sciences; Environmental monitoring; Food analysis; High resolution; Hyperspectral imaging; Image databases; Image enhancement; Image processing; Image resolution; Information Systems Applications (incl.Internet); Machine learning; Military applications; Ontology; Parameter identification; Physical properties; Point spread functions; Precision agriculture; Remote sensing; Remote sensing systems; Review Article; Satellites; Sensors; Sharpening; Simulation and Modeling; Space Exploration and Astronautics; Space Sciences (including Extraterrestrial Physics; Spectra; Spectral signatures; Surveillance; Deep learning; Multispectral; Hyperspectral; Image fusion; Resolution
• ISSN: 1865-0473; 1865-0481
• DOI: 10.1007/s12145-021-00621-6

Hyperspectral imaging has been rapidly developing over the past decade, and modern sensor technologies can cover large areas with exceptional spatial, spectral, and temporal resolutions. Due to these features, hyperspectral imaging is used effectively in numerous remote sensing applications such as precision agriculture, environmental monitoring, food analysis, and military applications requiring estimation of physical parameters of many complex surfaces and identifying visually similar materials with acceptable spectral signatures. The scope of fusion of the two images, one with high spatial content and the other with high spectral content, is to estimate one image with high spatial and spectral content. This paper presents a brief review of recent image resolution fusion algorithms, including deep learning techniques, for hyperspectral images. The need of high resolution panchromatic (pan) and multispectral (MS) images, lossless registration of images from multiple sources and point spread function (PSF) impose limitations for performing pan sharpening process. Hence the fusion is achieved using multispectral images instead of panchromatic images on hyperspectral images. It is essential to identify and reduce uncertainties in the image processing chain to improve image fusion enhancement. This paper also presents the current practices, problems, and prospects of hyperspectral image fusion. In addition, some important issues affecting fusion performance are discussed.