Ref-MEF: Reference-Guided Flexible Gated Image Reconstruction Network for Multi-Exposure Image Fusion

• Published in: Entropy (Basel, Switzerland) Vol. 26; no. 2; p. 139
• Main Authors: Huang, Yuhui, Zhou, Shangbo, Xu, Yufen, Chen, Yijia, Cao, Kai
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01.02.2024
• Subjects: Algorithms; Color imagery; computational photography; Computer vision; convolutional neural networks; Decomposition; Deep learning; Design; Exposure; Image enhancement; image processing; Image quality; Image reconstruction; Machine learning; Methods; Modules; multi-exposure fusion; Neural networks; Principal components analysis; Registration; image processing; computational photography; convolutional neural networks; multi-exposure fusion
• ISSN: 1099-4300; 1099-4300
• DOI: 10.3390/e26020139

Multi-exposure image fusion (MEF) is a computational approach that amalgamates multiple images, each captured at varying exposure levels, into a singular, high-quality image that faithfully encapsulates the visual information from all the contributing images. Deep learning-based MEF methodologies often confront obstacles due to the inherent inflexibilities of neural network structures, presenting difficulties in dynamically handling an unpredictable amount of exposure inputs. In response to this challenge, we introduce Ref-MEF, a method for color image multi-exposure fusion guided by a reference image designed to deal with an uncertain amount of inputs. We establish a reference-guided exposure correction (REC) module based on channel attention and spatial attention, which can correct input features and enhance pre-extraction features. The exposure-guided feature fusion (EGFF) module combines original image information and uses Gaussian filter weights for feature fusion while keeping the feature dimensions constant. The image reconstruction is completed through a gated context aggregation network (GCAN) and global residual learning GRL. Our refined loss function incorporates gradient fidelity, producing high dynamic range images that are rich in detail and demonstrate superior visual quality. In evaluation metrics focused on image features, our method exhibits significant superiority and leads in holistic assessments as well. It is worth emphasizing that as the number of input images increases, our algorithm exhibits notable computational efficiency.