Adaptive lightweight Transformer network for low-light image enhancement

Low-light image enhancement methods based on deep learning have proven successful. In recent years, methods combining convolutional neural networks (CNN), multi-layer perceptron, and Retinex theory have achieved good results in enhancement tasks. The CNN has a limited receptive field, thus preventin...

Full description

Saved in:
Bibliographic Details
Published inSignal, image and video processing Vol. 18; no. 6-7; pp. 5365 - 5375
Main Authors Meng, De, Lei, Zhichun
Format Journal Article
LanguageEnglish
Published London Springer London 01.08.2024
Subjects
Computer Imaging
Computer Science
Image Processing and Computer Vision
Multimedia Information Systems
Original Paper
Pattern Recognition and Graphics
Signal,Image and Speech Processing
Vision
Attention mechanism
Transformer
Image signal processor
Light weight
Low-light image enhancement
Online AccessGet full text

Cover

More Information
Summary:Low-light image enhancement methods based on deep learning have proven successful. In recent years, methods combining convolutional neural networks (CNN), multi-layer perceptron, and Retinex theory have achieved good results in enhancement tasks. The CNN has a limited receptive field, thus preventing it from modeling long-range pixel dependencies, and the Transformer is known for its capability to capture long-range dependencies but incurs significant computational costs. In this paper, we propose an adaptive lightweight Transformer network (ALT-Net) to restore images under normal lighting conditions by simulating the reverse-sequential execution of image signal processor (ISP) pipelines. Specifically, in the reverse direction, we use a lightweight encoder–decoder to achieve inverse mapping and add adaptive modules for correction. In the sequential direction, we add noise reduction modules and attention mechanisms to query key parameters in the ISP pipeline (white balance and color correction, etc.) to adjust the image. Compared with Retinexformer, ALT-Net improves the PSNR and SSIM on the LOL-v2-real dataset by 0.11 dB and 0.002 respectively. With only 80 k parameters, our ALT-Net achieves state-of-the-art performance in low-light image enhancement tasks, and it is more cost-effective than similar methods.
ISSN:1863-1703
1863-1711
DOI:10.1007/s11760-024-03239-5