GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing

• Published in: Scientific reports Vol. 13; no. 1; p. 9222
• Main Authors: Li, Haiqin, Zhang, Yaping, Liu, Jiatao, Ma, Yuanjie
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 07.06.2023; Nature Publishing Group; Nature Portfolio
• Subjects: 631/158; 704/158; 704/4111; Algorithms; Haze; Humanities and Social Sciences; Image processing; multidisciplinary; Neural networks; Remote sensing; Science; Science (multidisciplinary)
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-023-36149-6

Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transformers (ViTs), combined with dark channel prior (DCP) to achieve good performance. Specifically, a spatial feature transform (SFT) layer is first used to smoothly introduce the guided transmission map (GTM) into the model, improving the ability of the network to estimate haze thickness. A strengthen-operate-subtract (SOS) boosted module is then added to refine the local features of the restored image. The framework of GTMNet is determined by adjusting the input of the SOS boosted module and the position of the SFT layer. On SateHaze1k dataset, we compare GTMNet with several classical dehazing algorithms. The results show that on sub-datasets of Moderate Fog and Thick Fog, the PSNR and SSIM of GTMNet-B are comparable to that of the state-of-the-art model Dehazeformer-L, with only 0.1 times of parameter quantity. In addition, our method is intuitively effective in improving the clarity and the details of dehazed images, which proves the usefulness and significance of using the prior GTM and the SOS boosted module in a single RSI dehazing.