TransRA: transformer and residual attention fusion for single remote sensing image dehazing

• Published in: Multidimensional systems and signal processing Vol. 33; no. 4; pp. 1119 - 1138
• Main Authors: Dong, Pengwei, Wang, Bo
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.12.2022; Springer Nature B.V
• Subjects: Artificial Intelligence; Circuits and Systems; Coders; Deep learning; Electrical Engineering; Engineering; Haze; Image classification; Image quality; Machine learning; Neural networks; Remote sensing; Signal,Image and Speech Processing; Transformers; Residual attention; Fusion block; Remote sensing images; Transformer dehazing
• ISSN: 0923-6082; 1573-0824
• DOI: 10.1007/s11045-022-00835-x

Haze seriously reduces the quality of optical remote sensing images, resulting in poor performance in many applications, such as remote sensing image change detection and classification. In recent years, deep learning models have achieved convincing performance in image dehazing, which has attracted more and more attention in haze removal of remote sensing images. However, the existing deep learning-based methods are less able to recover the fine details of remote sensing images that suffered from haze, especially the cases of nonhomogeneous haze. In this paper, we propose a two-branch neural network fused with Transformer and residual attention to dehaze a single remote sensing image. Specifically, our upper branch is a U-shaped encoder–decoder architecture, using an efficient multi-head self-attention Transformer for capturing long-range dependencies. The lower branch is an attention stack of residual channels to enhance fitting capability of models and complement fine-detailed features for upper branch. Finally, the features of the two branches are stacked and mapped to the haze-free remote sensing image by fusion block. Extensive experiments demonstrate that our TransRA achieves superior performance against other dehazing competitors both qualitatively and quantitatively.