Cross-domain learning for underwater image enhancement

• Published in: Signal processing. Image communication Vol. 110; p. 116890
• Main Authors: Li, Fei, Zheng, Jiangbin, Zhang, Yuan-fang, Jia, Wenjing, Wei, Qianru, He, Xiangjian
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.01.2023
• Subjects: GAN; Loss function; Underwater image enhancement; Unsupervised learning; Loss function; Underwater image enhancement; GAN; Unsupervised learning
• ISSN: 0923-5965; 1879-2677
• DOI: 10.1016/j.image.2022.116890

The poor quality of underwater images has become a widely-known cause affecting the performance of the underwater development projects, including mineral exploitation, driving photography, and navigation for autonomous underwater vehicles. In recent years, deep learning-based techniques have achieved remarkable successes in image restoration and enhancement tasks. However, the limited availability of paired training data (underwater images and their corresponding clear images) and the requirement for vivid color correction remain challenging for underwater image enhancement, as almost all learning-based methods require paired data for training. In this study, instead of creating the time-consuming paired data, we explore the unsupervised training strategy. Specifically, we introduce a universal cross-domain GAN-based framework to generate high-quality images to address the dependence on paired training data. To ensure the vivid colorfulness, the color loss is designed to constrain the training process. Also, a feature fusion module (FFM) is proposed to increase the capacity of the whole model as well as the dual discriminator channel adopted in the architecture. Extensive quantitative and perceptual experiments show that our approach overcomes the limitation of paired data and obtains superior performance over the state-of-the-art on several underwater benchmarks in terms of both accuracy and model deployment. [Display omitted] •Proposed an unsupervised learning scheme for underwater image enhancement without paired data.•Proposed cross-domain transfer to obtain similar distribution close to the images captured in air.•Designed special color loss function to remove the color cast caused by the scatting.