Single-Band Stripe Noise Removal in Multispectral Remote Sensing Images Based on Semisupervised Disentangled Transformation Network

• Published in: IEEE transactions on geoscience and remote sensing Vol. 62; pp. 1 - 13
• Main Authors: Li, Jia, Li, Chenchen, He, Xianying, Cui, Fangfang, Zhao, Jie, Chen, Fansheng, Zeng, Dan
• Format: Journal Article
• Language: English
• Published: New York IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Background noise; Data models; Decoupling; Deep learning; Degradation; Image degradation; Image enhancement; Image quality; Multispectral remote sensing image; Noise; Performance evaluation; Remote sensing; semisupervised disentangled transformation network (SDTNet); stripe noise removal; Task analysis; Tensors; Transformations (mathematics); Wavelet transforms
• DOI: 10.1109/TGRS.2024.3433464
• ISSN: 0196-2892

The presence of stripe noise in multispectral data is a common issue caused by various factors during the imaging process. This noise severely degrades image quality and imposes limitations on downstream tasks. Although deep learning-based methods have demonstrated promising results in destriping, they often encounter challenges due to the disparity between the stripe noise distribution in simulated and real images. As a result, their destriping performance on real data is significantly hindered. To address this challenge, we propose a semisupervised disentangled transformation network (SDTNet) that encourages the model to learn the real stripe noise distribution through image decoupling and noise transformation using simulated and real data. SDTNet consists of the simulated and real image branches, which are subject to supervised and unsupervised constraints, respectively. They are jointly trained to enhance each other mutually. Furthermore, we introduce a decoupling strategy that effectively preserves the clean background component using self-consistency and adversarial losses. Instead of directly converting the whole image from the simulated domain to the real domain, SDTNet focuses on the relatively simpler task of converting the stripe noise component while maintaining the consistency of the image background. Extensive experimental evaluations on various datasets demonstrate the superior destriping performance of the proposed SDTNet compared to other methods, particularly in effectively removing stripe noise from real images.