Using Convolutional Neural Networks for Cloud Detection on VENμS Images over Multiple Land-Cover Types

• Published in: Remote sensing (Basel, Switzerland) Vol. 14; no. 20; p. 5210
• Main Authors: Pešek, Ondřej, Segal-Rozenhaimer, Michal, Karnieli, Arnon
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.10.2022
• Subjects: Aerosols; Algorithms; artificial neural network; Artificial neural networks; Clouds; CNN; Computer architecture; Datasets; deep learning; Deserts; Electromagnetic radiation; Land cover; Land use; Landsat satellites; Masking; Neural networks; Remote sensing; Satellite imagery; Satellites; semantic segmentation; Solar radiation; Tiles; Urban agriculture; Vegetation; Visible spectrum; Israel
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs14205210

In most parts of the electromagnetic spectrum, solar radiation cannot penetrate clouds. Therefore, cloud detection and masking are essential in image preprocessing for observing the Earth and analyzing its properties. Because clouds vary in size, shape, and structure, an accurate algorithm is required for removing them from the area of interest. This task is usually more challenging over bright surfaces such as exposed sunny deserts or snow than over water bodies or vegetated surfaces. The overarching goal of the current study is to explore and compare the performance of three Convolutional Neural Network architectures (U-Net, SegNet, and DeepLab) for detecting clouds in the VENμS satellite images. To fulfil this goal, three VENμS tiles in Israel were selected. The tiles represent different land-use and cover categories, including vegetated, urban, agricultural, and arid areas, as well as water bodies, with a special focus on bright desert surfaces. Additionally, the study examines the effect of various channel inputs, exploring possibilities of broader usage of these architectures for different data sources. It was found that among the tested architectures, U-Net performs the best in most settings. Its results on a simple RGB-based dataset indicate its potential value for any satellite system screening, at least in the visible spectrum. It is concluded that all of the tested architectures outperform the current VENμS cloud-masking algorithm by lowering the false positive detection ratio by tens of percents, and should be considered an alternative by any user dealing with cloud-corrupted scenes.