Multitask learning for large-scale semantic change detection

• Published in: Computer vision and image understanding Vol. 187; p. 102783
• Main Authors: Caye Daudt, Rodrigo, Le Saux, Bertrand, Boulch, Alexandre, Gousseau, Yann
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.10.2019; Elsevier
• Subjects: Computer Science; Computer Vision and Pattern Recognition; Fully convolutional networks; High resolution Earth observation; Multitask learning; Remote sensing; Semantic change detection; Multitask learning; Fully convolutional networks; 41A10; 65D05; High resolution Earth observation; 65D17; Semantic change detection; 41A05; Remote sensing; SEMANTIC CHANGE DETECTION; HIGH RESOLUTION EARTH OBSERVATION; REMOTE SENSING; FULLY CONVOLUTIONAL NETWORKS; MULTITASK LEARNING
• DOI: 10.1016/j.cviu.2019.07.003
• ISSN: 1077-3142

Change detection is one of the main problems in remote sensing, and is essential to the accurate processing and understanding of the large scale Earth observation data available. Most of the recently proposed change detection methods bring deep learning to this context, but change detection labelled datasets which are openly available are still very scarce, which limits the methods that can be proposed and tested. In this paper we present the first large scale very high resolution semantic change detection dataset, which enables the usage of deep supervised learning methods for semantic change detection with very high resolution images. The dataset contains coregistered RGB image pairs, pixel-wise change information and land cover information. We then propose several supervised learning methods using fully convolutional neural networks to perform semantic change detection. Most notably, we present a network architecture that performs change detection and land cover mapping simultaneously, while using the predicted land cover information to help to predict changes. We also describe a sequential training scheme that allows this network to be trained without setting a hyperparameter that balances different loss functions and achieves the best overall results. [Display omitted] •A large scale very high resolution semantic change detection dataset has been created.•FCNNs have been successfully used for semantic change detection.•A network for integrated change detection and land cover mapping is described.•A training scheme that avoids using hyperparameters for balancing loss functions.