Multicascaded Feature Fusion-Based Deep Learning Network for Local Climate Zone Classification Based on the So2Sat LCZ42 Benchmark Dataset

• Published in: IEEE journal of selected topics in applied earth observations and remote sensing Vol. 16; pp. 449 - 467
• Main Authors: Ji, Weizhen, Chen, Yunhao, Li, Kangning, Dai, Xiujuan
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Classification; Climate; Cloud cover; Convolution; Convolutional neural networks; Datasets; Deep learning; Disasters; Feature extraction; land surface temperature; local climate zones; Machine learning; Mapping; Meteorology; Microclimate; Multilayers; Remote sensing; Semantic segmentation; Thermal comfort; Thermal environments; Thermodynamic properties; Urban areas; urban heat island
• ISSN: 1939-1404; 2151-1535
• DOI: 10.1109/JSTARS.2022.3226524

A detailed investigation of the microclimate is beneficial for optimizing the urban inner/spatial pattern to enhance thermal comfort or even reduce heatwave disasters, whereas accurately classifying local climate zones (LCZs) severely restricts analysis of thermal characterization. Generally, deep learning-based approaches are effective for adaptive LCZ mapping, yet they often have poor accuracy because inadequate cascade feature extraction patterns may not adapt to the fuzzy LCZ boundaries produced by intricate urban textures, especially when using large-scale datasets. To address these issues, we propose a novel CNN model in which we design a strategy that incorporates a triple feature fusion pattern to enhance LCZ recognition based on the So2sat LCZ 42 large-scale annotated dataset. The approach connects multilayer cascaded information to participate in category judgment, which avoids the loss of effective feature information via continuous cascade transformation as much as possible. The results show that the overall accuracy and kappa coefficient of the proposed model reach 0.70 and 0.68, respectively, manifesting an improvement of approximately 4.47% and 6.25% over advanced LCZ classification approaches. In particular, the accuracy of the proposed approach improves even further after the fusion structure or layer depth is partially removed or reduced, respectively. Finally, we discuss several items, including the effectiveness of different parameters and cascaded feature fusion patterns, the superiority of multilayer cascade feature fusion, the mapping impact of seasons and cloud cover, and even some other issues in LCZ mapping. This article will facilitate improvements in the research precision of urban thermal environments.