UCFTNet: multi-class dtection of city critical disaster information based on U-shaped cross fusion transformer

• Published in: International journal of digital earth Vol. 17; no. 1
• Main Authors: Shi, Lingfei, Yang, Kun
• Format: Journal Article
• Language: English
• Published: Taylor & Francis Group 31.12.2024
• Subjects: Damaged information; semantic segmentation; transformer; UAV
• ISSN: 1753-8947; 1753-8955
• DOI: 10.1080/17538947.2024.2403619

With the continuous enhancement of remote sensing data acquisition capabilities, the demand for efficient extraction of multi-class critical urban disaster information has become increasingly urgent. However, current deep learning-based models primarily focus on single disaster objects and struggle with accuracy in complex post-disaster scenarios. To address this, we propose UCFTNet, a semantic segmentation model for urban post-disaster damaged roads and buildings. UCFTNet employs a U-shaped encoder-decoder structure and ConvNext modules, integrating spatial and multi-scale information of damaged buildings and roads from different scales and channels. Additionally, the decoder uses the CCT module and CFF module to merge multi-scale features and eliminate irrelevant background interference. Finally, a weighted loss function is designed to enhance the model's focus on disaster category pixels. Experimental results demonstrate that UCFTNet improves the accuracy of extracting damaged buildings and roads by at least 5% across three urban disaster datasets, confirming its effectiveness in post-disaster damage information extraction.