Drone-assisted segmentation of tile peeling on building façades using a deep learning model

• Published in: Journal of Building Engineering Vol. 80; p. 108063
• Main Author: Cao, Minh-Tu
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2023
• Subjects: BlendMask technique; Building façade; Building maintenance; Computer vision; Deep learning; Tile peeling; YOLOv7 model; Deep learning; Computer vision; YOLOv7 model; Building façade; Tile peeling; BlendMask technique; Building maintenance
• ISSN: 2352-7102; 2352-7102
• DOI: 10.1016/j.jobe.2023.108063

The need for precise segmentation of tile peeling on building façades is emphasized by its implications for efficient building maintenance, particularly in regions like Taiwan, where tiles are the dominant façade protection. In response to this challenge, the research introduces YOLOM, an innovative deep-learning-based segmentation model. This model combines the strengths of the You Only Look Once version 7 (YOLOv7) and the BlendMask-based segmentation technique, further enriched by the Efficient Layer Aggregation Network (ELAN) to boost feature discrimination and extraction capabilities for tile peeling. From a dataset of 1458 images encompassing 4595 instances of varied tile peeling captured during field surveys of public buildings, YOLOM showcased exceptional segmentation performance. It exceeded the Resnet-BlendMask by achieving 1.32 % and 0.8 % better Average Precision (AP) and AP at 50 % Intersection over Union (IoU) metrics, respectively. Notably, YOLOM consistently outperformed other models, reflecting a lead of 6.83 % and 3.3 % in AP for small objects (APs) and AP at 75 % IoU metrics. In a significant advancement, YOLOM was adeptly integrated with drone technology, refining its potential in aerial surveying of building facades. The combined approach is invaluable for building maintenance teams and facilitating proactive and cost-efficient interventions. The research contributes a distinctive framework seamlessly integrating state-of-the-art backbone and neck modules, particularly highlighting the ALAN. The innovative YOLOM model sets a new benchmark in AI methodologies for building maintenance and amplifies academic dialogues on AI-enhanced image segmentation. •Develop the instance-segmentation model, abbreviated (YOLOM), for building façade inspection.•Propose a framework of using YOLOM with drone to facilitate the inspection task.•Collect 1458 images with 4595 tile-peeling instances from aged buildings across Taiwan.•YOLOM earned the highest values for 5 criteria, E.g., AP50 (66.83 %) and mAP (36.42 %).•YOLOM achieved 1.42 % and 6.83 % better values than Resnet-BlendMask on mAP and APs.