Automatic recognition of pavement cracks from combined GPR B-scan and C-scan images using multiscale feature fusion deep neural networks

• Published in: Automation in construction Vol. 146; p. 104698
• Main Authors: Liu, Zhen, Gu, Xingyu, Chen, Jiaqi, Wang, Danyu, Chen, Yihan, Wang, Lutai
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.02.2023
• Subjects: Ground penetrating radar; Multiscale feature fusion; Object detection; Pavement crack assessment; YOLOv3; Ground penetrating radar; YOLOv3; Multiscale feature fusion; Pavement crack assessment; Object detection
• ISSN: 0926-5805; 1872-7891
• DOI: 10.1016/j.autcon.2022.104698

Pavement crack detection is critical for transportation infrastructure assessment using ground penetrating radar (GPR). This paper describes a YOLOv3 model with four-scale detection layers (FDL) to detect combined B-scan and C-scan GPR images subject to poor detection effects and a high missed detection rate of small crack feature sizes. Multiscale fusion structures, efficient intersection over union (EIoU) loss function, K-means++ clustering, and hyperparameter optimization were used in this proposed model to further improve detection performance. Results indicated that the F1 score and mAP of the YOLOv3-FDL model reached 88.1% and 87.8% and had an 8.8% and 7.5% improvement on the GPR dataset of concealed cracks, respectively, compared with the YOLOv3 model. This illustrated that this model solved the problem of missed crack detection to some extent. Future studies can take these results further, especially the three-dimensional feature analysis of pavement cracks. •B-scan and C-scan were combined to determine concealed crack features in GPR images.•YOLOv3-FDL model with four detection layers was proposed.•EIoU loss function and K-Means++ clustering were used.•Hyperparameter optimization based on evolutionary algorithm was performed.