Automated Asphalt Highway Pavement Crack Detection Based on Deformable Single Shot Multi-Box Detector Under a Complex Environment

• Published in: IEEE access Vol. 9; pp. 150925 - 150938
• Main Authors: Yan, Kun, Zhang, Zhihua
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Asphalt; Convolution; Crack detection; Cracks; Datasets; deformable convolution; Deformation; Detectors; Feature extraction; Formability; Highway maintenance; Interference; multi-scale; Object detection; Pavements; SSD; Task analysis; Technical services; Transformers
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2021.3125703

Pavement cracks are severely affecting highway performance. Thus, implementing high-precision highway pavement crack detection is important for highway maintenance. However, the asphalt highway pavement environment is complex, and different pavement backgrounds are more difficult than others for detecting highway pavement cracks. Interference from road markings and surface repairs also complicate the environments and thus the detection of crack. To reduce interference, we collected many images from different highway pavement backgrounds. We also improved the single shot multi-box detector (SSD) network and proposed a novel network named deformable SSD by adding a deformable convolution to the backbone feature extraction network VGG16. We verified our model using the PASCAL VOC2007 dataset and obtained a mean average precision ( mAP ) 3.1% higher than that of the original SSD model. We then trained and tested the proposed model using our crack detection dataset. We calculated precision, recall, F1 score, AP, mAP , and FPS to examine the performance of our model. The mAP of all categories in the test data was 85.11% using the proposed model 10.4% and 0.55% more than that of YOLOv4 and the original SSD model, respectively. These findings show that our model outperforms YOLOv4 and the original SSD model and confirm that incorporating a deformable convolution into the SSD network can improve the model's performance. The proposed model is appropriate for detecting pavement crack categories and locations in complicated environments. It can also provide important technical support for highway maintenance.