Batched-image detection model and deployment method for tunnel lining defects using line-scan cameras based on experiments study

• Published in: Tunnelling and underground space technology Vol. 142; p. 105428
• Main Authors: Qin, Shaojie, Qi, Taiyue, Lei, Bo, Huang, Xiaodong
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2023
• Subjects: Machine vision; Real-time detection; Structural health monitoring; TensorRT; Tunnel defect detection; YOLO; YOLO; Tunnel defect detection; Real-time detection; Structural health monitoring; Machine vision; TensorRT
• ISSN: 0886-7798; 1878-4364
• DOI: 10.1016/j.tust.2023.105428

[Display omitted] •It proposes a real-time defect detection network base on YOLO series.•It proposes efficient computing module and decoupling heads for tunnel defect.•It proposes deployment method for CNN directly work on line-scan camera.•It proposes a simultaneous multitasking technique for real-time detection system.•It develops a line-scan data structures for batch image processing. High-performance line-scan cameras are highly accurate and efficient for tunnel detection, however, the exponential growth of image data creates new challenges for real-time image processing. The inference speed of existing tunnel detection algorithms is insufficient for massive amounts of image data, and traditional data structures limit the parallelism of the detection system, thereby reducing the speed of image processing. In this study, a deep learning (DL) network is developed for real-time tunnel defect detection based on the you only look once (YOLO) family. The network includes innovative defect feature-extraction modules, optimization of the network architecture, and improvement of the decoupling heads to increase defect detection accuracy and efficiency. Furthermore, we developed critical technologies for real-time detection. First, our method employs a deployment method for DL networks based on TensorRT, which enables our network to be applied directly to C++ image acquisition programs away from the traditional DL frameworks. The proposed line-scan data structure enables the raw images to be fed into the neural network in batches, which, combined with the simultaneous technique of image acquisition, detection, and storage, significantly increases the efficiency of real-time detection. The paper demonstrates the advantages of the proposed model and hardware system through an experiment study. The test results indicate that the mean average precision and F1-score of our network were 86.07% and 84.53%, respectively, while it had 21.42 M parameters. Combined with the proposed storage strategy, a recall rate of more than 90% was achieved for defect detection. Moreover, batch image processing method has a significant advantage in terms of inference speed, with 243.9 FPS in PyTorch, 381.46 FPS in TensorRT, and 305.3 FPS in real-time detection, which is five times faster than existing defect-detection models. This study significantly increases the efficiency of tunnel lining detection, which has positive implications for the visual detection of other infrastructures.