Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 14; p. 5210
• Main Authors: Nie, Xiangyu, Xu, Zhejun, Zhang, Wei, Dong, Xue, Liu, Ning, Chen, Yuanfeng
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 12.07.2022; MDPI
• Subjects: Accidents, Traffic; Accuracy; Algorithms; Automobile Driving; Cameras; Data Collection; Datasets; Deep learning; foggy scene understanding; lane detection; Light; Neural networks; synthetic dataset; Teaching methods; Weather; deep learning; foggy scene understanding; lane detection; synthetic dataset
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22145210

Accurate lane detection is an essential function of dynamic traffic perception. Though deep learning (DL) based methods have been widely applied to lane detection tasks, such models rarely achieve sufficient accuracy in low-light weather conditions. To improve the model accuracy in foggy conditions, a new approach was proposed based on monocular depth prediction and an atmospheric scattering model to generate fog artificially. We applied our method to the existing CULane dataset collected in clear weather and generated 107,451 labeled foggy lane images under three different fog densities. The original and generated datasets were then used to train state-of-the-art (SOTA) lane detection networks. The experiments demonstrate that the synthetic dataset can significantly increase the lane detection accuracy of DL-based models in both artificially generated foggy lane images and real foggy scenes. Specifically, the lane detection model performance (F1-measure) was increased from 11.09 to 70.41 under the heaviest foggy conditions. Additionally, this data augmentation method was further applied to another dataset, VIL-100, to test the adaptability of this approach. Similarly, it was found that even when the camera position or level of brightness was changed from one dataset to another, the foggy data augmentation approach is still valid to improve model performance under foggy conditions without degrading accuracy on other weather conditions. Finally, this approach also sheds light on practical applications for other complex scenes such as nighttime and rainy days.