Reconstruction of High-Precision Semantic Map

• Published in: Sensors (Basel, Switzerland) Vol. 20; no. 21; p. 6264
• Main Authors: Tu, Xinyuan, Zhang, Jian, Luo, Runhao, Wang, Kai, Zeng, Qingji, Zhou, Yu, Yu, Yao, Du, Sidan
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 03.11.2020; MDPI
• Subjects: 3D reconstruction; 3D semantic map; Accuracy; Algorithms; Datasets; Mapping; Methods; Noise; Parallel processing; Real time; semantic fusion; Semantic segmentation; Semantics; Sensors
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s20216264

We present a real-time Truncated Signed Distance Field (TSDF)-based three-dimensional (3D) semantic reconstruction for LiDAR point cloud, which achieves incremental surface reconstruction and highly accurate semantic segmentation. The high-precise 3D semantic reconstruction in real time on LiDAR data is important but challenging. Lighting Detection and Ranging (LiDAR) data with high accuracy is massive for 3D reconstruction. We so propose a line-of-sight algorithm to update implicit surface incrementally. Meanwhile, in order to use more semantic information effectively, an online attention-based spatial and temporal feature fusion method is proposed, which is well integrated into the reconstruction system. We implement parallel computation in the reconstruction and semantic fusion process, which achieves real-time performance. We demonstrate our approach on the CARLA dataset, Apollo dataset, and our dataset. When compared with the state-of-art mapping methods, our method has a great advantage in terms of both quality and speed, which meets the needs of robotic mapping and navigation.