Scene-Adaptive 3D Semantic Segmentation Based on Multi-Level Boundary-Semantic-Enhancement for Intelligent Vehicles

• Published in: IEEE transactions on intelligent vehicles Vol. 9; no. 1; pp. 1 - 11
• Main Authors: Ni, Peizhou, Li, Xu, Kong, Dong, Yin, Xiaoqing
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.01.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: attentional fusion; Boundaries; boundary enhancement; Datasets; discriminator; Discriminators; Feature extraction; Intelligent vehicles; Laser radar; Lidar; LiDAR semantic segmentation; Modules; Point cloud compression; Real-time systems; Roads; Scene analysis; scene-adaptivity; semantic enhancement; Semantic segmentation; Semantics; Three-dimensional displays
• ISSN: 2379-8858; 2379-8904
• DOI: 10.1109/TIV.2023.3274949

3D semantic segmentation is a key technology of scene understanding in the self-driving field, which remains challenging problems. Recent 3D segmentation methods have achieved competitive results in indoor or typical urban traffic scenes. However, in complex and changeable scenarios where structured features are sparse and irregular, few of these methods could achieve well segmentation results, especially causing blurry and inaccurate boundary distinctions between inter-class objects, drivable areas, and backgrounds. In order to fully harvest boundary information and accurately distinguish the category of points on road and object boundaries in real-time, we present an efficient multi-level boundary-semantic-enhanced model for LiDAR semantic segmentation, which comprehensively discover boundary features in three aspects: first, boundary channels are extracted directly from LiDAR range images as the inputs of boundary-branch; second, the boundary attention module is designed to deeply fuse boundary information into the main segmentation branch; third, a modified discriminator is utilized to raise the perception of boundary information by minimizing the gap between the predicted and true boundaries. Besides, we add a semantic-enhanced module using the similar discriminator to optimize semantic segmentation results in the output end. Quantitative and qualitative evaluations are performed on both structured and unstructured real-world datasets including urban dataset SemanticKITTI, off-road dataset Rellis3D and our unstructured test set. The experimental results validate the effectiveness of the proposed methodology in improving efficiency, accuracy and scene-adaptivity.