3D-MiniNet: Learning a 2D Representation From Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentation

• Published in: IEEE robotics and automation letters Vol. 5; no. 4; pp. 5432 - 5439
• Main Authors: Alonso, Inigo, Riazuelo, Luis, Montesano, Luis, Murillo, Ana C.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.10.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Ablation; Artificial neural networks; Computer architecture; deep learning for visual perception; Feature extraction; Laser radar; Learning; Lidar; LiDAR point clouds; Modules; Post-production processing; Representations; Robotics; Semantic scene understanding; Semantic segmentation; Semantics; Task analysis; Three dimensional models; Three-dimensional displays; Two dimensional displays
• ISSN: 2377-3766; 2377-3766
• DOI: 10.1109/LRA.2020.3007440

LIDAR semantic segmentation is an essential task that provides 3D semantic information about the environment to robots. Fast and efficient semantic segmentation methods are needed to match the strong computational and temporal restrictions of many real-world robotic applications. This work presents 3D-MiniNet, a novel approach for LIDAR semantic segmentation that combines 3D and 2D learning layers. It first learns a 2D representation from the raw points through a novel projection which extracts local and global information from the 3D data. This representation is fed to an efficient 2D Fully Convolutional Neural Network (FCNN) that produces a 2D semantic segmentation. These 2D semantic labels are re-projected back to the 3D space and enhanced through a post-processing module. The main novelty in our strategy relies on the projection learning module. Our detailed ablation study shows how each component contributes to the final performance of 3D-MiniNet. We validate our approach on well known public benchmarks (SemanticKITTI and KITTI), where 3D-MiniNet gets state-of-the-art results while being faster and more parameter-efficient than previous methods.