Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detection

Data and model are the undoubtable two supporting pillars for LiDAR object detection. However, data-centric works have fallen far behind compared with the ever-growing list of fancy new models. In this work, we systematically study the synthesis-based LiDAR data augmentation approach (so-called GT-A...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Zhan, Jinglin, Liu, Tiejun, Li, Rengang, Zhang, Jingwei, Zhang, Zhaoxiang, Chen, Yuntao
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 22.05.2023
Subjects
Ablation
Composition
Data augmentation
Lidar
Object recognition
Synthetic data
Online AccessGet full text

Cover

More Information
Summary:Data and model are the undoubtable two supporting pillars for LiDAR object detection. However, data-centric works have fallen far behind compared with the ever-growing list of fancy new models. In this work, we systematically study the synthesis-based LiDAR data augmentation approach (so-called GT-Aug) which offers maxium controllability over generated data samples. We pinpoint the main shortcoming of existing works is introducing unrealistic LiDAR scan patterns during GT-Aug. In light of this finding, we propose Real-Aug, a synthesis-based augmentation method which prioritizes on generating realistic LiDAR scans. Our method consists a reality-conforming scene composition module which handles the details of the composition and a real-synthesis mixing up training strategy which gradually adapts the data distribution from synthetic data to the real one. To verify the effectiveness of our methods, we conduct extensive ablation studies and validate the proposed Real-Aug on a wide combination of detectors and datasets. We achieve a state-of-the-art 0.744 NDS and 0.702 mAP on nuScenes test set. The code shall be released soon.
ISSN:2331-8422