Accurate and robust visual SLAM with a novel ray-to-ray line measurement model

• Published in: Image and vision computing Vol. 140; p. 104837
• Main Authors: Zhang, Chengran, Fang, Zheng, Luo, Xingjian, Liu, Wei
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.12.2023
• Subjects: Optimization; Point and line feature; Simultaneous localization and mapping; Visual inertial odometry; Visual inertial odometry; Simultaneous localization and mapping; Point and line feature; Optimization
• ISSN: 0262-8856; 1872-8138
• DOI: 10.1016/j.imavis.2023.104837

Line feature is regarded as a more intuitive and accurate landmark than point feature in visual SLAM for its multiple-pixel comprehensiveness. However, uncertain factors, such as partial occlusion and noise, frequently hinder the mapping accuracy and destabilize the line-assisted SLAM system. Structural regulations and prior hypotheses are often used to tackle the issues, whereas only few people explore the impact of line feature optimization. In this paper, we attempt to improve the accuracy and robustness of visual SLAM system through line feature optimization process. First, a concise ray-to-ray residual model is proposed to replace the prevalent point-to-line model to integrally use line features. Second, the information matrix related to observation uncertainties is calculated to normalize the residual model, which aims to better balance the weights of different lines. Third, we add the line model to ORB-SLAM3 system and design the method of point-and-line based tracking and optimization. Finally, quantitative criteria are proposed to objectively evaluate the line feature map. Both synthetical and real datasets experiments are carried out to demonstrate the advantages of our algorithm in terms of camera ego-motion estimation and mapping. For camera ego-motion estimation experiments, the proposed ray-to-ray residual model produces more accurate results compared to state-of-the-art line-assisted SLAM/VIO algorithms. Furthermore, the model runs faster and obtains more robust results than the prevalent point-to-line reprojection residual model. For mapping experiments, quantitative criteria are proposed, which also open a new perspective to evaluate line-assisted SLAM systems, and give clues to evidence that the proposed method builds a more accurate line feature map. •A normalized ray-to-ray residual model for line feature optimization.•An adaptive information matrix for line feature to decrease noise impact.•An accurate and robust point-line visual-inertial SLAM system.•Quantitatively analyze the line feature mapping accuracy for visual SLAM system.