Patch-guided point matching for point cloud registration with low overlap

• Published in: Pattern recognition Vol. 144; p. 109876
• Main Authors: Zhao, Tianming, Li, Linfeng, Tian, Tian, Ma, Jiayi, Tian, Jinwen
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2023
• Subjects: Cross-level fusion; Low overlap; Matching pyramid; Point cloud registration; Point cloud registration; Cross-level fusion; Low overlap; Matching pyramid
• ISSN: 0031-3203
• DOI: 10.1016/j.patcog.2023.109876

Point cloud registration is a classic and fundamental problem. Existing point cloud registration methods obtain correspondence point pairs by calculating the correlation between point features. However, the instability of point features makes the outlier rate of corresponding point pairs high, resulting in poor matching results, especially when facing low overlap point clouds. An obvious fact is that patch matching has higher reliability than point matching. To this end, we propose a patch-guided point cloud registration network. Specifically, we perform fusion on patches and points at both the feature and result levels to achieve the guidance of patch to point matching and improve the accuracy of predicted point pairs. At the feature level, we propose a Matching Pyramid Network (MPN) for multi-level patch/point matching. The core of the MPN is an attention-based cross-layer context aggregation (CCA) module, which is used for the fusion of matching features between upper and lower layers. At the result level, we design a matching consistency judgment module to ensure that the point pairs are consistent in the matching of each layer, which greatly reduces the outlier ratio. Based on the above design, the corresponding point pairs predicted by our network have a high inlier ratio, which makes our method perform well in the face of low overlapping point clouds. Extensive experimental results show that our method outperforms other existing methods for indoor and outdoor datasets. •A patch-guided point matching framework is proposed to predict correspondence.•A Matching Pyramid Network (MPN) is proposed for multilevel patch/point matching.•A CCA module is proposed to implicitly guide the matching of point feature.•A match consistency judgment module is proposed to explicitly guide point matching.•The proposed method outperforms other methods on both indoor and outdoor benchmarks.