PointWeb: Enhancing Local Neighborhood Features for Point Cloud Processing

• Published in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 5560 - 5568
• Main Authors: Zhao, Hengshuang, Jiang, Li, Fu, Chi-Wing, Jia, Jiaya
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2019
• Subjects: 3D from Multiview and Sensors; Adaptation models; Computational modeling; Computer vision; Feature extraction; Grouping and Shape; Point cloud compression; Scene Analysis and Understanding; Segmentation; Semantics; Shape
• ISSN: 2575-7075
• DOI: 10.1109/CVPR.2019.00571

This paper presents PointWeb, a new approach to extract contextual features from local neighborhood in a point cloud. Unlike previous work, we densely connect each point with every other in a local neighborhood, aiming to specify feature of each point based on the local region characteristics for better representing the region. A novel module, namely Adaptive Feature Adjustment (AFA) module, is presented to find the interaction between points. For each local region, an impact map carrying element-wise impact between point pairs is applied to the feature difference map. Each feature is then pulled or pushed by other features in the same region according to the adaptively learned impact indicators. The adjusted features are well encoded with region information, and thus benefit the point cloud recognition tasks, such as point cloud segmentation and classification. Experimental results show that our model outperforms the state-of-the-arts on both semantic segmentation and shape classification datasets.