FeaStNet: Feature-Steered Graph Convolutions for 3D Shape Analysis

• Published in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition pp. 2598 - 2606
• Main Authors: Verma, Nitika, Boyer, Edmond, Verbeek, Jakob
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2018
• Subjects: Convolution; Neural networks; Shape; Three-dimensional displays; Two dimensional displays; Visualization
• ISSN: 1063-6919
• DOI: 10.1109/CVPR.2018.00275

Convolutional neural networks (CNNs) have massively impacted visual recognition in 2D images, and are now ubiquitous in state-of-the-art approaches. CNNs do not easily extend, however, to data that are not represented by regular grids, such as 3D shape meshes or other graph-structured data, to which traditional local convolution operators do not directly apply. To address this problem, we propose a novel graph-convolution operator to establish correspondences between filter weights and graph neighborhoods with arbitrary connectivity. The key novelty of our approach is that these correspondences are dynamically computed from features learned by the network, rather than relying on predefined static coordinates over the graph as in previous work. We obtain excellent experimental results that significantly improve over previous state-of-the-art shape correspondence results. This shows that our approach can learn effective shape representations from raw input coordinates, without relying on shape descriptors.