KVGCN: A KNN Searching and VLAD Combined Graph Convolutional Network for Point Cloud Segmentation

• Published in: Remote sensing (Basel, Switzerland) Vol. 13; no. 5; p. 1003
• Main Authors: Luo, Nan, Yu, Hongquan, Huo, Zhenfeng, Liu, Jinhui, Wang, Quan, Xu, Ying, Gao, Yun
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.03.2021
• Subjects: Accuracy; Aggregates; Artificial neural networks; Coders; Convolution; data collection; Deep learning; exhibitions; extracts; Feature extraction; graph convolutional network; Graph theory; graphs; Image segmentation; Multilayers; NetVLAD; Neural networks; point cloud; Remote sensing; robots; Scene analysis; Searching; Semantic segmentation; Semantics; Three dimensional models; topology
• ISSN: 2072-4292; 2072-4292
• DOI: 10.3390/rs13051003

Semantic segmentation of the sensed point cloud data plays a significant role in scene understanding and reconstruction, robot navigation, etc. This work presents a Graph Convolutional Network integrating K-Nearest Neighbor searching (KNN) and Vector of Locally Aggregated Descriptors (VLAD). KNN searching is utilized to construct the topological graph of each point and its neighbors. Then, we perform convolution on the edges of constructed graph to extract representative local features by multiple Multilayer Perceptions (MLPs). Afterwards, a trainable VLAD layer, NetVLAD, is embedded in the feature encoder to aggregate the local and global contextual features. The designed feature encoder is repeated for multiple times, and the extracted features are concatenated in a jump-connection style to strengthen the distinctiveness of features and thereby improve the segmentation. Experimental results on two datasets show that the proposed work settles the shortcoming of insufficient local feature extraction and promotes the accuracy (mIoU 60.9% and oAcc 87.4% for S3DIS) of semantic segmentation comparing to existing models.