Joint‐Learning: A Robust Segmentation Method for 3D Point Clouds Under Label Noise

• Published in: Computer animation and virtual worlds Vol. 36; no. 3
• Main Authors: Zhang, Mengyao, Zhou, Jie, Miao, Tingyun, Zhao, Yong, Si, Xin, Zhang, Jingliang
• Format: Journal Article
• Language: English
• Published: Hoboken, USA John Wiley & Sons, Inc 01.05.2025; Wiley Subscription Services, Inc
• Subjects: adaptive sample selection; Adaptive sampling; Datasets; dual‐network framework; Image segmentation; joint label correction; label noise; Labels; Learning; Networks; Noise; point cloud segmentation; Three dimensional models
• DOI: 10.1002/cav.70038
• ISSN: 1546-4261

ABSTRACT Most of point cloud segmentation methods are based on clean datasets and are easily affected by label noise. We present a novel method called Joint‐learning, which is the first attempt to apply a dual‐network framework to point cloud segmentation with noisy labels. Two networks are trained simultaneously, and each network selects clean samples to update its peer network. The communication between two networks is able to exchange the knowledge they learned, possessing good robustness and generalization ability. Subsequently, adaptive sample selection is proposed to maximize the learning capacity. When the accuracies of both networks are no longer improving, the selection rate is reduced, which results in cleaner selected samples. To further reduce the impact of noisy labels, for unselected samples, we provide a joint label correction algorithm to rectify their labels via two networks' predictions. We conduct various experiments on S3DIS and ScanNet‐v2 datasets under different types and rates of noises. Both quantitative and qualitative results verify the reasonableness and effectiveness of the proposed method. By comparison, our method is substantially superior to the state‐of‐the‐art methods and achieves the best results in all noise settings. The average performance improvement is more than 7.43%, with a maximum of 11.42%. We propose a novel method to deal with point cloud segmentation with noisy labels, which consists of dual‐network framework, adaptive sample selection, and joint label correction.