Semi-supervised classification with pairwise constraints

• Published in: Neurocomputing (Amsterdam) Vol. 139; pp. 130 - 137
• Main Authors: Gong, Chen, Fu, Keren, Wu, Qiang, Tu, Enmei, Yang, Jie
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 02.09.2014; Elsevier
• Subjects: Algorithms; Applied sciences; Artificial intelligence; Classification; Computer science; control theory; systems; Construction; Data processing. List processing. Character string processing; Exact sciences and technology; Graph theory; Graphs; Information retrieval. Graph; Labels; Learning; Learning and adaptive systems; Memory organisation. Data processing; Pairwise constraints; Semi-supervised learning; Similarity; Smoothness regularizer; Software; Theoretical computing; Pairwise constraints; Smoothness regularizer; Semi-supervised learning; Graph construction; Similarity; Smoothing; Vector support machine; Selection criterion; Graph theory; Regularization; Supervised classification; Weighted graph
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2014.02.053

Graph-based semi-supervised learning has been intensively investigated for a long history. However, existing algorithms only utilize the similarity information between examples for graph construction, so their discriminative ability is rather limited. In order to overcome this limitation, this paper considers both similarity and dissimilarity constraints, and constructs a signed graph with positive and negative edge weights to improve the classification performance. Therefore, the proposed algorithm is termed as Constrained Semi-supervised Classifier (CSSC). A novel smoothness regularizer is proposed to make the “must-linked” examples obtain similar labels, and “cannot-linked” examples get totally different labels. Experiments on a variety of synthetic and real-world datasets demonstrate that CSSC achieves better performances than some state-of-the-art semi-supervised learning algorithms, such as Harmonic Functions, Linear Neighborhood Propagation, LapRLS, LapSVM, and Safe Semi-supervised Support Vector Machines.