A kernel-based sparsity preserving method for semi-supervised classification

• Published in: Neurocomputing (Amsterdam) Vol. 139; pp. 345 - 356
• Main Authors: Gu, Nannan, Wang, Di, Fan, Mingyu, Meng, Deyu
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 02.09.2014; Elsevier
• Subjects: Applied sciences; Artificial intelligence; Benchmarking; Classification; Computer science; control theory; systems; Data points; Data processing. List processing. Character string processing; Detection, estimation, filtering, equalization, prediction; Exact sciences and technology; Feature extraction; Information, signal and communications theory; Labels; Learning and adaptive systems; Manifold regularization; Memory organisation. Data processing; Pattern recognition. Digital image processing. Computational geometry; Preserves; Representations; Semi-supervised classification; Semi-supervised learning; Signal and communications theory; Signal, noise; Software; Sparse representation; Tasks; Telecommunications and information theory; Sparse representation; Feature extraction; Semi-supervised classification; Semi-supervised learning; Manifold regularization; Input output; L2 approximation; Kernel method; Experimental result; Classification; Selection criterion; Regularization; Pattern extraction
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2014.02.022

In this paper, we propose an effective approach to semi-supervised classification through kernel-based sparse representation. The new method computes the sparse representation of data in the feature space, and then the learner is subject to a cost function which aims to preserve the sparse representing coefficients. By mapping the data into the feature space, the so-called “l2-norm problem” that may be encountered when directly applying sparse representations to non-image data classification tasks will be naturally alleviated, and meanwhile, the label of a data point can be reconstructed more precisely by the labels of other data points using the sparse representing coefficients. Inherited from sparse representation, our method can adaptively establish the relationship between data points, and has high discriminative ability. Furthermore, the new method has a natural multi-class explicit expression for new samples. Experimental results on several benchmark data sets are provided to show the effectiveness of our method.