Robust Pinball Twin Bounded Support Vector Machine for Data Classification

• Published in: Neural processing letters Vol. 55; no. 2; pp. 1131 - 1153
• Main Authors: Prasad, Subhash Chandra, Anagha, P., Balasundaram, S.
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.04.2023; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Classification; Complex Systems; Computational Intelligence; Computer Science; Kernels; Machine learning; Mathematical analysis; Noise sensitivity; Optimization; Outliers (statistics); Quadratic programming; Regularization; Robustness; Scattering; Support vector machines; norm loss; Pinball loss; Non-parallel hyperplanes; Twin bounded support vector machine; Classification
• ISSN: 1370-4621; 1573-773X
• DOI: 10.1007/s11063-022-10930-6

In this paper, a novel robust L 1 -norm based twin bounded support vector machine with pinball loss- having regularization term, scatter loss and misclassification loss- is proposed to enhance robustness in the presence of feature noise and outliers. Unlike in twin bounded support vector machine (TBSVM), pinball is used as the misclassification loss in place of hinge loss to reduce noise sensitivity. To further boost robustness, the scatter loss of the class of vectors is minimized using L 1 -norm. As an equivalent problem in simple form, a pair of quadratic programming problems (QPPs) is constructed (L1-Pin-TBSVM) with m variables where m is the number of training vectors. Unlike TBSVM, the proposed L1-Pin-TBSVM is free from inverse kernel matrix and the non-linear problem can be obtained directly from its linear formulation by applying the kernel trick. The efficacy and robustness of L1-Pin-TBSVM has been demonstrated by experiments performed on synthetic and UCI datasets in the presence of noise.