A lagrangian-based approach for universum twin bounded support vector machine with its applications

• Published in: Annals of mathematics and artificial intelligence Vol. 91; no. 2-3; pp. 109 - 131
• Main Authors: Moosaei, Hossein, Hladík, Milan
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.06.2023; Springer; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Classification; Complex Systems; Computer Science; Computing time; Handwriting recognition; Lagrangian function; Mathematical analysis; Mathematics; Numerical methods; S707: Lion15; Support vector machines; 90C20; Twin SVM; 90C25; Pattern classification; 90C90; Support vector machine; Lagrangian function; Quadratic programming; Universum data
• ISSN: 1012-2443; 1573-7470
• DOI: 10.1007/s10472-022-09783-5

The Universum provides prior knowledge about data in the mathematical problem to improve the generalization performance of the classifiers. Several works have shown that the Universum twin support vector machine ( U -TSVM) is an efficient method for binary classification problems. In this paper, we improve the U -TSVM method and propose an improved Universum twin bounded support vector machine (named as IUTBSVM). Indeed, by introducing different Lagrangian functions for the primal problems, we obtain new dual formulations of U -TSVM so that we do not need to compute inverse matrices. To reduce the computational time of the proposed method, we suggest a smaller size of the rectangular kernel matrices than the other methods. Numerical experiments on gender classification of human faces, handwritten digits recognition, and several UCI benchmark data sets indicate that the IUTBSVM is more efficient than the other four algorithms, namely U -SVM, TSVM, U -TSVM, and IUTSVM in the sense of the classification accuracy.