Shape-restricted support vector machine (SR-SVM): a SVM classifier taking supplementary shape information of input

• Published in: Journal of intelligent & fuzzy systems Vol. 40; no. 1; pp. 1481 - 1494
• Main Authors: Deng, Geng, Xie, Yaoguo, Wang, Xindong, Fu, Qiang
• Format: Journal Article
• Language: English
• Published: London, England SAGE Publications 01.01.2021; Sage Publications Ltd
• Subjects: Algorithms; Basis functions; Classification; Classifiers; Computational geometry; Convexity; Hyperplanes; Optimization; Support vector machines
• ISSN: 1064-1246; 1875-8967
• DOI: 10.3233/JIFS-202155

Many classification problems contain shape information from input features, such as monotonic, convex, and concave. In this research, we propose a new classifier, called Shape-Restricted Support Vector Machine (SR-SVM), which takes the component-wise shape information to enhance classification accuracy. There exists vast research literature on monotonic classification covering monotonic or ordinal shapes. Our proposed classifier extends to handle convex and concave types of features, and combinations of these types. While standard SVM uses linear separating hyperplanes, our novel SR-SVM essentially constructs non-parametric and nonlinear separating planes subject to component-wise shape restrictions. We formulate SR-SVM classifier as a convex optimization problem and solve it using an active-set algorithm. The approach applies basis function expansions on the input and effectively utilizes the standard SVM solver. We illustrate our methodology using simulation and real world examples, and show that SR-SVM improves the classification performance with additional shape information of input.