Density-based weighting multi-surface least squares classification with its applications

• Published in: Knowledge and information systems Vol. 33; no. 2; pp. 289 - 308
• Main Authors: Ye, Qiaolin, Ye, Ning, Gao, Shangbing
• Format: Journal Article
• Language: English
• Published: London Springer-Verlag 01.11.2012; Springer; Springer Nature B.V
• Subjects: Algorithms; Applied sciences; Classification; Classifiers; Computer Science; Computer science; control theory; systems; Data Mining and Knowledge Discovery; Data processing. List processing. Character string processing; Database Management; Density; Eigenvalues; Exact sciences and technology; Information Storage and Retrieval; Information systems; Information Systems and Communication Service; Information Systems Applications (incl.Internet); Information technology; IT in Business; Least squares method; Memory organisation. Data processing; Nonlinearity; Regular Paper; Software; Studies; Support vector machines; Weighting; China; Multi-plane support vector machine; Margin point information; High-density regions; Separation method; Space complexity; High density; Least squares method; Object oriented; Vector support machine; Multiple classification
• ISSN: 0219-1377; 0219-3116
• DOI: 10.1007/s10115-012-0499-4

Traditionally, multi-plane support vector machines (SVM), including twin support vector machine (TWSVM) and least squares twin support vector machine (LSTSVM), consider all of points and view them as equally important points. In real cases, most of the samples of a dataset are highly correlated. These samples generally lie in the high-density regions and may be important for performances of classifiers. This motivates the rush toward new classifiers that can sufficiently take advantage of the points in the high-density regions. Illuminated by several new geometrically motivated algorithms, we propose density-based weighting multi-surface least squares classification (DWLSC) method, which is designed for classification. Considering the special features of multi-plane SVMs, DWLSC can measure the importance of points sharing the same labels by density weighting method and sufficiently make the full use of margin point information between pairs of points from different classes. It also includes naturally an extension of the non-linear case. In addition to keeping the respective advantages of both TWSVM and LSTSVM, our method improves the separation of the points sharing different classes and is shown to be better than other multi-plane classifiers in favor of reduction in space complexity, especially when confronted with the non-linear case. In addition, experimental evidence suggests that our method is effective in performing classification tasks.