Incorporating monotonic domain knowledge in support vector learning for data mining regression problems

• Published in: Neural computing & applications Vol. 32; no. 15; pp. 11791 - 11805
• Main Authors: Chuang, Hui-Chi, Chen, Chih-Chuan, Li, Sheng-Tun
• Format: Journal Article
• Language: English
• Published: London Springer London 01.08.2020; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data mining; Data Mining and Knowledge Discovery; Domains; Image Processing and Computer Vision; Knowledge; Original Article; Probability and Statistics in Computer Science; Quadratic programming; Regression models; Subject specialists; Support vector machines; Monotonicity constraint; Support vector regression; Data mining; Prior domain knowledge
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-019-04661-4

A common problem of data-driven data mining methods is that they might lack considering domain knowledge, despite possibly having high accuracy with respect to the data. As such, prior knowledge plays an important role in many data mining applications. Incorporating prior knowledge into data mining techniques is not trivial and remains a partially open issue drawing much attention. In this paper, we propose a new support vector regression (SVR) model that takes into account the prior knowledge of domain experts in the form of inequalities, which reflect the monotonic relationship between the output and some of the attributes of the input. A dual quadratic programming problem corresponding to the SVR model is derived, along with algorithms for solving it and creating constraints, respectively. The experiment results, which were conducted on two artificial and two practical datasets, show that the proposed model, which considers the monotonicity defined by domain experts, performs better than the original SVR. Moreover, the proposed method is also suitable for prior domain knowledge of piecewise monotonicity.