Robust Regression Random Forests by Small and Noisy Training Data

• Published in: 2019 XXII International Conference on Soft Computing and Measurements (SCM) pp. 134 - 137
• Main Authors: Utkin, Lev V., Kovalev, Maxim S., Frank Coolen, P.A.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2019
• Subjects: Computational modeling; confidence interval; imprecise model; Noise measurement; Numerical models; Optimization; quadratic programming; Radio frequency; random forest; Random forests; regression; Regression tree analysis; robust model; Training data; Weight measurement
• DOI: 10.1109/SCM.2019.8903679

A regression random forest model taking into account imprecision of the decision tree estimates is proposed. The imprecision stems from conditions of small or noisy training data which may take place in many applications. In fact, a meta-model is proposed to train and to compute optimal weights assigned to decision trees, which control the imprecision in order to get the robust random forest estimates. The imprecision of the tree estimations is defined by means of interval models, for example, by using confidence intervals. The weights are computed by solving a standard quadratic optimization problem with linear constraints. Numerical examples illustrate the proposed robust model which provides outperforming results for noisy and small data in comparison with the standard random forest.