Robust Regression Random Forests by Small and Noisy Training Data

A regression random forest model taking into account imprecision of the decision tree estimates is proposed. The imprecision stems from conditions of small or noisy training data which may take place in many applications. In fact, a meta-model is proposed to train and to compute optimal weights assi...

Full description

Saved in:
Bibliographic Details
Published in2019 XXII International Conference on Soft Computing and Measurements (SCM) pp. 134 - 137
Main Authors Utkin, Lev V., Kovalev, Maxim S., Frank Coolen, P.A.
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2019
Subjects
Computational modeling
confidence interval
imprecise model
Noise measurement
Numerical models
Optimization
quadratic programming
Radio frequency
random forest
Random forests
regression
Regression tree analysis
robust model
Training data
Weight measurement
Online AccessGet full text
DOI10.1109/SCM.2019.8903679

Cover

More Information
Summary:A regression random forest model taking into account imprecision of the decision tree estimates is proposed. The imprecision stems from conditions of small or noisy training data which may take place in many applications. In fact, a meta-model is proposed to train and to compute optimal weights assigned to decision trees, which control the imprecision in order to get the robust random forest estimates. The imprecision of the tree estimations is defined by means of interval models, for example, by using confidence intervals. The weights are computed by solving a standard quadratic optimization problem with linear constraints. Numerical examples illustrate the proposed robust model which provides outperforming results for noisy and small data in comparison with the standard random forest.
DOI:10.1109/SCM.2019.8903679