Random forest missing data algorithms

• Published in: Statistical analysis and data mining Vol. 10; no. 6; pp. 363 - 377
• Main Authors: Tang, Fei, Ishwaran, Hemant
• Format: Journal Article
• Language: English
• Published: Hoboken Wiley Subscription Services, Inc., A Wiley Company 01.12.2017; Wiley Subscription Services, Inc
• Subjects: Algorithms; correlation; imputation; machine learning; Missing data; missingness; multivariate; splitting (random; univariate; unsupervised; univariate; Correlation; Splitting (random; unsupervised; multivariate; Imputation; Machine Learning; Missingness
• ISSN: 1932-1864; 1932-1872
• DOI: 10.1002/sam.11348

Random forest (RF) missing data algorithms are an attractive approach for imputing missing data. They have the desirable properties of being able to handle mixed types of missing data, they are adaptive to interactions and nonlinearity, and they have the potential to scale to big data settings. Currently there are many different RF imputation algorithms, but relatively little guidance about their efficacy. Using a large, diverse collection of data sets, imputation performance of various RF algorithms was assessed under different missing data mechanisms. Algorithms included proximity imputation, on the fly imputation, and imputation utilizing multivariate unsupervised and supervised splitting—the latter class representing a generalization of a new promising imputation algorithm called missForest. Our findings reveal RF imputation to be generally robust with performance improving with increasing correlation. Performance was good under moderate to high missingness, and even (in certain cases) when data was missing not at random.