Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty

• Published in: Metrika Vol. 76; no. 7; pp. 887 - 908
• Main Authors: Hong, Zhaoping, Hu, Yuao, Lian, Heng
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.10.2013
• Subjects: Economic Theory/Quantitative Economics/Mathematical Methods; Mathematics and Statistics; Probability Theory and Stochastic Processes; Statistics; Bayesian information criterion; Cross-validation; SCAD penalty
• ISSN: 0026-1335; 1435-926X
• DOI: 10.1007/s00184-012-0422-8

In this paper, we consider the problem of simultaneous variable selection and estimation for varying-coefficient partially linear models in a “small , large ” setting, when the number of coefficients in the linear part diverges with sample size while the number of varying coefficients is fixed. Similar problem has been considered in Lam and Fan (Ann Stat 36(5):2232–2260, 2008 ) based on kernel estimates for the nonparametric part, in which no variable selection was investigated besides that was assume to be smaller than . Here we use polynomial spline to approximate the nonparametric coefficients which is more computationally expedient, demonstrate the convergence rates as well as asymptotic normality of the linear coefficients, and further present the oracle property of the SCAD-penalized estimator which works for almost as large as under mild assumptions. Monte Carlo studies and real data analysis are presented to demonstrate the finite sample behavior of the proposed estimator. Our theoretical and empirical investigations are actually carried out for the generalized varying-coefficient partially linear models, including both Gaussian data and binary data as special cases.