Shrinkage estimation of varying covariate effects based on quantile regression

• Published in: Statistics and computing Vol. 24; no. 5; pp. 853 - 869
• Main Authors: Peng, Limin, Xu, Jinfeng, Kutner, Nancy
• Format: Journal Article
• Language: English
• Published: Boston Springer US 01.09.2014
• Subjects: Artificial Intelligence; Heterogeneity; Mathematical models; Mathematics and Statistics; Probability and Statistics in Computer Science; Quantiles; Regression; Shrinkage; Statistical Theory and Methods; Statistics; Statistics and Computing/Statistics Programs; Utilities; Shrinkage estimation; Censoring; Quantile regression; Varying covariate effects; Adaptive-LASSO; Variable selection
• ISSN: 0960-3174; 1573-1375
• DOI: 10.1007/s11222-013-9406-4

Varying covariate effects often manifest meaningful heterogeneity in covariate-response associations. In this paper, we adopt a quantile regression model that assumes linearity at a continuous range of quantile levels as a tool to explore such data dynamics. The consideration of potential non-constancy of covariate effects necessitates a new perspective for variable selection, which, under the assumed quantile regression model, is to retain variables that have effects on all quantiles of interest as well as those that influence only part of quantiles considered. Current work on l 1 -penalized quantile regression either does not concern varying covariate effects or may not produce consistent variable selection in the presence of covariates with partial effects, a practical scenario of interest. In this work, we propose a shrinkage approach by adopting a novel uniform adaptive LASSO penalty. The new approach enjoys easy implementation without requiring smoothing. Moreover, it can consistently identify the true model (uniformly across quantiles) and achieve the oracle estimation efficiency. We further extend the proposed shrinkage method to the case where responses are subject to random right censoring. Numerical studies confirm the theoretical results and support the utility of our proposals.