Bayesian sparse reduced rank multivariate regression

• Published in: Journal of multivariate analysis Vol. 157; pp. 14 - 28
• Main Authors: Goh, Gyuhyeong, Dey, Dipak K., Chen, Kun
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.05.2017
• Subjects: Bayesian; Low rank; Posterior consistency; Rank reduction; Sparsity; Sparsity; 62J07; Posterior consistency; Rank reduction; Bayesian; Low rank; 62F15; 62H25
• ISSN: 0047-259X; 1095-7243
• DOI: 10.1016/j.jmva.2017.02.007

Many modern statistical problems can be cast in the framework of multivariate regression, where the main task is to make statistical inference for a possibly sparse and low-rank coefficient matrix. The low-rank structure in the coefficient matrix is of intrinsic multivariate nature, which, when combined with sparsity, can further lift dimension reduction, conduct variable selection, and facilitate model interpretation. Using a Bayesian approach, we develop a unified sparse and low-rank multivariate regression method to both estimate the coefficient matrix and obtain its credible region for making inference. The newly developed sparse and low-rank prior for the coefficient matrix enables rank reduction, predictor selection and response selection simultaneously. We utilize the marginal likelihood to determine the regularization hyperparameter, so our method maximizes its posterior probability given the data. For theoretical aspect, the posterior consistency is established to discuss an asymptotic behavior of the proposed method. The efficacy of the proposed approach is demonstrated via simulation studies and a real application on yeast cell cycle data.