Additive mixed models with approximate Dirichlet process mixtures: the EM approach

• Published in: Statistics and computing Vol. 26; no. 1-2; pp. 73 - 92
• Main Authors: Heinzl, Felix, Tutz, Gerhard
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.01.2016
• Subjects: Artificial Intelligence; Mathematics and Statistics; Probability and Statistics in Computer Science; Statistical Theory and Methods; Statistics; Statistics and Computing/Statistics Programs; Dirichlet process mixture; Stick breaking; Additive mixed models; Penalized splines; EM algorithm
• ISSN: 0960-3174; 1573-1375
• DOI: 10.1007/s11222-014-9475-z

We consider additive mixed models for longitudinal data with a nonlinear time trend. As random effects distribution an approximate Dirichlet process mixture is proposed that is based on the truncated version of the stick breaking presentation of the Dirichlet process and provides a Gaussian mixture with a data driven choice of the number of mixture components. The main advantage of the specification is its ability to identify clusters of subjects with a similar random effects structure. For the estimation of the trend curve the mixed model representation of penalized splines is used. An Expectation-Maximization algorithm is given that solves the estimation problem and that exhibits advantages over Markov chain Monte Carlo approaches, which are typically used when modeling with Dirichlet processes. The method is evaluated in a simulation study and applied to theophylline data and to body mass index profiles of children.