Enabling analytical power calculations for multilevel models with autocorrelated errors through deriving and approximating the precision matrix

• Published in: Behavior research methods Vol. 56; no. 7; pp. 8105 - 8131
• Main Authors: Lafit, Ginette, Artner, Richard, Ceulemans, Eva
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.10.2024; Springer Nature B.V
• Subjects: Behavioral Science and Psychology; Cognitive Psychology; Computer Simulation; Data Interpretation, Statistical; Humans; Hypotheses; Longitudinal Studies; Models, Statistical; Monte Carlo Method; Monte Carlo simulation; Multilevel Analysis; Notes/Comments/Reply Manuscript; Psychology; Statistical analysis; Statistical models; Statistical power; Intensive longitudinal designs; Statistical power; AR errors; Linear mixed effect models
• ISSN: 1554-3528; 1554-3528
• DOI: 10.3758/s13428-024-02435-y

To unravel how within-person psychological processes fluctuate in daily life, and how these processes differ between persons, intensive longitudinal (IL) designs in which participants are repeatedly measured, have become popular. Commonly used statistical models for those designs are multilevel models with autocorrelated errors. Substantive hypotheses of interest are then typically investigated via statistical hypotheses tests for model parameters of interest. An important question in the design of such IL studies concerns the determination of the number of participants and the number of measurements per person needed to achieve sufficient statistical power for those statistical tests. Recent advances in computational methods and software have enabled the computation of statistical power using Monte Carlo simulations. However, this approach is computationally intensive and therefore quite restrictive. To ease power computations, we derive simple-to-use analytical formulas for multilevel models with AR(1) within-person errors. Analytic expressions for a model family are obtained via asymptotic approximations of all sample statistics in the precision matrix of the fixed effects. To validate this analytical approach to power computation, we compare it to the simulation-based approach via a series of Monte Carlo simulations. We find comparable performances making the analytic approach a useful tool for researchers that can drastically save them time and resources.