Analysis of single-case data: Randomisation tests for measures of effect size

• Published in: Neuropsychological rehabilitation Vol. 24; no. 3-4; pp. 507 - 527
• Main Authors: Heyvaert, Mieke, Onghena, Patrick
• Format: Journal Article
• Language: English
• Published: England Routledge 04.07.2014; Taylor & Francis Ltd
• Subjects: Computer Graphics; Humans; Internal validity; Magnitude; Nonparametric statistical significance test; Random Allocation; Randomisation test; Replication studies; Research Design - statistics & numerical data; Single-case experimental design; Single-subject experimental design; Software; Statistical software; Statistics as Topic - methods; Single-case experimental design; Randomisation test; Statistical software; Nonparametric statistical significance test; Single-subject experimental design
• ISSN: 0960-2011; 1464-0694; 1464-0694
• DOI: 10.1080/09602011.2013.818564

Single-case experiments can be used to evaluate the effect of an intervention or treatment for a single entity. The internal validity and statistical conclusion validity of single-case experiments can be improved by incorporating randomisation in their design. In this article, we explain how to design randomised single-case phase and alternation studies as well as randomised simultaneous and sequential replication studies, and how to conduct randomisation tests for these designs. Advantages and limitations of randomisation tests are discussed. In order to not only determine the (non)randomness of an intervention effect, but also the magnitude of this effect, we propose to use an effect size index as a test statistic for the randomisation test. We illustrate this combination for the design and analysis of an ABAB phase study, using a free software package.