Randomization tests as alternative analysis methods for behavior-analytic data

• Published in: Journal of the experimental analysis of behavior Vol. 111; no. 2; p. 309
• Main Authors: Craig, Andrew R, Fisher, Wayne W
• Format: Journal Article
• Language: English
• Published: United States 01.03.2019
• Subjects: Applied Behavior Analysis - methods; Applied Behavior Analysis - statistics & numerical data; Biological Variation, Individual; Data Interpretation, Statistical; Humans; Random Allocation; Research Design; Single-Case Studies as Topic - statistics & numerical data; Statistics, Nonparametric; data analysis; randomization; nonparametric statistics; between-groups research; single-case research; autocorrelation; within-subjects research
• ISSN: 1938-3711
• DOI: 10.1002/jeab.500

Randomization statistics offer alternatives to many of the statistical methods commonly used in behavior analysis and the psychological sciences, more generally. These methods are more flexible than conventional parametric and nonparametric statistical techniques in that they make no assumptions about the underlying distribution of outcome variables, are relatively robust when applied to small-n data sets, and are generally applicable to between-groups, within-subjects, mixed, and single-case research designs. In the present article, we first will provide a historical overview of randomization methods. Next, we will discuss the properties of randomization statistics that may make them particularly well suited for analysis of behavior-analytic data. We will introduce readers to the major assumptions that undergird randomization methods, as well as some practical and computational considerations for their application. Finally, we will demonstrate how randomization statistics may be calculated for mixed and single-case research designs. Throughout, we will direct readers toward resources that they may find useful in developing randomization tests for their own data.