A method to reduce imbalance for site-level randomized stepped wedge implementation trial designs

• Published in: Implementation science : IS Vol. 14; no. 1; pp. 46 - 9
• Main Authors: Lew, Robert A, Miller, Christopher J, Kim, Bo, Wu, Hongsheng, Stolzmann, Kelly, Bauer, Mark S
• Format: Journal Article
• Language: English
• Published: England BioMed Central Ltd 03.05.2019; BioMed Central; BMC
• Subjects: Ambulatory care facilities; Analysis; Chronic illnesses; Clinical trials; Collaboration; Design of experiments; Evidence-Based Medicine; Evidence-based practice; Hospital costs; Hospitals, Veterans - organization & administration; Humans; Imbalance; Intervention; Mental disorders; Mental Disorders - therapy; Mental health; Mental health services; Methodology; Methods; Nested control trails; Program Development; Quality Improvement; Research Design; Researchers; Stepped wedge; Systematic review; United States; United States Department of Veterans Affairs; Veterans hospitals; United States; Imbalance; Nested control trails; Stepped wedge
• ISSN: 1748-5908; 1748-5908
• DOI: 10.1186/s13012-019-0893-3

Controlled implementation trials often randomize the intervention at the site level, enrolling relatively few sites (e.g., 6-20) compared to trials that randomize by subject. Trials with few sites carry a substantial risk of an imbalance between intervened (cases) and non-intervened (control) sites in important site characteristics, thereby threatening the internal validity of the primary comparison. A stepped wedge design (SWD) staggers the intervention at sites over a sequence of times or time waves until all sites eventually receive the intervention. We propose a new randomization method, sequential balance, to control time trend in site allocation by minimizing sequential imbalance across multiple characteristics. We illustrate the new method by applying it to a SWD implementation trial. The trial investigated the impact of blended internal-external facilitation on the establishment of evidence-based teams in general mental health clinics in nine US Department of Veterans Affairs medical centers. Prior to randomization to start time, an expert panel of implementation researchers and health system program leaders identified by consensus a series of eight facility-level characteristics judged relevant to the success of implementation. We characterized each of the nine sites according to these consensus features. Using a weighted sum of these characteristics, we calculated imbalance scores for each of 1680 possible site assignments to identify the most sequentially balanced assignment schemes. From 1680 possible site assignments, we identified 34 assignments with minimal imbalance scores, and then randomly selected one assignment by which to randomize start time. Initially, the mean imbalance score was 3.10, but restricted to the 34 assignments, it declined to 0.99. Sequential balancing of site characteristics across groups of sites in the time waves of a SWD strengthens the internal validity of study conclusions by minimizing potential confounding. Registered at ClinicalTrials.gov as clinical trials # NCT02543840 ; entered 9/4/2015.