Impact of survey length and compensation on validity, reliability, and sample characteristics for Ultrashort-, Short-, and Long-Research Participant Perception Surveys

• Published in: Journal of clinical and translational science Vol. 2; no. 1; pp. 31 - 37
• Main Authors: Kost, Rhonda G., Correa da Rosa, Joel
• Format: Journal Article
• Language: English
• Published: England Cambridge University Press 01.02.2018
• Subjects: community engagement; Compensation; Demographics; Demography; Ethnicity; Hypothesis testing; Patient engagement; patient-centered; Perception; performance improvement; Polls & surveys; Research centers; Research Methods and Technology; research participant experience; Response rates; Sample size; Science; Standard scores; Validity; New York
• ISSN: 2059-8661; 2059-8661
• DOI: 10.1017/cts.2018.18

The validated Research Participant Perception Survey (RPPS-Long) elicits valuable data at modest response rates. To address this limitation, we developed shorter RPPS-Ultrashort and RPPS-Short versions, fielded them with the RPPS-Long to a random sample of a national research volunteer registry, and assessed response and completion rates, test/retest reliability, and demographics. 2228 eligible registry members received survey links. Response rates were 64% (RPPS-Ultrashort), 63% (RPPS-Short), and 51% (RPPS-Long), respectively (P<0.001). Completion rates were 63%, 54%, and 37%, respectively (p<0.001). All surveys were reliable with Cronbach's alpha = 0.81, 0.84, and 0.87, respectively. Retest reliability was highest for RPPS-Short (Kappa=0.85). Provision of compensation increased RPPS-Short completion rate from 54% to 71% (p<0.001). Compensated respondents were younger (p<0.001), with greater minority representation (p=0.03). Shorter surveys were reliable and produced higher response and completion rates then long surveys. Compensation further increased completion rates and shifted sample age and race profiles.