Reducing Sensitive Survey Response Bias in Research on Adolescents: A Comparison of Web-Based and Paper-and-Pencil Administration

• Published in: American journal of health promotion Vol. 25; no. 5; pp. 349 - 352
• Main Authors: Wyrick, David L., Bond, Lloyd
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.05.2011
• Subjects: Adolescent; Bias; Child; Data Collection - methods; Disclosure; Female; Humans; Internet; Male; Schools; Self Report; Students - psychology; Students - statistics & numerical data; Writing; Computerized; Manuscript format: research; Study design: randomized trial; Strategy: nA; Health focus: nA; Web-Based; Target population circumstances: nA; Middle School; High School; Target population: youth; Survey; Response Rates; Paper-and-Pencil; Adolescent; Sensitive; Research purpose: modeling/relationship testing; Setting: school; Response Bias; Outcome measure: cognitive and behavioral
• ISSN: 0890-1171; 2168-6602; 2168-6602
• DOI: 10.4278/ajhp.080611-ARB-90

Purpose. Using the Problem Oriented Screening Instrument for Teenagers (POSIT), the effect of mode of administration on (1) students' willingness to disclose sensitive information and (2) response rates was investigated. Design. A2 × 2 unequal N factorial analysis of variance (ANOVA) design was employed. Mode of administration (paper-and-pencil vs. Web-based) was crossed with grade level (middle vs. high school). Setting. The study was conducted in two middle and two high schools. Subjects. A total of 628 middle and high school students completed the survey. Measures. The POSIT is a self-report measure with 139 yes/no items that identifies stressors in 10 functional areas (e.g., Substance Use). Analysis. An unequal N 2 (mode) × 2 (grade level) factorial ANOVA was employed. Results. No statistically significant differences were found for self-reported risk across modes of administration. Students completing the Web-based version of the survey were four times more likely to skip an item. Conclusions. Effect of Mode on Reporting of Sensitive Information—Students completed the Web-based surveys in computer labs with other students. The intent of the Web-based survey was to increase perceived privacy but the environment likely negated any effect. Effect of Mode on Response Rates—The higher response rate for the paper-and-pencil survey was the opposite of what was expected and revealed that students were more likely to skip sensitive items on the Web survey. (Am J Health Promot 2011;25[5]:349-352.)