The Problem with Online Data Collection: Predicting Invalid Responding in Undergraduate Samples

The popularity of online research is increasing, but the validity of the results obtained is not yet clear. The purpose of this study was to examine some of the factors that influence the validity of computerized data collection in an undergraduate sample. Participants were 99 university students ra...

Full description

Saved in:
Bibliographic Details
Published inCurrent psychology (New Brunswick, N.J.) Vol. 38; no. 5; pp. 1258 - 1264
Main Authors Al-Salom, Patricia, Miller, Carlin J.
Format Journal Article
LanguageEnglish
Published New York Springer US 01.10.2019
Springer
Springer Nature B.V
Subjects
Behavioral Science and Psychology
College students
Data collection
Data entry
Psychology
Social Sciences
Surveys
Validity
Online research
Data validity
Undergraduate students
Online AccessGet full text

Cover

More Information
Summary:The popularity of online research is increasing, but the validity of the results obtained is not yet clear. The purpose of this study was to examine some of the factors that influence the validity of computerized data collection in an undergraduate sample. Participants were 99 university students randomly assigned to one of three data collection conditions: online survey platform, in-person computerized survey platform, and in-person pencil-and-paper survey. Results suggest self-reported inattention symptoms, exposure to more stressors, and computerized platforms predicted more invalid responding. In contrast, personality, self-reported impulsivity symptoms, and shorter completion times did not predict invalid responding. Overall, more than half of the participants failed at least one validity check and 11% failed three or more validity checks. Researchers, particularly those working with undergraduate samples, should consider implementing procedures to ensure the data collected online are valid.
ISSN:1046-1310
1936-4733
DOI:10.1007/s12144-017-9674-9