Evaluating Reddit as a Crowdsourcing Platform for Psychology Research Projects

• Published in: Teaching of psychology Vol. 49; no. 4; pp. 329 - 337
• Main Authors: Luong, Raymond, Lomanowska, Anna M.
• Format: Journal Article
• Language: English
• Published: Los Angeles, CA SAGE Publications 01.10.2022; Taylor & Francis Ltd
• Subjects: Crowdsourcing; Data Collection; Ethnicity; Internet; Motivation; Psychological research; Psychological Studies; Psychology; Questionnaires; Recruitment; Research Methodology; Research Projects; Resistance (Psychology); Sample size; Social Characteristics; Social Media; Social networks; MTurk; crowdsourcing; Reddit; participant pool; r/SampleSize; online sample; online recruitment
• ISSN: 0098-6283; 1532-8023
• DOI: 10.1177/00986283211020739

Background: Online crowdsourcing platforms, such as Amazon Mechanical Turk (MTurk), have become popular alternatives to the ubiquitous student samples used in psychology research. r/SampleSize, an alternative pool on the website Reddit, allows for online participant recruitment without compulsory or immediate payment, making it potentially useful for students, research trainees, and course instructors. Objective: The current study sought to assess the viability of using r/SampleSize as a participant pool by comparing its data characteristics to MTurk and existing lab samples. Method: Two hundred and fifty-six MTurk workers and 277 r/SampleSize participants completed identical questionnaires on demographics, participation motivations, and standard psychology scales. Results: Participants recruited through r/SampleSize reported diverse ages, education levels, income, and employment, although White ethnic background and US residence were predominant. r/SampleSize participants were more internally motivated than MTurk to participate in research and had greater need for cognition but did not differ significantly in altruism or motivation to gain self-knowledge. r/SampleSize data reliability and quality were comparable to MTurk and lab samples across most analyses. Teaching Implications: r/SampleSize can be used to recruit relatively large and diverse samples for undergraduate research projects with minimal setup, labor, and cost. Conclusion: The findings suggest that r/SampleSize is a diverse and viable participant pool.