Surely Shorter is Better? A Questionnaire Length Experiment in a Self-Completion Survey

• Published in: Survey research methods Vol. 19; no. 2
• Main Authors: Tim Hanson, Eva Aizpurua, Rory Fitzgerald, Marta Vukovic
• Format: Journal Article
• Language: English
• Published: European Survey Research Association 08.08.2025
• Subjects: Data Quality; European Social Survey; Interview length; Response Rate; Self-administered Questionnaires
• ISSN: 1864-3361
• DOI: 10.18148/srm/2025.v19i2.8348

As surveys increasingly transition to self-completion approaches, understanding the impact of design decisions on survey outcomes becomes paramount. This includes assessing the effects of different questionnaire lengths on survey quality and considering what length of questionnaire can reasonably be fielded in a self-completion environment. This paper presents findings from a self-completion experiment conducted in Austria in 2021, which compared the full European Social Survey Round 10 questionnaire (estimated 50-minute completion time) with a shorter version (anticipated 35-minute completion time). The analysis includes a comparison between the longer and shorter versions based on response rates, sample composition, and data quality indicators. Except for response rates, which were significantly but only slightly higher in the shorter condition, results for both versions were generally comparable. Fielding a shorter questionnaire did not produce clear benefits in terms of sample composition or data quality. These results suggest that a questionnaire that would traditionally be regarded as lengthy for self-completion can yield acceptable outcomes.