The Impact of Scale Direction on Data Quality

Survey literature has documented a tendency for respondents to select scale options closer to the start of a scale, resulting in scale direction effects. This paper builds upon the literature and expands it in two important ways. First, we experimentally manipulated scale length, scale labeling, and...

Full description

Saved in:
Bibliographic Details
Published inSurvey research methods Vol. 19; no. 2
Main Authors Ting Yan, Alexandru Cernat, Florian Keusch
Format Journal Article
LanguageEnglish
Published European Survey Research Association 08.08.2025
Subjects
data quality
measurement equivalence
reliability
satisficing
scale direction
validity
Online AccessGet full text

Cover

More Information
Summary:Survey literature has documented a tendency for respondents to select scale options closer to the start of a scale, resulting in scale direction effects. This paper builds upon the literature and expands it in two important ways. First, we experimentally manipulated scale length, scale labeling, and scale type, and fully crossed them with scale direction. This experimental setup allows us to examine the moderating effects of other scale features on scale direction effects. Second, previous literature largely examined the impact of scale direction on distributional properties of answers. In this paper, we conducted a systematic assessment of reliability and validity of answers as well as measurement equivalence by scale direction, allowing us to gain a deeper understanding and a more complete picture of the impact of scale direction on resultant answers. The findings will have important implications for question writers and will provide practical guidance on the direction of scales.
ISSN:1864-3361
DOI:10.18148/srm/2025.v19i2.8384