What I say depends on how you ask: Experimental evidence of the effect of framing on the measurement of attitudes

• Published in: Economics letters Vol. 238; p. 111686
• Main Authors: Bloem, Jeffrey R., Rahman, Khandker Wahedur
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.05.2024
• Subjects: Attitudes; Data collection; Framing effects; Non-classical measurement error; Response bias; Survey design; G41; Non-classical measurement error; Survey design; Attitudes; Response bias; Data collection; Framing effects; D91; C83
• ISSN: 0165-1765; 1873-7374
• DOI: 10.1016/j.econlet.2024.111686

We use a survey experiment to document the presence of framing effects in the measurement of attitudes. Next, using standard techniques for generating aggregate indices, we find that statement framing can meaningfully influence the relationship of the index with relevant covariates—in some cases changing the magnitude, statistical significance, and even the sign of the estimated relationship. We conclude by discussing how randomizing statement framing across respondents can help address bias in the measurement of attitudes. •Our analysis reveals evidence of framing effects.•Statement framing can lead to meaningful bias in estimated relationships.•Framing affects the magnitude, significance, and sign between indices and covariates.•Randomizing statement framing across respondents can address this bias.