Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimaging

• Published in: Journal of choice modelling Vol. 41; p. 100309
• Main Authors: Haghani, Milad, Bliemer, Michiel C.J., Rose, John M., Oppewal, Harmen, Lancsar, Emily
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.12.2021
• Subjects: Choice experiments; Economic valuation; Hypothetical bias; Hypothetical choice surveys; Stated preference; Hypothetical choice surveys; Hypothetical bias; Economic valuation; Choice experiments; Stated preference
• ISSN: 1755-5345; 1755-5345
• DOI: 10.1016/j.jocm.2021.100309

The notion of hypothetical bias (HB) constitutes, arguably, the most fundamental issue in relation to the use of hypothetical survey methods. Whether or to what extent choices of survey participants and subsequent inferred estimates translate to real-world settings continues to be debated. While HB has been extensively studied in the broader context of contingent valuation, it is much less understood in relation to choice experiments (CE). While the number of CE studies has rapidly increased, the critical issue of HB has been studied in only a small fraction of CE studies. This paper provides macro-scale insights into the literature of CE and reviews the empirical evidence for HB in CE in various fields of applied economics as well as experimental psychology and behavioural neuroscience. Results suggest mixed evidence on the prevalence, extent and direction of HB as well as considerable context and measurement dependency. While HB is found to be an undeniable issue when conducting CEs, the empirical evidence on HB does not render CEs unable to represent real-world preferences. While health-related choice experiments often find negligible degrees of HB, experiments in consumer behaviour and transport domains suggest significant degrees of HB. Environmental valuation studies provide mixed evidence. Also, across these disciplines many studies display HB in their total willingness to pay estimates and opt-in rates but not in their hypothetical marginal rates of substitution (subject to scale correction). Further, recent findings in psychology and brain imaging studies identify neurocognitive mechanisms underlying HB that may explain some of the discrepancies and unexpected findings in the mainstream CE literature. •Empirical evidence on the prevalence of hypothetical bias in choice experiments is reviewed.•The survey integrates findings of consumer, health, environmental and transport economics.•Evidence from experimental psychology partly explain mechanisms of hypothetical bias.•Hypothetical bias is found to be an undeniable issue in relation to choice experiments.•The prevalence of significant bias varies considerably across disciplines and contexts of choice.