Sensitivity of reaction time to the magnitude of rewards reveals the cost-structure of time

• Published in: Scientific reports Vol. 9; no. 1; pp. 20053 - 14
• Main Authors: Steverson, Kai, Chung, Hui-Kuan, Zimmermann, Jan, Louie, Kenway, Glimcher, Paul
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 27.12.2019; Nature Publishing Group
• Subjects: 631/378/2649/1409; 631/378/2649/2150; Bayes Theorem; Computer applications; Decision Making; Diffusion models; Humanities and Social Sciences; Humans; Learning; Models, Psychological; multidisciplinary; Science; Science (multidisciplinary); Time and Motion Studies
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-019-56392-0

The Drift-Diffusion Model (DDM) is the prevalent computational model of the speed-accuracy trade-off in decision making. The DDM provides an explanation of behavior by optimally balancing reaction times and error rates. However, when applied to value-based decision making, the DDM makes the stark prediction that reaction times depend only on the relative utility difference between the options and not on absolute utility magnitudes. This prediction runs counter to evidence that reaction times decrease with higher utility magnitude. Here, we ask if and how it could be optimal for reaction times to show this observed pattern. We study an algorithmic framework that balances the cost of delaying rewards against the utility of obtained rewards. We find that the functional form of the cost of delay plays a key role, with the empirically observed pattern becoming optimal under multiplicative discounting. We add to the empirical literature by testing whether utility magnitude affects reaction times using a novel methodology that does not rely on functional form assumptions for the subjects’ utilities. Our results advance the understanding of how and why reaction times are sensitive to the magnitude of rewards.