Multifaceted confidence in exploratory choice

• Published in: PloS one Vol. 20; no. 1; p. e0304923
• Main Authors: Solopchuk, Oleg, Dayan, Peter
• Format: Journal Article
• Language: English
• Published: United States Public Library of Science 09.01.2025; Public Library of Science (PLoS)
• Subjects: Adolescent; Adult; Biology and Life Sciences; Choice (Psychology); Choice Behavior - physiology; Cognitive ability; Confidence; Decision making; Dissociation; Experiments; Exploration; Exploratory Behavior - physiology; Female; Humans; Hypotheses; Male; Medical research; Medicine and Health Sciences; Physical Sciences; Psychological research; Reinforcement; Research and Analysis Methods; Reward; Social Sciences; Stochastic models; Young Adult; Germany
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0304923

Our choices are typically accompanied by a feeling of confidence—an internal estimate that they are correct. Correctness, however, depends on our goals. For example, exploration-exploitation problems entail a tension between short- and long-term goals: finding out about the value of one option could mean foregoing another option that is apparently more rewarding. Here, we hypothesised that after making an exploratory choice that involves sacrificing an immediate gain, subjects will be confident that they chose a better option for long-term rewards, but not confident that it was a better option for immediate reward. We asked 250 subjects across 2 experiments to perform a varying-horizon two-arm bandits task, in which we asked them to rate their confidence that their choice would lead to more immediate, or more total reward. Confirming previous studies, we found a significant increase in exploration with increasing trial horizon, but, contrary to our predictions, we found no difference between confidence in immediate or total reward. This dissociation is further evidence for a separation in the mechanisms involved in choices and confidence judgements.