Uncertainty in learning, choice, and visual fixation

• Published in: Proceedings of the National Academy of Sciences - PNAS Vol. 117; no. 6; pp. 3291 - 3300
• Main Authors: Stojić, Hrvoje, Orquin, Jacob L., Dayan, Peter, Dolan, Raymond J., Speekenbrink, Maarten
• Format: Journal Article
• Language: English
• Published: United States National Academy of Sciences 11.02.2020
• Subjects: Adolescent; Adult; Algorithms; Biological Sciences; Choice learning; Computer applications; Decision making; Decision Making - physiology; Exploratory Behavior - physiology; Female; Fixation; Fixation, Ocular - physiology; Humans; Kalman filters; Learning; Male; Reinforcement, Psychology; Social Sciences; Software; Task Performance and Analysis; Uncertainty; Visual discrimination learning; Young Adult; visual fixation; exploration–exploitation; uncertainty; decision making; reinforcement learning

Uncertainty plays a critical role in reinforcement learning and decision making. However, exactly how it influences behavior remains unclear. Multiarmed-bandit tasks offer an ideal test bed, since computational tools such as approximate Kalman filters can closely characterize the interplay between t...