Feature-based learning improves adaptability without compromising precision

• Published in: Nature communications Vol. 8; no. 1; pp. 1768 - 16
• Main Authors: Farashahi, Shiva, Rowe, Katherine, Aslami, Zohra, Lee, Daeyeol, Soltani, Alireza
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 24.11.2017; Nature Publishing Group; Nature Portfolio
• Subjects: 631/378/116/2396; 631/378/2649/1409; Adaptability; Adolescent; Adult; Choice Behavior; Computational neuroscience; Computer Simulation; Estimates; Female; Fruits; Heuristic; Humanities and Social Sciences; Humans; Hypotheses; Learning; Male; multidisciplinary; Neural coding; Neurons - physiology; Neurosciences; Reinforcement; Reward; Science; Science (multidisciplinary); Young Adult
• ISSN: 2041-1723; 2041-1723
• DOI: 10.1038/s41467-017-01874-w

Learning from reward feedback is essential for survival but can become extremely challenging with myriad choice options. Here, we propose that learning reward values of individual features can provide a heuristic for estimating reward values of choice options in dynamic, multi-dimensional environments. We hypothesize that this feature-based learning occurs not just because it can reduce dimensionality, but more importantly because it can increase adaptability without compromising precision of learning. We experimentally test this hypothesis and find that in dynamic environments, human subjects adopt feature-based learning even when this approach does not reduce dimensionality. Even in static, low-dimensional environments, subjects initially adopt feature-based learning and gradually switch to learning reward values of individual options, depending on how accurately objects’ values can be predicted by combining feature values. Our computational models reproduce these results and highlight the importance of neurons coding feature values for parallel learning of values for features and objects. Learning about a rewarded outcome is complicated by the fact that a choice often incorporates multiple features with differing association with the reward. Here the authors demonstrate that feature-based learning is an efficient and adaptive strategy in dynamically changing environments.