Dopamine-Mediated Reinforcement Learning Signals in the Striatum and Ventromedial Prefrontal Cortex Underlie Value-Based Choices

• Published in: The Journal of neuroscience Vol. 31; no. 5; pp. 1606 - 1613
• Main Authors: Jocham, Gerhard, Klein, Tilmann A., Ullsperger, Markus
• Format: Journal Article
• Language: English
• Published: United States Society for Neuroscience 02.02.2011
• Subjects: Adult; Amisulpride; Choice Behavior - drug effects; Corpus Striatum - drug effects; Corpus Striatum - physiology; Dopamine - physiology; Dopamine Antagonists - pharmacology; Dopamine D2 Receptor Antagonists; Female; Humans; Magnetic Resonance Imaging; Male; Models, Neurological; Neuropsychological Tests; Prefrontal Cortex - drug effects; Prefrontal Cortex - physiology; Psychomotor Performance - drug effects; Reinforcement (Psychology); Reinforcement Schedule; Reward; Signal Transduction - drug effects; Signal Transduction - physiology; Sulpiride - analogs & derivatives; Sulpiride - pharmacology; Time Factors
• ISSN: 0270-6474; 1529-2401; 1529-2401
• DOI: 10.1523/JNEUROSCI.3904-10.2011

A large body of evidence exists on the role of dopamine in reinforcement learning. Less is known about how dopamine shapes the relative impact of positive and negative outcomes to guide value-based choices. We combined administration of the dopamine D 2 receptor antagonist amisulpride with functional magnetic resonance imaging in healthy human volunteers. Amisulpride did not affect initial reinforcement learning. However, in a later transfer phase that involved novel choice situations requiring decisions between two symbols based on their previously learned values, amisulpride improved participants' ability to select the better of two highly rewarding options, while it had no effect on choices between two very poor options. During the learning phase, activity in the striatum encoded a reward prediction error. In the transfer phase, in the absence of any outcome, ventromedial prefrontal cortex (vmPFC) continually tracked the learned value of the available options on each trial. Both striatal prediction error coding and tracking of learned value in the vmPFC were predictive of subjects' choice performance in the transfer phase, and both were enhanced under amisulpride. These findings show that dopamine-dependent mechanisms enhance reinforcement learning signals in the striatum and sharpen representations of associative values in prefrontal cortex that are used to guide reinforcement-based decisions.