From conflict management to reward-based decision making: Actors and critics in primate medial frontal cortex

• Published in: Neuroscience and biobehavioral reviews Vol. 46; pp. 44 - 57
• Main Authors: Silvetti, Massimo, Alexander, William, Verguts, Tom, Brown, Joshua W.
• Format: Journal Article
• Language: English
• Published: United States 01.10.2014
• Subjects: Animals; Decision Making - physiology; Frontal Lobe - physiology; Humans; Learning - physiology; Models, Neurological; Reinforcement (Psychology); Reward; Anterior cingulate; Computational modeling; Conflict monitoring; Cognitive control; Reinforcement learning
• ISSN: 0149-7634; 1873-7528; 1873-7528
• DOI: 10.1016/j.neubiorev.2013.11.003

The role of the medial prefrontal cortex (mPFC) and especially the anterior cingulate cortex has been the subject of intense debate for the last decade. A number of theories have been proposed to account for its function. Broadly speaking, some emphasize cognitive control, whereas others emphasize value processing; specific theories concern reward processing, conflict detection, error monitoring, and volatility detection, among others. Here we survey and evaluate them relative to experimental results from neurophysiological, anatomical, and cognitive studies. We argue for a new conceptualization of mPFC, arising from recent computational modeling work. Based on reinforcement learning theory, these new models propose that mPFC is an Actor-Critic system. This system is aimed to predict future events including rewards, to evaluate errors in those predictions, and finally, to implement optimal skeletal-motor and visceromotor commands to obtain reward. This framework provides a comprehensive account of mPFC function, accounting for and predicting empirical results across different levels of analysis, including monkey neurophysiology, human ERP, human neuroimaging, and human behavior.