A neural active inference model of perceptual-motor learning

• Published in: Frontiers in computational neuroscience Vol. 17; p. 1099593
• Main Authors: Yang, Zhizhuo, Diaz, Gabriel J, Fajen, Brett R, Bailey, Reynold, Ororbia, Alexander G
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Research Foundation 20.02.2023; Frontiers Media S.A
• Subjects: active inference; anticipation; Cognitive ability; Free energy; interception; learning; locomotion; Motor skill learning; Nervous system; Neural networks; Neuroscience; Planning; Sensorimotor integration; learning; active inference; anticipation; interception; locomotion
• ISSN: 1662-5188; 1662-5188
• DOI: 10.3389/fncom.2023.1099593

The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience that can produce human-like behavior through reward-based learning. In this study, we test the ability for the AIF to capture the role of anticipation in the visual guidance of action in humans through the systematic investigation of a visual-motor task that has been well-explored-that of intercepting a target moving over a ground plane. Previous research demonstrated that humans performing this task resorted to anticipatory changes in speed intended to compensate for semi-predictable changes in target speed later in the approach. To capture this behavior, our proposed "neural" AIF agent uses artificial neural networks to select actions on the basis of a very short term prediction of the information about the task environment that these actions would reveal along with a long-term estimate of the resulting cumulative expected free energy. Systematic variation revealed that anticipatory behavior emerged only when required by limitations on the agent's movement capabilities, and only when the agent was able to estimate accumulated free energy over sufficiently long durations into the future. In addition, we present a novel formulation of the that maps a multi-dimensional world-state to a uni-dimensional distribution of free-energy/reward. Together, these results demonstrate the use of AIF as a plausible model of anticipatory visually guided behavior in humans.