Superior colliculus neurons encode a visual saliency map during free viewing of natural dynamic video

• Published in: Nature communications Vol. 8; no. 1; p. 14263
• Main Authors: White, Brian J., Berg, David J., Kan, Janis Y., Marino, Robert A., Itti, Laurent, Munoz, Douglas P.
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 24.01.2017; Nature Publishing Group; Nature Portfolio
• Subjects: 631/378/2617/1832; 631/378/2649/1310; Animals; Attention - physiology; Computer Simulation; Humanities and Social Sciences; Hypotheses; Macaca mulatta; Male; Models, Animal; Models, Neurological; Monkeys & apes; multidisciplinary; Neural Pathways; Neurons; Neurons - physiology; Neurosciences; Photic Stimulation - methods; Saccades; Science; Science (multidisciplinary); Software; Superior Colliculi - cytology; Superior Colliculi - physiology; Thalamus - physiology; Visual Perception - physiology; United States > US; California
• ISSN: 2041-1723; 2041-1723
• DOI: 10.1038/ncomms14263

Models of visual attention postulate the existence of a saliency map whose function is to guide attention and gaze to the most conspicuous regions in a visual scene. Although cortical representations of saliency have been reported, there is mounting evidence for a subcortical saliency mechanism, which pre-dates the evolution of neocortex. Here, we conduct a strong test of the saliency hypothesis by comparing the output of a well-established computational saliency model with the activation of neurons in the primate superior colliculus (SC), a midbrain structure associated with attention and gaze, while monkeys watched video of natural scenes. We find that the activity of SC superficial visual-layer neurons (SCs), specifically, is well-predicted by the model. This saliency representation is unlikely to be inherited from fronto-parietal cortices, which do not project to SCs, but may be computed in SCs and relayed to other areas via tectothalamic pathways. Saliency maps have been proposed to guide visual attention, yet the underlying neural correlates remain undetermined. Here, the authors record from monkeys as they watch videos of natural scenes, and find superior colliculus superficial visual-layer neurons exhibit activity patterns consistent with a visual saliency map.