Comparison of Object Recognition Behavior in Human and Monkey

• Published in: The Journal of neuroscience Vol. 35; no. 35; pp. 12127 - 12136
• Main Authors: Rajalingham, Rishi, Schmidt, Kailyn, DiCarlo, James J.
• Format: Journal Article
• Language: English
• Published: United States Society for Neuroscience 02.09.2015
• Subjects: Animals; Humans; Learning - physiology; Macaca mulatta; Male; Pattern Recognition, Visual - physiology; Photic Stimulation; Psychophysics; Recognition, Psychology - physiology; Species Specificity; object recognition; vision; monkey; human
• ISSN: 0270-6474; 1529-2401; 1529-2401
• DOI: 10.1523/JNEUROSCI.0573-15.2015

Although the rhesus monkey is used widely as an animal model of human visual processing, it is not known whether invariant visual object recognition behavior is quantitatively comparable across monkeys and humans. To address this question, we systematically compared the core object recognition behavior of two monkeys with that of human subjects. To test true object recognition behavior (rather than image matching), we generated several thousand naturalistic synthetic images of 24 basic-level objects with high variation in viewing parameters and image background. Monkeys were trained to perform binary object recognition tasks on a match-to-sample paradigm. Data from 605 human subjects performing the same tasks on Mechanical Turk were aggregated to characterize “pooled human” object recognition behavior, as well as 33 separate Mechanical Turk subjects to characterize individual human subject behavior. Our results show that monkeys learn each new object in a few days, after which they not only match mean human performance but show a pattern of object confusion that is highly correlated with pooled human confusion patterns and is statistically indistinguishable from individual human subjects. Importantly, this shared human and monkey pattern of 3D object confusion is not shared with low-level visual representations (pixels, V1+; models of the retina and primary visual cortex) but is shared with a state-of-the-art computer vision feature representation. Together, these results are consistent with the hypothesis that rhesus monkeys and humans share a common neural shape representation that directly supports object perception. SIGNIFICANCE STATEMENT To date, several mammalian species have shown promise as animal models for studying the neural mechanisms underlying high-level visual processing in humans. In light of this diversity, making tight comparisons between nonhuman and human primates is particularly critical in determining the best use of nonhuman primates to further the goal of the field of translating knowledge gained from animal models to humans. To the best of our knowledge, this study is the first systematic attempt at comparing a high-level visual behavior of humans and macaque monkeys.