It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience

• Published in: Social cognitive and affective neuroscience Vol. 5; no. 1; pp. 98 - 107
• Main Authors: Wilms, Marcus, Schilbach, Leonhard, Pfeiffer, Ulrich, Bente, Gary, Fink, Gereon R, Vogeley, Kai
• Format: Journal Article
• Language: English
• Published: England Oxford University Press 01.03.2010
• Subjects: Attention - physiology; Brain Mapping - methods; Eye Movement Measurements; Eye Movements; Humans; Magnetic Resonance Imaging - methods; Photic Stimulation; Tools of the Trade; Visual Perception - physiology
• ISSN: 1749-5016; 1749-5024
• DOI: 10.1093/scan/nsq024

The field of social neuroscience has made remarkable progress in elucidating the neural mechanisms of social cognition. More recently, the need for new experimental approaches has been highlighted that allow studying social encounters in a truly interactive manner by establishing 'online' reciprocity in social interaction. In this article, we present a newly developed adaptation of a method which uses eyetracking data obtained from participants in real time to control visual stimulation during functional magnetic resonance imaging, thus, providing an innovative tool to generate gaze-contingent stimuli in spite of the constraints of this experimental setting. We review results of two paradigms employing this technique and demonstrate how gaze data can be used to animate a virtual character whose behavior becomes 'responsive' to being looked at allowing the participant to engage in 'online' interaction with this virtual other in real-time. Possible applications of this setup are discussed highlighting the potential of this development as a new 'tool of the trade' in social cognitive and affective neuroscience.