Eye movements during visual imagery and perception show spatial correspondence but have unique temporal signatures

• Published in: Cognition Vol. 210; p. 104597
• Main Authors: Gurtner, Lilla M., Hartmann, Matthias, Mast, Fred W.
• Format: Journal Article
• Language: English
• Published: Netherlands Elsevier B.V 01.05.2021; Elsevier Science Ltd
• Subjects: Bayesian analysis; Bayesian hierarchical regression; Cognitive ability; Eye; Eye fixation; Eye movement; Eye movements; Fixation; Imagery; Looking at nothing; Mathematical models; Measurement; Mental imagery; Mental task performance; Moderation; Recurrence; Recurrence quantification analysis; Regression analysis; Short term memory; Spatial correspondence; Spatial discrimination; Spatial memory; Visual imagery; Visual perception; Visual system; Vividness; Visual imagery; Looking at nothing; Recurrence quantification analysis; Bayesian hierarchical regression; Spatial correspondence; Eye movement
• ISSN: 0010-0277; 1873-7838
• DOI: 10.1016/j.cognition.2021.104597

Eye fixation patterns during mental imagery are similar to those during perception of the same picture, suggesting that oculomotor mechanisms play a role in mental imagery (i.e., the “looking at nothing” effect). Previous research has focused on the spatial similarities of eye movements during perception and mental imagery. The primary aim of this study was to assess whether the spatial similarity translates to the temporal domain. We used recurrence quantification analysis (RQA) to assess the temporal structure of eye fixations in visual perception and mental imagery and we compared the temporal as well as the spatial characteristics in mental imagery with perception by means of Bayesian hierarchical regression models. We further investigated how person and picture-specific characteristics contribute to eye movement behavior in mental imagery. Working memory capacity and mental imagery abilities were assessed to either predict gaze dynamics in visual imagery or to moderate a possible correspondence between spatial or temporal gaze dynamics in perception and mental imagery. We were able to show the spatial similarity of fixations between visual perception and imagery and we provide first evidence for its moderation by working memory capacity. Interestingly, the temporal gaze dynamics in mental imagery were unrelated to those in perception and their variance between participants was not explained by variance in visuo-spatial working memory capacity or vividness of mental images. The semantic content of the imagined pictures was the only meaningful predictor of temporal gaze dynamics. The spatial correspondence reflects shared spatial structure of mental images and perceived pictures, while the unique temporal gaze behavior could be driven by generation, maintenance and protection processes specific to visual imagery. The unique temporal gaze dynamics offer a window to new insights into the genuine process of mental imagery independent of its similarity to perception