Closer in time when farther in space—Spatial factors in audiovisual temporal integration

• Published in: Brain research. Cognitive brain research Vol. 25; no. 2; pp. 443 - 458
• Main Authors: Noesselt, Toemme, Fendrich, Robert, Bonath, Bjoern, Tyll, Sascha, Heinze, Hans-Jochen
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01.10.2005; Elsevier Science
• Subjects: Acoustic Stimulation - methods; Adult; Analysis of Variance; Attention - physiology; Audiovisual; Auditory driving; Auditory Perception - physiology; Biological and medical sciences; Cognition. Intelligence; Crossmodal; Dose-Response Relationship, Radiation; Fundamental and applied biological sciences. Psychology; Humans; Intersensory synchrony; Judgment - physiology; Miscellaneous; Photic Stimulation - methods; Psychology. Psychoanalysis. Psychiatry; Psychology. Psychophysiology; Psychomotor Performance; Reaction Time - physiology; Sensory Thresholds; Space Perception - physiology; Temporal integration; Time; Time Perception - physiology; Audiovisual; Auditory driving; Temporal integration; Sensory system; Intersensory synchrony; Crossmodal; Human; Hearing; Information processing; Cognition; Audiovisual integration; Intermodal perception
• ISSN: 0926-6410
• DOI: 10.1016/j.cogbrainres.2005.07.005

We investigated the effect of visual eccentricity and spatial alignment on judgments of audiovisual synchrony. Sequences of flashes at 4, 6, and 8 Hz were presented centrally, or at horizontal eccentricities of 6° or 18°. Concurrent sequences of clicks were presented at the same rate as the flashes, or at higher or lower rates. Subjects judged whether the flash rate was the same as (synchronous with), faster than, or slower than the click rate. With the 4- and 6-Hz flash rates, subjects' judgments of audiovisual synchrony increased with increasing eccentricity, but only when the click rate was more rapid than the flash rate. This effect remained even when the size of the peripheral visual stimuli was adjusted to compensate for cortical magnification, and was not significantly influenced by the spatial proximity of the auditory and visual signals. However, it was absent when the auditory and visual stimuli were presented serially rather than concurrently. With the 8-Hz flash rate, synchrony judgments were prevalent irrespective of eccentricity. When two serially presented flash rates were compared, visual–visual matching judgments increased with eccentricity at flash rates of 6 Hz and higher, but decreased at flash rates below 6 Hz. Finally, when two concurrent flash rates were compared, visual–visual synchrony judgments increased with eccentricity at all flash-rate combinations. Together, these results suggest that while perceptual uncertainty can play a role in synchrony judgments at rates of 6 Hz and higher, below 6 Hz eccentricity produces a widening of the window of apparent audiovisual temporal synchrony which perceptual uncertainty cannot explain.