The McGurk effect in the time of pandemic: Age-dependent adaptation to an environmental loss of visual speech cues

• Published in: Psychonomic bulletin & review Vol. 28; no. 3; pp. 992 - 1002
• Main Authors: Chládková, Kateřina, Podlipský, Václav Jonáš, Nudga, Natalia, Šimáčková, Šárka
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.06.2021; Springer Nature B.V
• Subjects: Adaptation; Age; Behavioral Science and Psychology; Brief Report; Cognitive Psychology; Communication; Language; Noise; Older people; Pandemics; Psychology; Speech; Cue reweighting; Audiovisual integration; Cognitive adaptation; Speech perception
• ISSN: 1069-9384; 1531-5320
• DOI: 10.3758/s13423-020-01852-2

Seeing a person’s mouth move for [ga] while hearing [ba] often results in the perception of “da.” Such audiovisual integration of speech cues, known as the McGurk effect, is stable within but variable across individuals. When the visual or auditory cues are degraded, due to signal distortion or the perceiver’s sensory impairment, reliance on cues via the impoverished modality decreases. This study tested whether cue-reliance adjustments due to exposure to reduced cue availability are persistent and transfer to subsequent perception of speech with all cues fully available. A McGurk experiment was administered at the beginning and after a month of mandatory face-mask wearing (enforced in Czechia during the 2020 pandemic). Responses to audio-visually incongruent stimuli were analyzed from 292 persons (ages 16–55), representing a cross-sectional sample, and 41 students (ages 19–27), representing a longitudinal sample. The extent to which the participants relied exclusively on visual cues was affected by testing time in interaction with age. After a month of reduced access to lipreading, reliance on visual cues (present at test) somewhat lowered for younger and increased for older persons. This implies that adults adapt their speech perception faculty to an altered environmental availability of multimodal cues, and that younger adults do so more efficiently. This finding demonstrates that besides sensory impairment or signal noise, which reduce cue availability and thus affect audio-visual cue reliance, having experienced a change in environmental conditions can modulate the perceiver’s (otherwise relatively stable) general bias towards different modalities during speech communication.