Effects of Structure and Meaning on Cortical Tracking of Linguistic Units in Naturalistic Speech

• Published in: Neurobiology of language Vol. 3; no. 3; pp. 386 - 412
• Main Authors: Coopmans, Cas W., de Hoop, Helen, Hagoort, Peter, Martin, Andrea E.
• Format: Journal Article
• Language: English
• Published: One Broadway, 12th Floor, Cambridge, Massachusetts 02142, USA MIT Press 01.01.2022; MIT Press Journals, The
• Subjects: Brain research; compositionality; Continuous speech; Dutch language; EEG; Electroencephalography; Event-related potentials; idioms; jabberwocky; Language; Lexical semantics; Linguistic units; Linguistics; mutual information; Natural language; Neurobiology; Neurosciences; Nonsense sentences; Phrases; Semantics; Sentence structure; Speech; Syntactic structures; Syntax; Word meaning; idioms; compositionality; mutual information; EEG; jabberwocky
• ISSN: 2641-4368; 2641-4368
• DOI: 10.1162/nol_a_00070

Recent research has established that cortical activity “tracks” the presentation rate of syntactic phrases in continuous speech, even though phrases are abstract units that do not have direct correlates in the acoustic signal. We investigated whether cortical tracking of phrase structures is modulated by the extent to which these structures compositionally determine meaning. To this end, we recorded electroencephalography (EEG) of 38 native speakers who listened to naturally spoken Dutch stimuli in different conditions, which parametrically modulated the degree to which syntactic structure and lexical semantics determine sentence meaning. Tracking was quantified through mutual information between the EEG data and either the speech envelopes or abstract annotations of syntax, all of which were filtered in the frequency band corresponding to the presentation rate of phrases (1.1–2.1 Hz). Overall, these mutual information analyses showed stronger tracking of phrases in regular sentences than in stimuli whose lexical-syntactic content is reduced, but no consistent differences in tracking between sentences and stimuli that contain a combination of syntactic structure and lexical content. While there were no effects of compositional meaning on the degree of phrase-structure tracking, analyses of event-related potentials elicited by sentence-final words did reveal meaning-induced differences between conditions. Our findings suggest that cortical tracking of structure in sentences indexes the internal generation of this structure, a process that is modulated by the properties of its input, but not by the compositional interpretation of its output.