A multimodal encoding model applied to imaging decision-related neural cascades in the human brain

• Published in: NeuroImage (Orlando, Fla.) Vol. 180; no. Pt A; pp. 211 - 222
• Main Authors: Muraskin, Jordan, Brown, Truman R., Walz, Jennifer M., Tu, Tao, Conroy, Bryan, Goldman, Robin I., Sajda, Paul
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 15.10.2018; Elsevier Limited
• Subjects: Adult; Brain; Brain - physiology; Brain mapping; Brain Mapping - methods; Cognition; Confidence; Decision making; Decision Making - physiology; EEG; Electroencephalography; Electroencephalography - methods; Female; fMRI; Frontal lobe; Functional magnetic resonance imaging; Humans; Hypotheses; Magnetic Resonance Imaging - methods; Male; Models, Neurological; Multimodal Imaging - methods; Neuroimaging; Simultaneous acquisition; Young Adult; Decision-making; fMRI; Simultaneous acquisition; Confidence; EEG
• DOI: 10.1016/j.neuroimage.2017.06.059
• ISSN: 1053-8119

Perception and cognition in the brain are naturally characterized as spatiotemporal processes. Decision-making, for example, depends on coordinated patterns of neural activity cascading across the brain, running in time from stimulus to response and in space from primary sensory regions to the frontal lobe. Measuring this cascade is key to developing an understanding of brain function. Here we report on a novel methodology that employs multi-modal imaging for inferring this cascade in humans at unprecedented spatiotemporal resolution. Specifically, we develop an encoding model to link simultaneously measured electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) signals to infer high-resolution spatiotemporal brain dynamics during a perceptual decision. After demonstrating replication of results from the literature, we report previously unobserved sequential reactivation of a substantial fraction of the pre-response network whose magnitude correlates with a proxy for decision confidence. Our encoding model, which temporally tags BOLD activations using time localized EEG variability, identifies a coordinated and spatially distributed neural cascade that is associated with a perceptual decision. In general the methodology illuminates complex brain dynamics that would otherwise be unobservable using fMRI or EEG acquired separately. •An encoding model method is proposed that links simultaneously measured EEG and fMRI.•The method temporally tags BOLD activations using time localized EEG variability.•The method is applied to EEG/fMRI acquired during a perceptual decision making task.•Results include a previously unobserved reactivation of a pre-response network.•The magnitude of the reactivation correlates with a proxy for decision confidence.