Spatial-Temporal Convolutional Attention for Mapping Functional Brain Networks

Using functional magnetic resonance imaging (fMRI) and deep learning to explore functional brain networks (FBNs) has attracted many researchers. However, most of these studies still rely on temporal correlation between sources and voxel signals, lacking exploration of the dynamics of brain function....

Full description

Saved in:
Bibliographic Details
Published in2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI) pp. 1 - 4
Main Authors Liu, Yiheng, Ge, Enjie, Qiang, Ning, Liu, Tianming, Ge, Bao
Format Conference Proceeding
LanguageEnglish
Published IEEE 18.04.2023
Subjects
Attention Mechanism
Biological system modeling
Brain Function Dynamic
Brain modeling
Convolution
Correlation
Deep learning
fMRI
Functional Brain Network
Functional magnetic resonance imaging
Task analysis
Online AccessGet full text

Cover

More Information
Summary:Using functional magnetic resonance imaging (fMRI) and deep learning to explore functional brain networks (FBNs) has attracted many researchers. However, most of these studies still rely on temporal correlation between sources and voxel signals, lacking exploration of the dynamics of brain function. Due to the prevalent local correlations in volumes, FBNs can be directly generated in the spatial domain using spatial-wise attention (SA) in a self-supervised manner, resulting in higher spatial similarity with templates compared to classical methods. Therefore, we propose a novel Spatial-Temporal Convolutional Attention (STCA) model to dynamically discover FBNs using sliding windows. We validate the performance of our proposed method on the HCP-rest dataset, showing that STCA can be used to dynamically discover FBNs, offering a novel approach to better understand the human brain.
ISSN:1945-8452
DOI:10.1109/ISBI53787.2023.10230749