LCGNet: Local Sequential Feature Coupling Global Representation Learning for Functional Connectivity Network Analysis With fMRI

• Published in: IEEE transactions on medical imaging Vol. 43; no. 12; pp. 4319 - 4330
• Main Authors: Zhou, Jie, Jie, Biao, Wang, Zhengdong, Zhang, Zhixiang, Du, Tongchun, Bian, Weixin, Yang, Yang, Jia, Jun
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.12.2024
• Subjects: Adult; Alzheimer Disease - diagnostic imaging; Attention Deficit Disorder with Hyperactivity - diagnostic imaging; Attention Deficit Disorder with Hyperactivity - physiopathology; Brain - diagnostic imaging; Brain - physiology; convolutional neural network; Couplings; disease classification; Diseases; Feature extraction; Female; Functional connectivity network; Functional magnetic resonance imaging; Humans; Image Processing, Computer-Assisted - methods; Long short term memory; Machine Learning; Magnetic Resonance Imaging - methods; Male; Nerve Net - diagnostic imaging; Neural Networks, Computer; Representation learning; transformer; Transformers
• ISSN: 0278-0062; 1558-254X; 1558-254X
• DOI: 10.1109/TMI.2024.3421360

Analysis of functional connectivity networks (FCNs) derived from resting-state functional magnetic resonance imaging (rs-fMRI) has greatly advanced our understanding of brain diseases, including Alzheimer's disease (AD) and attention deficit hyperactivity disorder (ADHD). Advanced machine learning techniques, such as convolutional neural networks (CNNs), have been used to learn high-level feature representations of FCNs for automated brain disease classification. Even though convolution operations in CNNs are good at extracting local properties of FCNs, they generally cannot well capture global temporal representations of FCNs. Recently, the transformer technique has demonstrated remarkable performance in various tasks, which is attributed to its effective self-attention mechanism in capturing the global temporal feature representations. However, it cannot effectively model the local network characteristics of FCNs. To this end, in this paper, we propose a novel network structure for Local sequential feature Coupling Global representation learning (LCGNet) to take advantage of convolutional operations and self-attention mechanisms for enhanced FCN representation learning. Specifically, we first build a dynamic FCN for each subject using an overlapped sliding window approach. We then construct three sequential components (i.e., edge-to-vertex layer, vertex-to-network layer, and network-to-temporality layer) with a dual backbone branch of CNN and transformer to extract and couple from local to global topological information of brain networks. Experimental results on two real datasets (i.e., ADNI and ADHD-200) with rs-fMRI data show the superiority of our LCGNet.