A Hybrid Multi-scale Attention Convolution and Aging Transformer Network for Alzheimer's Disease Diagnosis

• Published in: IEEE journal of biomedical and health informatics Vol. 27; no. 7; pp. 1 - 8
• Main Authors: Gao, Xingyu, Cai, Hongjie, Liu, Manhua
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.07.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Aging; Alzheimer Disease - diagnostic imaging; Alzheimer Disease - pathology; Alzheimer's disease; Alzheimer's disease diagnosis; Artificial neural networks; Attention mechanism; Bioinformatics; Brain; Brain - diagnostic imaging; Brain - pathology; Brain mapping; Computational neuroscience; Convolution; Correlation; Deep learning; Dementia; Dementia disorders; Diagnosis; Feature extraction; Feature maps; Humans; Magnetic resonance imaging; Magnetic Resonance Imaging - methods; Medical diagnosis; Medical imaging; Multi-scale convolution; Neural networks; Neural Networks, Computer; Neurodegenerative diseases; Neuroimaging; Neuroimaging - methods; Structural MRI; Transformer; Transformers
• ISSN: 2168-2194; 2168-2208; 2168-2208
• DOI: 10.1109/JBHI.2023.3270937

Deep neural networks have been successfully investigated in the computational analysis of structural magnetic resonance imaging (sMRI) data for the diagnosis of dementia, such as Alzheimer's disease (AD). The disease-related changes in sMRI may be different in local brain regions, which have variant structures but with some correlations. In addition, aging increases the risk of dementia. However, it is still challenging to capture the local variations and long-range correlations of different brain regions and make use of the age information for disease diagnosis. To address these problems, this paper proposes a hybrid network with multi-scale attention convolution and aging transformer for AD diagnosis. First, to capture the local variations, a multi-scale attention convolution is proposed to learn the feature maps with multi-scale kernels, which are adaptively aggregated by an attention module. Then, to model the long-range correlations of brain regions, a pyramid non-local block is used on the high-level features to learn more powerful features. Finally, we propose an aging transformer subnetwork to embed the age information into image features and capture the dependencies between subjects at different ages. The proposed method can learn not only the subject-specific rich features but also the inter-subject age correlations in an end-to-end framework. Our method is evaluated with T1-weighted sMRI scans from a large cohort of subjects on the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Experimental results demonstrate that our method has achieved promising performance for AD-related diagnosis.