A hybrid Convolutional and Recurrent Neural Network for Hippocampus Analysis in Alzheimer's Disease

• Published in: Journal of neuroscience methods Vol. 323; pp. 108 - 118
• Main Authors: Li, Fan, Liu, Manhua
• Format: Journal Article
• Language: English
• Published: Netherlands Elsevier B.V 15.07.2019
• Subjects: Alzheimer's disease; Convolutional neural networks (CNN); Hippocampus analysis; Image classification; MR brain images; Recurrent Neural Network (RNN); Recurrent Neural Network (RNN); Convolutional neural networks (CNN); Alzheimer's disease; MR brain images; Hippocampus analysis; Image classification
• ISSN: 0165-0270; 1872-678X; 1872-678X
• DOI: 10.1016/j.jneumeth.2019.05.006

•Propose a hybrid convolutional and recurrent neural network for hippocampus analysis•3D image patch from hippocampus is divided into internal and external hippo patches•DenseNets are built on the decomposed patches to learn intensity and shape features•RNN is cascaded to learn the high-level features of hippocampus for AD diagnosis•Experiments on ADNI show the effectiveness of proposed method and its superiority Hippocampus is one of the first structures affected by neurodegenerative diseases such as Alzheimer's disease (AD) and mild cognitive impairment (MCI). Hippocampal atrophy can be evaluated in terms of hippocampal volumes and shapes using structural MR images. However, the shape and volume features from hippocampus mask have limited discriminative information for AD diagnosis. In addition, extraction of these features is independent of classification model, resulting to sub-optimal performance for disease diagnosis. This paper proposes a hybrid convolutional and recurrent neural network for more detailed hippocampus analysis using structural MR images in AD. The DenseNets are constructed on the decomposed image patches of internal and external hippocampus to learn the intensity and shape features. Recurrent neural network (RNN) is cascaded to combine the features from the left and right hippocampus and learn the high-level features for disease classification. Our proposed method is evaluated with the baseline MR images of 807 subjects including 194 AD, 397 MCI and 216 normal controls (NC) from Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Experiments show the proposed method achieves AUC (area under ROC curve) of 91.0%, 75.8% and 74.6% for classifications of AD vs. NC, MCI vs. NC and pMCI vs. sMCI, respectively. The proposed method achieves better performance than the volume and shape analysis methods. A hybrid convolutional and recurrent neural network was proposed by combining DenseNets and bidirectional gated recurrent unit (BGRU) for hippocampus analysis and AD diagnosis. Results show its promising performance.