Data-efficient deep learning of radiological image data for outcome prediction after endovascular treatment of patients with acute ischemic stroke

• Published in: Computers in biology and medicine Vol. 115; p. 103516
• Main Authors: Hilbert, A., Ramos, L.A., van Os, H.J.A., Olabarriaga, S.D., Tolhuisen, M.L., Wermer, M.J.H., Barros, R.S., van der Schaaf, I., Dippel, D., Roos, Y.B.W.E.M., van Zwam, W.H., Yoo, A.J., Emmer, B.J., Lycklama à Nijeholt, G.J., Zwinderman, A.H., Strijkers, G.J., Majoie, C.B.L.M., Marquering, H.A.
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.12.2019; Elsevier Limited
• Subjects: Accuracy; Acute ischemic stroke; Algorithms; Angiography; Arteries; Artificial intelligence; Artificial neural networks; Automation; Biomarkers; Cardiovascular system; Clinical decision making; Coders; Computed tomography; Datasets; Decision making; Deep learning; Gradient-weighted class activation mapping; Image analysis; Image annotation; Image processing; Ischemia; Learning algorithms; Machine learning; Medical imaging; Medical prognosis; Neural networks; Occlusion; Patients; Prognostics; Radiological images; Reperfusion; ResNet; RFNN; Software; Stroke; Structured receptive fields; Visualization; Netherlands; Deep learning; RFNN; Radiological images; Gradient-weighted class activation mapping; Acute ischemic stroke; Structured receptive fields; Prognostics; ResNet
• ISSN: 0010-4825; 1879-0534; 1879-0534
• DOI: 10.1016/j.compbiomed.2019.103516

Treatment selection is becoming increasingly more important in acute ischemic stroke patient care. Clinical variables and radiological image biomarkers (old age, pre-stroke mRS, NIHSS, occlusion location, ASPECTS, among others) have an important role in treatment selection and prognosis. Radiological biomarkers require expert annotation and are subject to inter-observer variability. Recently, Deep Learning has been introduced to reproduce these radiological image biomarkers. Instead of reproducing these biomarkers, in this work, we investigated Deep Learning techniques for building models to directly predict good reperfusion after endovascular treatment (EVT) and good functional outcome using CT angiography images. These models do not require image annotation and are fast to compute. We compare the Deep Learning models to Machine Learning models using traditional radiological image biomarkers. We explored Residual Neural Network (ResNet) architectures, adapted them with Structured Receptive Fields (RFNN) and auto-encoders (AE) for network weight initialization. We further included model visualization techniques to provide insight into the network's decision-making process. We applied the methods on the MR CLEAN Registry dataset with 1301 patients. The Deep Learning models outperformed the models using traditional radiological image biomarkers in three out of four cross-validation folds for functional outcome (average AUC of 0.71) and for all folds for reperfusion (average AUC of 0.65). Model visualization showed that the arteries were relevant features for functional outcome prediction. The best results were obtained for the ResNet models with RFNN. Auto-encoder initialization often improved the results. We concluded that, in our dataset, automated image analysis with Deep Learning methods outperforms radiological image biomarkers for stroke outcome prediction and has the potential to improve treatment selection. [Display omitted] •We proposed a Deep Learning approach for predicting outcomes of acute ischemic stroke patients using CT angiography images.•We found out that in most cases, pre-training with auto-encoders improved the prediction.•Our approach does not require expert annotation of the images and is fast to compute.•Gradient-weighted Class Activation Mapping allows visualization of the imaging features to interpret our models.•Our models had a higher predictive value than models using common radiological image biomarkers for outcome prediction.