Diagnostic evaluation of a deep learning model for optical diagnosis of colorectal cancer

• Published in: Nature communications Vol. 11; no. 1; p. 2961
• Main Authors: Zhou, Dejun, Tian, Fei, Tian, Xiangdong, Sun, Lin, Huang, Xianghui, Zhao, Feng, Zhou, Nan, Chen, Zuoyu, Zhang, Qiang, Yang, Meng, Yang, Yichen, Guo, Xuexi, Li, Zhibin, Liu, Jia, Wang, Jiefu, Wang, Junfeng, Wang, Bangmao, Zhang, Guoliang, Sun, Baocun, Zhang, Wei, Kong, Dalu, Chen, Kexin, Li, Xiangchun
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 11.06.2020; Nature Publishing Group; Nature Portfolio
• Subjects: 631/114/1305; 692/4020; 692/699/67/1504/1885; Aged; Cancer; Clinical trials; Colonoscopy; Colorectal cancer; Colorectal carcinoma; Colorectal Neoplasms - diagnosis; Datasets; Deep Learning; Diagnosis; Diagnostic systems; Female; Gastroenterology; Humanities and Social Sciences; Humans; Machine Learning; Male; Medical imaging; Middle Aged; multidisciplinary; Recall; Retrospective Studies; Science; Science (multidisciplinary); Test sets; Training; White light
• ISSN: 2041-1723; 2041-1723
• DOI: 10.1038/s41467-020-16777-6

Colonoscopy is commonly used to screen for colorectal cancer (CRC). We develop a deep learning model called CRCNet for optical diagnosis of CRC by training on 464,105 images from 12,179 patients and test its performance on 2263 patients from three independent datasets. At the patient-level, CRCNet achieves an area under the precision-recall curve (AUPRC) of 0.882 (95% CI: 0.828–0.931), 0.874 (0.820–0.926) and 0.867 (0.795–0.923). CRCNet exceeds average endoscopists performance on recall rate across two test sets (91.3% versus 83.8%; two-sided t-test, p < 0.001 and 96.5% versus 90.3%; p = 0.006) and precision for one test set (93.7% versus 83.8%; p = 0.02), while obtains comparable recall rate on one test set and precision on the other two. At the image-level, CRCNet achieves an AUPRC of 0.990 (0.987–0.993), 0.991 (0.987–0.995), and 0.997 (0.995–0.999). Our study warrants further investigation of CRCNet by prospective clinical trials. Colonoscopy is the most commonly used tool to screen for colorectal cancer (CRC). Here, the authors develop a deep learning model to perform optical diagnosis of CRC by training on a large data set of white-light colonoscopy images and achieve endoscopist-level performance on three independent datasets.