Artificial intelligence aided precise detection of local recurrence on MRI for nasopharyngeal carcinoma: a multicenter cohort studyResearch in context
Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed to find if artificial intelligence (AI) could be competent pre-inspector for MRI radiologists and whether AI-aided MRI could perform better...
Saved in:
Published in | EClinicalMedicine Vol. 63; p. 102202 |
---|---|
Main Authors | , , , , , , , , , , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
Elsevier
01.09.2023
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed to find if artificial intelligence (AI) could be competent pre-inspector for MRI radiologists and whether AI-aided MRI could perform better or even equal to PET/CT. Methods: This multicenter study enrolled 6916 patients from five hospitals between September 2009 and October 2020. A 2.5D convolutional neural network diagnostic model and a nnU-Net contouring model were developed in the training and test cohorts and used to independently predict and visualize the recurrence of patients in the internal and external validation cohorts. We evaluated the area under the ROC curve (AUC) of AI and compared AI with MRI and PET/CT in sensitivity and specificity using the McNemar test. The prospective cohort was randomized into the AI and non-AI groups, and their sensitivity and specificity were compared using the Chi-square test. Findings: The AI model achieved AUCs of 0.92 and 0.88 in the internal and external validation cohorts, corresponding to the sensitivity of 79.5% and 74.3% and specificity of 91.0% and 92.8%. It had comparable sensitivity to MRI (e.g., 74.3% vs. 74.7%, P = 0.89) but lower sensitivity than PET/CT (77.9% vs. 92.0%, P < 0.0001) at the same individual-specificities. The AI model achieved moderate precision with a median dice similarity coefficient of 0.67. AI-aided MRI improved specificity (92.5% vs. 85.0%, P = 0.034), equaled PET/CT in the internal validation subcohort, and increased sensitivity (81.9% vs. 70.8%, P = 0.021) in the external validation subcohort. In the prospective cohort of 1248 patients, the AI group had higher sensitivity than the non-AI group (78.6% vs. 67.3%, P = 0.23), albeit nonsignificant. In future randomized controlled trials, a sample size of 3943 patients in each arm would be required to demonstrate the statistically significant difference. Interpretation: The AI model equaled MRI by expert radiologists, and AI-aided MRI by expert radiologists equaled PET/CT. A larger randomized controlled trial is warranted to demonstrate the AI's benefit sufficiently. Funding: The Sun Yat-sen University Clinical Research 5010 Program (2015020), Guangdong Basic and Applied Basic Research Foundation (2022A1515110356), and Guangzhou Science and Technology Program (2023A04J1788). |
---|---|
AbstractList | Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed to find if artificial intelligence (AI) could be competent pre-inspector for MRI radiologists and whether AI-aided MRI could perform better or even equal to PET/CT. Methods: This multicenter study enrolled 6916 patients from five hospitals between September 2009 and October 2020. A 2.5D convolutional neural network diagnostic model and a nnU-Net contouring model were developed in the training and test cohorts and used to independently predict and visualize the recurrence of patients in the internal and external validation cohorts. We evaluated the area under the ROC curve (AUC) of AI and compared AI with MRI and PET/CT in sensitivity and specificity using the McNemar test. The prospective cohort was randomized into the AI and non-AI groups, and their sensitivity and specificity were compared using the Chi-square test. Findings: The AI model achieved AUCs of 0.92 and 0.88 in the internal and external validation cohorts, corresponding to the sensitivity of 79.5% and 74.3% and specificity of 91.0% and 92.8%. It had comparable sensitivity to MRI (e.g., 74.3% vs. 74.7%, P = 0.89) but lower sensitivity than PET/CT (77.9% vs. 92.0%, P < 0.0001) at the same individual-specificities. The AI model achieved moderate precision with a median dice similarity coefficient of 0.67. AI-aided MRI improved specificity (92.5% vs. 85.0%, P = 0.034), equaled PET/CT in the internal validation subcohort, and increased sensitivity (81.9% vs. 70.8%, P = 0.021) in the external validation subcohort. In the prospective cohort of 1248 patients, the AI group had higher sensitivity than the non-AI group (78.6% vs. 67.3%, P = 0.23), albeit nonsignificant. In future randomized controlled trials, a sample size of 3943 patients in each arm would be required to demonstrate the statistically significant difference. Interpretation: The AI model equaled MRI by expert radiologists, and AI-aided MRI by expert radiologists equaled PET/CT. A larger randomized controlled trial is warranted to demonstrate the AI's benefit sufficiently. Funding: The Sun Yat-sen University Clinical Research 5010 Program (2015020), Guangdong Basic and Applied Basic Research Foundation (2022A1515110356), and Guangzhou Science and Technology Program (2023A04J1788). |
Author | Wei Fan Chuan-Miao Xie Anwei Li Jiajian Li Yun He Xu Zhang Pu-Yun OuYang Yi-Shan Wu Jian-Gui Guo Wei-Jun Zhang Bao-Yu Zhang Zhi-Qiao Liu Zhi-Long Wang Ming-Yong Gao Jia-Ni Liu Fang-Yun Xie Shan-Shan Yang Ya-Nan Zhao |
Author_xml | – sequence: 1 fullname: Pu-Yun OuYang organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 2 fullname: Yun He organization: Department of Radiology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 3 fullname: Jian-Gui Guo organization: Department of Radiation Oncology, The First People's Hospital of Foshan, Foshan, China – sequence: 4 fullname: Jia-Ni Liu organization: Department of Head and Neck Oncology, The Cancer Center of the Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, China – sequence: 5 fullname: Zhi-Long Wang organization: Department of Radiology, Zhongshan City People's Hospital, Zhongshan, China – sequence: 6 fullname: Anwei Li organization: CVTE Research, Guangzhou, China – sequence: 7 fullname: Jiajian Li organization: CVTE Research, Guangzhou, China – sequence: 8 fullname: Shan-Shan Yang organization: Department of Radiation Oncology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China – sequence: 9 fullname: Xu Zhang organization: Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 10 fullname: Wei Fan organization: Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 11 fullname: Yi-Shan Wu organization: Department of Nasopharyngeal Carcinoma, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 12 fullname: Zhi-Qiao Liu organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 13 fullname: Bao-Yu Zhang organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 14 fullname: Ya-Nan Zhao organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 15 fullname: Ming-Yong Gao organization: Department of Radiology, The First People's Hospital of Foshan, Foshan, China – sequence: 16 fullname: Wei-Jun Zhang organization: Department of Radiation Oncology, Affiliated Cancer Hospital & Institute of Guangzhou Medical University, Guangzhou, China – sequence: 17 fullname: Chuan-Miao Xie organization: Department of Radiology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China – sequence: 18 fullname: Fang-Yun Xie organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China; Corresponding author. Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, No. 651 Dongfeng East Road, Guangzhou, 510060, China |
BookMark | eNqtj01KA0EQhRuJYNTcoS4QmH8n7kQUs3ATsh9qumtmKvR0he4eMBfxvDbBhQdwVcV7H_Xq3auVE0c3al3U7W5bl0_Z6s9-pzYhnLIsK7Kq3TXZWn2_-MgDa0YL7CJZyyM5TYBsyMDZk-ZAYCiSjiwOZAArOtHJWby_skn-POxhEA8Og5wn9Bc3UoI0es1OZnwGhHmxkTWlFA9aJvERQlzM5UCBEjelB5Ke7K_4qG4HtIE2v_NB7d_fjq8fWyN46s6e5xTRCXJ3FcSPHaYi2lLX54hY1U1Rtbqqc4N92fS5SXXbPi_7ovzPWz8fQXea |
ContentType | Journal Article |
DBID | DOA |
DatabaseName | DOAJ Directory of Open Access Journals |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: DOA name: Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine |
EISSN | 2589-5370 |
ExternalDocumentID | oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b2 |
GroupedDBID | .1- .FO 0R~ 0SF 53G 6I. AACTN AAEDW AALRI AAMRU AAXUO ABMAC ACLIJ ADBBV ADVLN AEXQZ AFRHN AFTJW AITUG AJUYK ALMA_UNASSIGNED_HOLDINGS AMRAJ AOIJS BCNDV EBS EJD FDB GROUPED_DOAJ HYE M41 NCXOZ OK1 ROL RPM SSZ Z5R |
ID | FETCH-doaj_primary_oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b23 |
IEDL.DBID | DOA |
ISSN | 2589-5370 |
IngestDate | Tue Oct 22 15:16:05 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-doaj_primary_oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b23 |
OpenAccessLink | https://doaj.org/article/b1aaa456248c451dab36b1d8968b13b2 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b2 |
PublicationCentury | 2000 |
PublicationDate | 2023-09-01 |
PublicationDateYYYYMMDD | 2023-09-01 |
PublicationDate_xml | – month: 09 year: 2023 text: 2023-09-01 day: 01 |
PublicationDecade | 2020 |
PublicationTitle | EClinicalMedicine |
PublicationYear | 2023 |
Publisher | Elsevier |
Publisher_xml | – name: Elsevier |
SSID | ssj0002048960 |
Score | 4.559508 |
Snippet | Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed... |
SourceID | doaj |
SourceType | Open Website |
StartPage | 102202 |
SubjectTerms | Artificial intelligence Diagnosis Magnetic resonance imaging Nasopharyngeal carcinoma Recurrence |
Title | Artificial intelligence aided precise detection of local recurrence on MRI for nasopharyngeal carcinoma: a multicenter cohort studyResearch in context |
URI | https://doaj.org/article/b1aaa456248c451dab36b1d8968b13b2 |
Volume | 63 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3LSsQwFA0yC3EjPvHNXbgtTvqYadypOMwIdSEKsys3L1EwHWpd-CN-r7lJhe5c6DYpTXopN-cmJ-cwdq7pgoyapoks1JQKFJsItCrhRoylMiKTge1e3U_mT_ndslgOrL6IExblgWPgLiRHRILpeanygmuU2URyXYpJKXkmY_Ydi0Ex9RqO13L_BG2wpEUpkiIjM-KBKH9YPWZbbLOHfXAVh9tma8btsPWqP9jeZV_UE8Uc4GWgkgmk4KhhRRoU7wa06QJ1ykFjISxD0NKGebiyB765eliAh6HgkOwJsP10zx4JgiLHINe84SUgBA4hkTJNC-SP23YQRGZ_SHh-AkAMdp-299hidvt4M0_om-pVVKaoSSs6NPgI1n0E698imO2zkWucOWCQCluiVgJ57sukAqVBy9GoMtfcpyN7yK7_Pt7Rf7zkmG2Q8Xtke52wUdd-mFMPDzp5Fv6Eb1iiw4o |
link.rule.ids | 315,783,787,2109 |
linkProvider | Directory of Open Access Journals |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Artificial+intelligence+aided+precise+detection+of+local+recurrence+on+MRI+for+nasopharyngeal+carcinoma%3A+a+multicenter+cohort+studyResearch+in+context&rft.jtitle=EClinicalMedicine&rft.au=Pu-Yun+OuYang&rft.au=Yun+He&rft.au=Jian-Gui+Guo&rft.au=Jia-Ni+Liu&rft.date=2023-09-01&rft.pub=Elsevier&rft.issn=2589-5370&rft.eissn=2589-5370&rft.volume=63&rft.spage=102202&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b2 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2589-5370&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2589-5370&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2589-5370&client=summon |