Artificial intelligence aided precise detection of local recurrence on MRI for nasopharyngeal carcinoma: a multicenter cohort studyResearch in context

Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed to find if artificial intelligence (AI) could be competent pre-inspector for MRI radiologists and whether AI-aided MRI could perform better...

Full description

Saved in:
Bibliographic Details
Published inEClinicalMedicine Vol. 63; p. 102202
Main Authors Pu-Yun OuYang, Yun He, Jian-Gui Guo, Jia-Ni Liu, Zhi-Long Wang, Anwei Li, Jiajian Li, Shan-Shan Yang, Xu Zhang, Wei Fan, Yi-Shan Wu, Zhi-Qiao Liu, Bao-Yu Zhang, Ya-Nan Zhao, Ming-Yong Gao, Wei-Jun Zhang, Chuan-Miao Xie, Fang-Yun Xie
Format Journal Article
LanguageEnglish
Published Elsevier 01.09.2023
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed to find if artificial intelligence (AI) could be competent pre-inspector for MRI radiologists and whether AI-aided MRI could perform better or even equal to PET/CT. Methods: This multicenter study enrolled 6916 patients from five hospitals between September 2009 and October 2020. A 2.5D convolutional neural network diagnostic model and a nnU-Net contouring model were developed in the training and test cohorts and used to independently predict and visualize the recurrence of patients in the internal and external validation cohorts. We evaluated the area under the ROC curve (AUC) of AI and compared AI with MRI and PET/CT in sensitivity and specificity using the McNemar test. The prospective cohort was randomized into the AI and non-AI groups, and their sensitivity and specificity were compared using the Chi-square test. Findings: The AI model achieved AUCs of 0.92 and 0.88 in the internal and external validation cohorts, corresponding to the sensitivity of 79.5% and 74.3% and specificity of 91.0% and 92.8%. It had comparable sensitivity to MRI (e.g., 74.3% vs. 74.7%, P = 0.89) but lower sensitivity than PET/CT (77.9% vs. 92.0%, P < 0.0001) at the same individual-specificities. The AI model achieved moderate precision with a median dice similarity coefficient of 0.67. AI-aided MRI improved specificity (92.5% vs. 85.0%, P = 0.034), equaled PET/CT in the internal validation subcohort, and increased sensitivity (81.9% vs. 70.8%, P = 0.021) in the external validation subcohort. In the prospective cohort of 1248 patients, the AI group had higher sensitivity than the non-AI group (78.6% vs. 67.3%, P = 0.23), albeit nonsignificant. In future randomized controlled trials, a sample size of 3943 patients in each arm would be required to demonstrate the statistically significant difference. Interpretation: The AI model equaled MRI by expert radiologists, and AI-aided MRI by expert radiologists equaled PET/CT. A larger randomized controlled trial is warranted to demonstrate the AI's benefit sufficiently. Funding: The Sun Yat-sen University Clinical Research 5010 Program (2015020), Guangdong Basic and Applied Basic Research Foundation (2022A1515110356), and Guangzhou Science and Technology Program (2023A04J1788).
AbstractList Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed to find if artificial intelligence (AI) could be competent pre-inspector for MRI radiologists and whether AI-aided MRI could perform better or even equal to PET/CT. Methods: This multicenter study enrolled 6916 patients from five hospitals between September 2009 and October 2020. A 2.5D convolutional neural network diagnostic model and a nnU-Net contouring model were developed in the training and test cohorts and used to independently predict and visualize the recurrence of patients in the internal and external validation cohorts. We evaluated the area under the ROC curve (AUC) of AI and compared AI with MRI and PET/CT in sensitivity and specificity using the McNemar test. The prospective cohort was randomized into the AI and non-AI groups, and their sensitivity and specificity were compared using the Chi-square test. Findings: The AI model achieved AUCs of 0.92 and 0.88 in the internal and external validation cohorts, corresponding to the sensitivity of 79.5% and 74.3% and specificity of 91.0% and 92.8%. It had comparable sensitivity to MRI (e.g., 74.3% vs. 74.7%, P = 0.89) but lower sensitivity than PET/CT (77.9% vs. 92.0%, P < 0.0001) at the same individual-specificities. The AI model achieved moderate precision with a median dice similarity coefficient of 0.67. AI-aided MRI improved specificity (92.5% vs. 85.0%, P = 0.034), equaled PET/CT in the internal validation subcohort, and increased sensitivity (81.9% vs. 70.8%, P = 0.021) in the external validation subcohort. In the prospective cohort of 1248 patients, the AI group had higher sensitivity than the non-AI group (78.6% vs. 67.3%, P = 0.23), albeit nonsignificant. In future randomized controlled trials, a sample size of 3943 patients in each arm would be required to demonstrate the statistically significant difference. Interpretation: The AI model equaled MRI by expert radiologists, and AI-aided MRI by expert radiologists equaled PET/CT. A larger randomized controlled trial is warranted to demonstrate the AI's benefit sufficiently. Funding: The Sun Yat-sen University Clinical Research 5010 Program (2015020), Guangdong Basic and Applied Basic Research Foundation (2022A1515110356), and Guangzhou Science and Technology Program (2023A04J1788).
Author Wei Fan
Chuan-Miao Xie
Anwei Li
Jiajian Li
Yun He
Xu Zhang
Pu-Yun OuYang
Yi-Shan Wu
Jian-Gui Guo
Wei-Jun Zhang
Bao-Yu Zhang
Zhi-Qiao Liu
Zhi-Long Wang
Ming-Yong Gao
Jia-Ni Liu
Fang-Yun Xie
Shan-Shan Yang
Ya-Nan Zhao
Author_xml – sequence: 1
  fullname: Pu-Yun OuYang
  organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 2
  fullname: Yun He
  organization: Department of Radiology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 3
  fullname: Jian-Gui Guo
  organization: Department of Radiation Oncology, The First People's Hospital of Foshan, Foshan, China
– sequence: 4
  fullname: Jia-Ni Liu
  organization: Department of Head and Neck Oncology, The Cancer Center of the Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, China
– sequence: 5
  fullname: Zhi-Long Wang
  organization: Department of Radiology, Zhongshan City People's Hospital, Zhongshan, China
– sequence: 6
  fullname: Anwei Li
  organization: CVTE Research, Guangzhou, China
– sequence: 7
  fullname: Jiajian Li
  organization: CVTE Research, Guangzhou, China
– sequence: 8
  fullname: Shan-Shan Yang
  organization: Department of Radiation Oncology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
– sequence: 9
  fullname: Xu Zhang
  organization: Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 10
  fullname: Wei Fan
  organization: Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 11
  fullname: Yi-Shan Wu
  organization: Department of Nasopharyngeal Carcinoma, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 12
  fullname: Zhi-Qiao Liu
  organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 13
  fullname: Bao-Yu Zhang
  organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 14
  fullname: Ya-Nan Zhao
  organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 15
  fullname: Ming-Yong Gao
  organization: Department of Radiology, The First People's Hospital of Foshan, Foshan, China
– sequence: 16
  fullname: Wei-Jun Zhang
  organization: Department of Radiation Oncology, Affiliated Cancer Hospital & Institute of Guangzhou Medical University, Guangzhou, China
– sequence: 17
  fullname: Chuan-Miao Xie
  organization: Department of Radiology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China
– sequence: 18
  fullname: Fang-Yun Xie
  organization: Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, China; Corresponding author. Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, No. 651 Dongfeng East Road, Guangzhou, 510060, China
BookMark eNqtj01KA0EQhRuJYNTcoS4QmH8n7kQUs3ATsh9qumtmKvR0he4eMBfxvDbBhQdwVcV7H_Xq3auVE0c3al3U7W5bl0_Z6s9-pzYhnLIsK7Kq3TXZWn2_-MgDa0YL7CJZyyM5TYBsyMDZk-ZAYCiSjiwOZAArOtHJWby_skn-POxhEA8Og5wn9Bc3UoI0es1OZnwGhHmxkTWlFA9aJvERQlzM5UCBEjelB5Ke7K_4qG4HtIE2v_NB7d_fjq8fWyN46s6e5xTRCXJ3FcSPHaYi2lLX54hY1U1Rtbqqc4N92fS5SXXbPi_7ovzPWz8fQXea
ContentType Journal Article
DBID DOA
DatabaseName DOAJ Directory of Open Access Journals
DatabaseTitleList
Database_xml – sequence: 1
  dbid: DOA
  name: Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
EISSN 2589-5370
ExternalDocumentID oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b2
GroupedDBID .1-
.FO
0R~
0SF
53G
6I.
AACTN
AAEDW
AALRI
AAMRU
AAXUO
ABMAC
ACLIJ
ADBBV
ADVLN
AEXQZ
AFRHN
AFTJW
AITUG
AJUYK
ALMA_UNASSIGNED_HOLDINGS
AMRAJ
AOIJS
BCNDV
EBS
EJD
FDB
GROUPED_DOAJ
HYE
M41
NCXOZ
OK1
ROL
RPM
SSZ
Z5R
ID FETCH-doaj_primary_oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b23
IEDL.DBID DOA
ISSN 2589-5370
IngestDate Tue Oct 22 15:16:05 EDT 2024
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-doaj_primary_oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b23
OpenAccessLink https://doaj.org/article/b1aaa456248c451dab36b1d8968b13b2
ParticipantIDs doaj_primary_oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b2
PublicationCentury 2000
PublicationDate 2023-09-01
PublicationDateYYYYMMDD 2023-09-01
PublicationDate_xml – month: 09
  year: 2023
  text: 2023-09-01
  day: 01
PublicationDecade 2020
PublicationTitle EClinicalMedicine
PublicationYear 2023
Publisher Elsevier
Publisher_xml – name: Elsevier
SSID ssj0002048960
Score 4.559508
Snippet Background: MRI is the routine examination to surveil the recurrence of nasopharyngeal carcinoma, but it has relatively lower sensitivity than PET/CT. We aimed...
SourceID doaj
SourceType Open Website
StartPage 102202
SubjectTerms Artificial intelligence
Diagnosis
Magnetic resonance imaging
Nasopharyngeal carcinoma
Recurrence
Title Artificial intelligence aided precise detection of local recurrence on MRI for nasopharyngeal carcinoma: a multicenter cohort studyResearch in context
URI https://doaj.org/article/b1aaa456248c451dab36b1d8968b13b2
Volume 63
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3LSsQwFA0yC3EjPvHNXbgtTvqYadypOMwIdSEKsys3L1EwHWpd-CN-r7lJhe5c6DYpTXopN-cmJ-cwdq7pgoyapoks1JQKFJsItCrhRoylMiKTge1e3U_mT_ndslgOrL6IExblgWPgLiRHRILpeanygmuU2URyXYpJKXkmY_Ydi0Ex9RqO13L_BG2wpEUpkiIjM-KBKH9YPWZbbLOHfXAVh9tma8btsPWqP9jeZV_UE8Uc4GWgkgmk4KhhRRoU7wa06QJ1ykFjISxD0NKGebiyB765eliAh6HgkOwJsP10zx4JgiLHINe84SUgBA4hkTJNC-SP23YQRGZ_SHh-AkAMdp-299hidvt4M0_om-pVVKaoSSs6NPgI1n0E698imO2zkWucOWCQCluiVgJ57sukAqVBy9GoMtfcpyN7yK7_Pt7Rf7zkmG2Q8Xtke52wUdd-mFMPDzp5Fv6Eb1iiw4o
link.rule.ids 315,783,787,2109
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Artificial+intelligence+aided+precise+detection+of+local+recurrence+on+MRI+for+nasopharyngeal+carcinoma%3A+a+multicenter+cohort+studyResearch+in+context&rft.jtitle=EClinicalMedicine&rft.au=Pu-Yun+OuYang&rft.au=Yun+He&rft.au=Jian-Gui+Guo&rft.au=Jia-Ni+Liu&rft.date=2023-09-01&rft.pub=Elsevier&rft.issn=2589-5370&rft.eissn=2589-5370&rft.volume=63&rft.spage=102202&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_b1aaa456248c451dab36b1d8968b13b2
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2589-5370&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2589-5370&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2589-5370&client=summon