The impact of artificial intelligence on the reading times of radiologists for chest radiographs
Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the d...
Saved in:
Published in | NPJ digital medicine Vol. 6; no. 1; pp. 82 - 8 |
---|---|
Main Authors | , , , |
Format | Journal Article |
Language | English |
Published |
London
Nature Publishing Group UK
29.04.2023
Nature Publishing Group Nature Portfolio |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s,
p
< 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s,
p
< 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s,
p
= 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06,
p
< 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times. |
---|---|
AbstractList | Abstract Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s, p < 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s, p < 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s, p = 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, p < 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times. Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s, p < 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s, p < 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s, p = 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, p < 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times. Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists' workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s, p < 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s, p < 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s, p = 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, p < 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times.Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists' workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s, p < 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s, p < 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s, p = 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, p < 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times. Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3 s vs. 14.8 s, p < 0.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8 s vs. 13.1 s, p < 0.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6 s vs. 18.4 s, p = 0.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, p < 0.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times. |
ArticleNumber | 82 |
Author | Han, Kyunghwa Ryu, Leeha Kim, Eun-Kyung Shin, Hyun Joo |
Author_xml | – sequence: 1 givenname: Hyun Joo orcidid: 0000-0002-7462-2609 surname: Shin fullname: Shin, Hyun Joo organization: Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu – sequence: 2 givenname: Kyunghwa surname: Han fullname: Han, Kyunghwa organization: Department of Radiology, Severance Hospital, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine – sequence: 3 givenname: Leeha surname: Ryu fullname: Ryu, Leeha organization: Department of Biostatistics and Computing, Yonsei University Graduate School – sequence: 4 givenname: Eun-Kyung orcidid: 0000-0002-3368-5013 surname: Kim fullname: Kim, Eun-Kyung email: ekkim@yuhs.ac organization: Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, Center for Digital Health, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/37120423$$D View this record in MEDLINE/PubMed |
BookMark | eNp9kk1v3CAQhlGVqkmT_IEeKku99OKGLwM-VVXUj0iRcknPhMWDl5UNW2Ar9d-XXadpkkO4wMDzvgzDvEVHIQZA6B3Bnwhm6iJzIrloMWUtxor2LX-FTijrVStYR48erY_Rec4bjDHFXPVcvEHHTJIaUHaC7m7X0Ph5a2xpomtMKt55683U-FBgmvwIwUITQ1MqmMAMPoxN8TPkPZ9qHKc4-lxy42Jq7BpyWbbHZLbrfIZeOzNlOL-fT9HPb19vL3-01zffry6_XLe246S0DgTtuONOcOx6YDAQBQyTfpDAjLJEKGGs5FIOTlI3ACcdZhYMGMwNtuwUXS2-QzQbvU1-NumPjsbrw0ZMo94_zk6gneS9kFW24sBXalDckTokpbR3lsjq9Xnx2u5WMwwWQklmemL69CT4tR7jb00w4Up1pDp8vHdI8deulkTPPttaTxMg7rKmCsueyF7Rin54hm7iLoVaqwPVifplolLvH6f0kMu_n6wAXQCbYs4J3ANCsN53jF46RteO0YeO0byK1DOR9cUUH_fP8tPLUrZIc70njJD-p_2C6i-IYNUQ |
CitedBy_id | crossref_primary_10_1038_s41746_024_01328_w crossref_primary_10_1038_s41598_024_70780_1 crossref_primary_10_1177_08465371251320938 crossref_primary_10_46475_asean_jr_v24i3_881 crossref_primary_10_3389_fmed_2024_1449537 crossref_primary_10_3390_jcm12247730 crossref_primary_10_1007_s00330_024_10676_w crossref_primary_10_20517_ais_2024_49 crossref_primary_10_3174_ajnr_A8422 crossref_primary_10_3390_diagnostics13122090 crossref_primary_10_3390_jpm14020164 crossref_primary_10_1001_jamanetworkopen_2024_48714 crossref_primary_10_1186_s41747_023_00386_1 crossref_primary_10_2214_AJR_23_30696 crossref_primary_10_1109_TMI_2024_3381123 crossref_primary_10_1016_j_ebiom_2024_105463 crossref_primary_10_1186_s13244_023_01525_3 crossref_primary_10_2214_AJR_24_31898 crossref_primary_10_3174_ajnr_A8141 crossref_primary_10_1038_s41598_024_65488_1 crossref_primary_10_3348_kjr_2025_0071 crossref_primary_10_3389_fmed_2025_1514931 crossref_primary_10_1016_j_ejrad_2023_111252 crossref_primary_10_1007_s00481_023_00789_z crossref_primary_10_1097_JS9_0000000000002187 crossref_primary_10_1038_s41598_024_82775_z crossref_primary_10_2196_53297 crossref_primary_10_1148_radiol_240272 crossref_primary_10_1148_radiol_240650 crossref_primary_10_4103_jcsr_jcsr_53_24 crossref_primary_10_1371_journal_pone_0316732 crossref_primary_10_1002_jeo2_12025 crossref_primary_10_1186_s13244_024_01660_5 crossref_primary_10_1016_j_jmir_2024_101710 crossref_primary_10_1007_s10278_024_01323_3 crossref_primary_10_1007_s00134_024_07725_9 crossref_primary_10_1016_j_jstrokecerebrovasdis_2024_108014 crossref_primary_10_1186_s44263_023_00033_2 crossref_primary_10_3390_diagnostics13122060 crossref_primary_10_1148_radiol_250339 crossref_primary_10_2106_JBJS_RVW_24_00106 crossref_primary_10_1136_bmjhci_2024_101091 crossref_primary_10_1148_radiol_230860 |
Cites_doi | 10.3349/ymj.2020.61.8.647 10.3348/kjr.2021.0476 10.1148/radiol.2020201240 10.21147/j.issn.1000-9604.2021.06.05 10.1038/s41598-022-14519-w 10.1371/journal.pone.0282123 10.1148/ryai.2020200024 10.3348/kjr.2019.0821 10.1148/radiol.212631 10.1148/radiol.2021202818 10.3348/kjr.2021.0544 10.1183/13993003.03061-2020 10.1259/bjr.20200870 10.1007/s00234-020-02566-x 10.1038/s41746-020-00324-0 10.1148/radiol.2018171820 10.1016/j.acra.2021.10.008 10.1371/journal.pone.0264383 10.1148/radiol.210937 10.1148/radiol.2018180237 10.1371/journal.pone.0281690 10.1007/s00330-021-08397-5 10.1007/s12282-022-01375-9 10.1016/j.diii.2022.06.004 10.1007/s00247-021-05114-8 10.3348/kjr.2022.0193 |
ContentType | Journal Article |
Copyright | The Author(s) 2023 2023. The Author(s). The Author(s) 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
Copyright_xml | – notice: The Author(s) 2023 – notice: 2023. The Author(s). – notice: The Author(s) 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
DBID | C6C AAYXX CITATION NPM 3V. 7RV 7X7 7XB 8FI 8FJ 8FK ABUWG AFKRA AZQEC BENPR CCPQU DWQXO FYUFA GHDGH K9. KB0 M0S NAPCQ PHGZM PHGZT PIMPY PKEHL PPXIY PQEST PQQKQ PQUKI PRINS 7X8 5PM DOA |
DOI | 10.1038/s41746-023-00829-4 |
DatabaseName | Springer Nature OA Free Journals CrossRef PubMed ProQuest Central (Corporate) Nursing & Allied Health Database Health & Medical Collection ProQuest Central (purchase pre-March 2016) Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials ProQuest Central ProQuest One ProQuest Central Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Health & Medical Complete (Alumni) Nursing & Allied Health Database (Alumni Edition) Health & Medical Collection (Alumni) Nursing & Allied Health Premium ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals |
DatabaseTitle | CrossRef PubMed Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing ProQuest Central China ProQuest Central Health Research Premium Collection Health and Medicine Complete (Alumni Edition) ProQuest Central Korea ProQuest Central (New) ProQuest One Academic Eastern Edition ProQuest Nursing & Allied Health Source ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Hospital Collection (Alumni) Nursing & Allied Health Premium ProQuest Health & Medical Complete ProQuest One Academic UKI Edition ProQuest Nursing & Allied Health Source (Alumni) ProQuest One Academic ProQuest One Academic (New) ProQuest Central (Alumni) MEDLINE - Academic |
DatabaseTitleList | MEDLINE - Academic Publicly Available Content Database CrossRef PubMed |
Database_xml | – sequence: 1 dbid: C6C name: SpringerOpen Free (Free internet resource, activated by CARLI) url: http://www.springeropen.com/ sourceTypes: Publisher – sequence: 2 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 3 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 4 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine |
EISSN | 2398-6352 |
EndPage | 8 |
ExternalDocumentID | oai_doaj_org_article_f7496704ab4e4b8d84f111172229fc17 PMC10148851 37120423 10_1038_s41746_023_00829_4 |
Genre | Journal Article |
GrantInformation_xml | – fundername: This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI22C1580). – fundername: Korea Health Industry Development Institute (KHIDI) grantid: HI22C1580 funderid: https://doi.org/10.13039/501100003710 – fundername: Korea Health Industry Development Institute (KHIDI) grantid: HI22C1580 – fundername: ; – fundername: ; grantid: HI22C1580 |
GroupedDBID | 0R~ 53G 7RV 7X7 8FI 8FJ AAJSJ ABUWG ACGFS ACSMW ADBBV AFKRA AJTQC ALIPV ALMA_UNASSIGNED_HOLDINGS AOIJS BCNDV BENPR C6C CCPQU EBLON EBS EIHBH FYUFA GROUPED_DOAJ HMCUK HYE M~E NAO NAPCQ NO~ OK1 PGMZT PIMPY RNT RPM SNYQT UKHRP AASML AAYXX CITATION PHGZM PHGZT NPM 3V. 7XB 8FK AZQEC DWQXO K9. PKEHL PPXIY PQEST PQQKQ PQUKI PRINS 7X8 5PM PUEGO |
ID | FETCH-LOGICAL-c541t-fe6254f4f640f9e3ed18e3019d7e3a8c1686ac7477df72fde41503ceaea04a0c3 |
IEDL.DBID | 7X7 |
ISSN | 2398-6352 |
IngestDate | Wed Aug 27 01:27:18 EDT 2025 Thu Aug 21 18:36:57 EDT 2025 Thu Jul 10 23:04:18 EDT 2025 Fri Jul 25 07:44:15 EDT 2025 Thu Jan 02 22:52:50 EST 2025 Thu Apr 24 22:51:40 EDT 2025 Tue Jul 01 00:56:00 EDT 2025 Fri Feb 21 02:39:49 EST 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 1 |
Language | English |
License | 2023. The Author(s). Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c541t-fe6254f4f640f9e3ed18e3019d7e3a8c1686ac7477df72fde41503ceaea04a0c3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 |
ORCID | 0000-0002-3368-5013 0000-0002-7462-2609 |
OpenAccessLink | https://www.proquest.com/docview/2807569466?pq-origsite=%requestingapplication% |
PMID | 37120423 |
PQID | 2807569466 |
PQPubID | 5061815 |
PageCount | 8 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_f7496704ab4e4b8d84f111172229fc17 pubmedcentral_primary_oai_pubmedcentral_nih_gov_10148851 proquest_miscellaneous_2807917982 proquest_journals_2807569466 pubmed_primary_37120423 crossref_primary_10_1038_s41746_023_00829_4 crossref_citationtrail_10_1038_s41746_023_00829_4 springer_journals_10_1038_s41746_023_00829_4 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2023-04-29 |
PublicationDateYYYYMMDD | 2023-04-29 |
PublicationDate_xml | – month: 04 year: 2023 text: 2023-04-29 day: 29 |
PublicationDecade | 2020 |
PublicationPlace | London |
PublicationPlace_xml | – name: London – name: England |
PublicationTitle | NPJ digital medicine |
PublicationTitleAbbrev | npj Digit. Med |
PublicationTitleAlternate | NPJ Digit Med |
PublicationYear | 2023 |
Publisher | Nature Publishing Group UK Nature Publishing Group Nature Portfolio |
Publisher_xml | – name: Nature Publishing Group UK – name: Nature Publishing Group – name: Nature Portfolio |
References | Guermazi (CR9) 2022; 302 Lee (CR8) 2022; 23 Hwang, Park (CR14) 2020; 21 Benjamens, Dhunnoo, Meskó (CR3) 2020; 3 Hwang (CR1) 2021; 22 Kim (CR27) 2020; 61 Pacilè (CR18) 2020; 2 Zhang (CR10) 2021; 94 CR16 CR15 O’Neill (CR6) 2021; 3 Müller (CR13) 2022; 29 Sung (CR11) 2021; 299 CR2 Choy (CR5) 2018; 288 Lee (CR24) 2020; 297 Shin (CR21) 2023; 18 Nam (CR23) 2019; 290 Kim (CR12) 2022; 17 Sun (CR17) 2021; 33 Nam (CR22) 2021; 57 CR25 Alexander (CR4) 2022; 304 Watanabe (CR7) 2021; 63 Shin, Son, Kim, Kim (CR19) 2022; 12 CR20 Kwak (CR26) 2023; 18 S Pacilè (829_CR18) 2020; 2 HJ Shin (829_CR19) 2022; 12 Y Sun (829_CR17) 2021; 33 G Choy (829_CR5) 2018; 288 R Alexander (829_CR4) 2022; 304 EJ Hwang (829_CR1) 2021; 22 S Benjamens (829_CR3) 2020; 3 829_CR15 829_CR16 SH Kwak (829_CR26) 2023; 18 JG Nam (829_CR23) 2019; 290 HJ Shin (829_CR21) 2023; 18 A Guermazi (829_CR9) 2022; 302 829_CR2 TJ O’Neill (829_CR6) 2021; 3 EY Kim (829_CR12) 2022; 17 EJ Hwang (829_CR14) 2020; 21 FC Müller (829_CR13) 2022; 29 JG Nam (829_CR22) 2021; 57 829_CR25 JH Lee (829_CR24) 2020; 297 SJ Kim (829_CR27) 2020; 61 JH Lee (829_CR8) 2022; 23 829_CR20 B Zhang (829_CR10) 2021; 94 Y Watanabe (829_CR7) 2021; 63 J Sung (829_CR11) 2021; 299 |
References_xml | – volume: 61 start-page: 647 year: 2020 end-page: 651 ident: CR27 article-title: Current state and strategy for establishing a digitally innovative hospital: memorial review article for opening of Yongin Severance Hospital publication-title: Yonsei Med. J. doi: 10.3349/ymj.2020.61.8.647 – volume: 23 start-page: 505 year: 2022 end-page: 516 ident: CR8 article-title: Improving the performance of radiologists using artificial intelligence-based detection support software for mammography: a multi-reader study publication-title: Korean J. Radiol. doi: 10.3348/kjr.2021.0476 – volume: 297 start-page: 687 year: 2020 end-page: 696 ident: CR24 article-title: Performance of a deep learning algorithm compared with radiologic interpretation for lung cancer detection on chest radiographs in a health screening population publication-title: Radiology doi: 10.1148/radiol.2020201240 – ident: CR2 – ident: CR16 – volume: 33 start-page: 682 year: 2021 end-page: 693 ident: CR17 article-title: Deep learning model improves radiologists’ performance in detection and classification of breast lesions publication-title: Chin. J. Cancer Res. doi: 10.21147/j.issn.1000-9604.2021.06.05 – volume: 12 year: 2022 ident: CR19 article-title: Diagnostic performance of artificial intelligence approved for adults for the interpretation of pediatric chest radiographs publication-title: Sci. Rep. doi: 10.1038/s41598-022-14519-w – volume: 18 start-page: e0282123 year: 2023 ident: CR21 article-title: Hospital-wide survey of clinical experience with artificial intelligence applied to daily chest radiographs publication-title: PloS ONE doi: 10.1371/journal.pone.0282123 – volume: 3 start-page: e200024 year: 2021 ident: CR6 article-title: Active reprioritization of the reading worklist using artificial intelligence has a beneficial effect on the turnaround time for interpretation of head CT with intracranial hemorrhage publication-title: Radio. Artif. Intell. doi: 10.1148/ryai.2020200024 – volume: 21 start-page: 511 year: 2020 end-page: 525 ident: CR14 article-title: Clinical implementation of deep learning in thoracic radiology: potential applications and challenges publication-title: Korean J. Radiol. doi: 10.3348/kjr.2019.0821 – volume: 304 start-page: 274 year: 2022 end-page: 282 ident: CR4 article-title: Mandating limits on workload, duty, and speed in radiology publication-title: Radiology doi: 10.1148/radiol.212631 – ident: CR25 – volume: 299 start-page: 450 year: 2021 end-page: 459 ident: CR11 article-title: Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study publication-title: Radiology doi: 10.1148/radiol.2021202818 – volume: 22 start-page: 1743 year: 2021 end-page: 1748 ident: CR1 article-title: Use of artificial intelligence-based software as medical devices for chest radiography: a position paper from the Korean Society of Thoracic Radiology publication-title: Korean J. Radiol. doi: 10.3348/kjr.2021.0544 – volume: 57 start-page: 2003061 year: 2021 ident: CR22 article-title: Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs publication-title: Eur. Respir. J. doi: 10.1183/13993003.03061-2020 – volume: 94 start-page: 20200870 year: 2021 ident: CR10 article-title: Improving rib fracture detection accuracy and reading efficiency with deep learning-based detection software: a clinical evaluation publication-title: Br. J. Radiol. doi: 10.1259/bjr.20200870 – volume: 63 start-page: 713 year: 2021 end-page: 720 ident: CR7 article-title: Improvement of the diagnostic accuracy for intracranial haemorrhage using deep learning-based computer-assisted detection publication-title: Neuroradiology doi: 10.1007/s00234-020-02566-x – volume: 3 year: 2020 ident: CR3 article-title: The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database publication-title: NPJ Digit. Med. doi: 10.1038/s41746-020-00324-0 – volume: 288 start-page: 318 year: 2018 end-page: 328 ident: CR5 article-title: Current applications and future impact of machine learning in radiology publication-title: Radiology doi: 10.1148/radiol.2018171820 – ident: CR15 – volume: 29 start-page: 1085 year: 2022 end-page: 1090 ident: CR13 article-title: Impact of concurrent use of artificial intelligence tools on radiologists reading time: a prospective feasibility study publication-title: Acad. Radiol. doi: 10.1016/j.acra.2021.10.008 – volume: 17 start-page: e0264383 year: 2022 ident: CR12 article-title: Concordance rate of radiologists and a commercialized deep-learning solution for chest X-ray: Real-world experience with a multicenter health screening cohort publication-title: PloS ONE doi: 10.1371/journal.pone.0264383 – volume: 302 start-page: 627 year: 2022 end-page: 636 ident: CR9 article-title: Improving radiographic fracture recognition performance and efficiency using artificial intelligence publication-title: Radiology doi: 10.1148/radiol.210937 – volume: 2 start-page: e190208 year: 2020 ident: CR18 article-title: Improving breast cancer detection accuracy of mammography with the concurrent use of an artificial intelligence tool publication-title: Radiology – volume: 290 start-page: 218 year: 2019 end-page: 228 ident: CR23 article-title: Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs publication-title: Radiology doi: 10.1148/radiol.2018180237 – volume: 18 start-page: e0281690 year: 2023 ident: CR26 article-title: Incidentally found resectable lung cancer with the usage of artificial intelligence on chest radiographs publication-title: PloS ONE doi: 10.1371/journal.pone.0281690 – ident: CR20 – volume: 18 start-page: e0281690 year: 2023 ident: 829_CR26 publication-title: PloS ONE doi: 10.1371/journal.pone.0281690 – ident: 829_CR25 doi: 10.1007/s00330-021-08397-5 – volume: 17 start-page: e0264383 year: 2022 ident: 829_CR12 publication-title: PloS ONE doi: 10.1371/journal.pone.0264383 – volume: 22 start-page: 1743 year: 2021 ident: 829_CR1 publication-title: Korean J. Radiol. doi: 10.3348/kjr.2021.0544 – volume: 288 start-page: 318 year: 2018 ident: 829_CR5 publication-title: Radiology doi: 10.1148/radiol.2018171820 – volume: 18 start-page: e0282123 year: 2023 ident: 829_CR21 publication-title: PloS ONE doi: 10.1371/journal.pone.0282123 – ident: 829_CR16 doi: 10.1007/s12282-022-01375-9 – volume: 3 year: 2020 ident: 829_CR3 publication-title: NPJ Digit. Med. doi: 10.1038/s41746-020-00324-0 – volume: 304 start-page: 274 year: 2022 ident: 829_CR4 publication-title: Radiology doi: 10.1148/radiol.212631 – volume: 57 start-page: 2003061 year: 2021 ident: 829_CR22 publication-title: Eur. Respir. J. doi: 10.1183/13993003.03061-2020 – ident: 829_CR15 doi: 10.1016/j.diii.2022.06.004 – volume: 12 year: 2022 ident: 829_CR19 publication-title: Sci. Rep. doi: 10.1038/s41598-022-14519-w – volume: 63 start-page: 713 year: 2021 ident: 829_CR7 publication-title: Neuroradiology doi: 10.1007/s00234-020-02566-x – volume: 29 start-page: 1085 year: 2022 ident: 829_CR13 publication-title: Acad. Radiol. doi: 10.1016/j.acra.2021.10.008 – volume: 94 start-page: 20200870 year: 2021 ident: 829_CR10 publication-title: Br. J. Radiol. doi: 10.1259/bjr.20200870 – volume: 3 start-page: e200024 year: 2021 ident: 829_CR6 publication-title: Radio. Artif. Intell. doi: 10.1148/ryai.2020200024 – volume: 61 start-page: 647 year: 2020 ident: 829_CR27 publication-title: Yonsei Med. J. doi: 10.3349/ymj.2020.61.8.647 – volume: 23 start-page: 505 year: 2022 ident: 829_CR8 publication-title: Korean J. Radiol. doi: 10.3348/kjr.2021.0476 – ident: 829_CR2 doi: 10.1007/s00247-021-05114-8 – volume: 2 start-page: e190208 year: 2020 ident: 829_CR18 publication-title: Radiology – volume: 297 start-page: 687 year: 2020 ident: 829_CR24 publication-title: Radiology doi: 10.1148/radiol.2020201240 – ident: 829_CR20 doi: 10.3348/kjr.2022.0193 – volume: 299 start-page: 450 year: 2021 ident: 829_CR11 publication-title: Radiology doi: 10.1148/radiol.2021202818 – volume: 302 start-page: 627 year: 2022 ident: 829_CR9 publication-title: Radiology doi: 10.1148/radiol.210937 – volume: 33 start-page: 682 year: 2021 ident: 829_CR17 publication-title: Chin. J. Cancer Res. doi: 10.21147/j.issn.1000-9604.2021.06.05 – volume: 290 start-page: 218 year: 2019 ident: 829_CR23 publication-title: Radiology doi: 10.1148/radiol.2018180237 – volume: 21 start-page: 511 year: 2020 ident: 829_CR14 publication-title: Korean J. Radiol. doi: 10.3348/kjr.2019.0821 |
SSID | ssj0002048946 |
Score | 2.465543 |
Snippet | Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload is of... Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists' workload is of... Abstract Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists’ workload... |
SourceID | doaj pubmedcentral proquest pubmed crossref springer |
SourceType | Open Website Open Access Repository Aggregation Database Index Database Enrichment Source Publisher |
StartPage | 82 |
SubjectTerms | 692/308/409 692/700/1421/1770 Artificial intelligence Biomedicine Biotechnology Digital technology Medical diagnosis Medicine Medicine & Public Health Radiology Reading Thorax Workloads |
SummonAdditionalLinks | – databaseName: DOAJ Directory of Open Access Journals dbid: DOA link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Lb9QwELZQDxUXxJtAqYzEDazG9jhxjm3VqkIqJyr1ZhxnLIpQUu1u_z9jO7vs8rxwjD2W7HnI48zMN4y9RayNUb0SUXolADSKXg2NUKgSPFzrbUz_Oy4_NhdX8OHaXG-1-ko5YQUeuDDuKLbQNW0NvgeE3g4WYrLyNvWhjkHmOnK687YeU19zeA1sB81cJVNre7QE8r1Tvq0WuZ5UwM5NlAH7f-dl_pos-VPENF9E5w_Zg9mD5Mdl54_YPRwfs_3LOUb-hH0myfNS_MinyNMJC0oEv9mC3-TTyMn344uSRM9zj_lEv6DvqdQFLTl5tDx31CrDGd16-ZRdnZ99Or0Qcx8FEQzIlYhIjxyIEBuoY4caB2mRDLsbWtTeBtnYxgd6V7RDbFUckC71Wgf06InvddDP2N44jfiCcTOkvCgTaAEAmOB7L02sPcaexGFVxeSapy7MIOOp18U3l4Pd2roiB0dycFkODir2brPmtkBs_JX6JIlqQ5ngsfMAKY2blcb9S2kqdrAWtJttdukSLpBpEt5-xd5spsnaUgjFjzjdFZouYbzRSZ8XvdjsRLdSpSyjitkdjdnZ6u7MePMlI3qnhsnEVlmx92vl-rGvP_Pi5f_gxSt2X2WrAKG6A7a3Wtzha3K0Vv1htqnvJ4EiFQ priority: 102 providerName: Directory of Open Access Journals – databaseName: HAS SpringerNature Open Access 2022 dbid: AAJSJ link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3Nb9UwDLfGJiEuiG8KAwWJG0Q0qdOkxwdimp40LjBpt5C2CUxCLXrv7f8nTtrCg4HEsYkjObHTOLH9M8BL70ulZCt5EE5yxMrzVvY1l14SPJx2JtB7x9mH-vQc1xfq4gDknAuTgvYTpGX6Tc_RYW-2GE1nCpeteEoH5XgDjgiqPer20Wq1_rheXlYIirbBesqQKStzzeC9UyiB9V9nYf4ZKPmbtzQdQid34PZkPbJV5vcuHPjhHtw8m_zj9-FzlDrLiY9sDIzmlREi2OUv0JtsHFi0-9gmB9CzVF-e6Dfxe8w5QVsWrVmWqmnl5oRsvX0A5yfvP7075VMNBd4pFDsefLzgYMBQYxkaX_leGB83ddNrXznTidrUrot3Ct0HLUPv44FeVp133pXoyq56CIfDOPjHwFRPMVGqiwMQUXWudUKF0vnQyiYYWYCY19R2E8A41bn4ZpOjuzI2y8FGOdgkB4sFvFrGfM_wGv-kfkuiWigJGjs1jJsvdlIVGzQ2tY7Mt-ixNb3BQMeCpsLloRO6gONZ0Hbar1tLmECqJqz9Al4s3XGnkfvEDX68yjQN4bvFmT7KerFwUmkhKcKoALOnMXus7vcMl18TmjcVS47LKgp4PSvXT77-vhZP_o_8KdySSf-Ry-YYDnebK_8smlO79vm0f34AXsUZuA priority: 102 providerName: Springer Nature |
Title | The impact of artificial intelligence on the reading times of radiologists for chest radiographs |
URI | https://link.springer.com/article/10.1038/s41746-023-00829-4 https://www.ncbi.nlm.nih.gov/pubmed/37120423 https://www.proquest.com/docview/2807569466 https://www.proquest.com/docview/2807917982 https://pubmed.ncbi.nlm.nih.gov/PMC10148851 https://doaj.org/article/f7496704ab4e4b8d84f111172229fc17 |
Volume | 6 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1Lb9QwEB5BKyEuiDeBsjISN7CaOE7snNB21apaqRUCKu3NOI4NlVBSNtv_j8f2piyPnqL4IdmeGXs8M_4G4K21eVWxllFXaEY5Ly1tWVdTZhnCwwktHdo7zs7r0wu-XFWrZHAbU1jldk8MG3U3GLSRHyJqS1UjGvqHq58Us0ahdzWl0LgL-whdhlwtVmKysSAore-R3srkpTwcudfAMeq2pOFVKeU751GA7f-Xrvl3yOQfftNwHJ08hAdJjyTzSPhHcMf2j-HeWfKUP4Gvnv4kPoEkgyPIIBErglz-BsJJhp54DZCsYyg9CZnmsf3a_w_xddBIvF5LQl6tWBwwrsencHFy_GVxSlM2BWoqXmyos_6qwx13Nc9dY0vbFdJ68W46YUstTVHLWht_uxCdE8x11h_teWmstjrnOjflM9jrh96-AFJ1GB1VGd-Bc14Z3eqicrm2rmWNkyyDYrumyiSoccx48UMFl3cpVaSD8nRQgQ6KZ_Bu6nMVgTZubX2EpJpaIkh2KBjW31SSOeUEb2rhB99yy1vZSe7wgBCYwtyZQmRwsCW0SpI7qhs-y-DNVO1lDh0purfDdWzTINKbn-nzyBfTSEpRMIw1ykDucMzOUHdr-svvAdcb0yb7ZS0yeL9lrptx_X8tXt4-jVdwnwV-55Q1B7C3WV_b116R2rSzIC0z2J_Pl5-X_nt0fP7xky9d1ItZME78AuE-H6c |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwEB6VIgGXimdJKWAkOIHVxHHi5IAQr2pLuz210t5cJ7GhEkrKZivEn-I3MmMnW5ZHbz1u4qwmns-eiWfmG4Dn1sZZJirBXWIElzK1vBJNzoUVRA-nTOHovGN6mE-O5adZNluDn2MtDKVVjnui36ibrqYz8h1ibclyYkN_c_aNU9coiq6OLTQCLPbtj-_4yda_3vuA-n0hxO7Ho_cTPnQV4HUmkwV3Fl1-6aTLZexKm9omKSzCvGyUTU1RJ3mRmxq9bNU4JVxj0cTFaW2NNbE0cZ3i_16D62h4Y_rYUzO1PNMhElyUcKjNidNip5fo8VOWb8p9FSuXK_bPtwn4l2_7d4rmH3Fab_52b8PG4LeytwFod2DNtnfhxnSIzN-DE8QbCyWXrHOMABm4Kdjpb6SfrGsZepxsHlL3me9sT-Pn-LsL1Ug9Qz-a-T5e4bLn1O7vw_GVzPMDWG-71j4EljWUjZXV-ICUMqtNZZLMxca6SpSuEBEk45zqeqA2pw4bX7UPsaeFDnrQqAft9aBlBC-Xz5wFYo9LR78jVS1HEim3v9DNP-thjWunZJkrFL6SVlZFU0hHBklRy3RXJyqC7VHRetgpen2B6wieLW_jGqfAjWltdx7GlMQsh2-6GXCxlCRViaDcpgiKFcSsiLp6pz394nnEqU0zTmsSwasRXBdy_X8uti5_jadwc3I0PdAHe4f7j-CW8NiXXJTbsL6Yn9vH6MQtqid-5TA4ueql-gt2sVhw |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwEB6VrVRxQbxJKWAkOIFp7EwS58BhoazaLa2QoFJvrpPYUKlKqs1WiD_E78SPJLBQkDj0mGQSTWbG8Rd75huAZ1rHacpLTg1TnCImmpa8zijX3NHD5UoYt95xcJjtHuH8OD1eg-9DLYxP2veUlv4zPWSHbXdoobNLl02oLwel-Oq8Nn0y5b7-9tX-qnWv93asX59zPnv36e0u7bsJ0CpFtqRGW6iPBk2GsSl0omsmtA3vos51okTFMpGpyqLrvDY5N7W2U1ucVFppFaOKq8Q-9xqsW3zPcALr0-n843xczXH0twVmfVVOnIhLFF6Z-XyDgMtQ7Z_Jmb_t0PqJb3YTbvSIlUyDjW7Bmm5uw8ZBvyd_B05spJFQbElaQ5wtAysFOf2F7pO0DbFYkyxC0j7xPe2d_MIet6EOqSMWQRPfwSuc9mza3V04uhJL34NJ0zb6AZC0dnlYaWVvQMS0UqViqYmVNiUvjOARsMGmsupJzV1vjTPpN9cTIYMfpPWD9H6QGMGL8Z7zQOnxT-k3zlWjpKPj9ifaxWfZh6c0ORZZbpUvUWMpaoHGTUW5a5ZuKpZHsDU4WvbfiE46HqI0c_z-ETwdL9vR7bZsVKPbiyBTOE45-6b3Q1yMmiQ54y6rKQKxEjErqq5eaU6_eAZx16DZmpVF8HIIrp96_d0Wm_8n_gQ2PuzM5Pu9w_2HcJ37oYCUF1swWS4u9COL5pbl434oETi56tH7A_OrWKo |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=The+impact+of+artificial+intelligence+on+the+reading+times+of+radiologists+for+chest+radiographs&rft.jtitle=NPJ+digital+medicine&rft.au=Shin%2C+Hyun+Joo&rft.au=Han%2C+Kyunghwa&rft.au=Ryu%2C+Leeha&rft.au=Kim%2C+Eun-Kyung&rft.date=2023-04-29&rft.eissn=2398-6352&rft.volume=6&rft.issue=1&rft.spage=82&rft_id=info:doi/10.1038%2Fs41746-023-00829-4&rft_id=info%3Apmid%2F37120423&rft.externalDocID=37120423 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2398-6352&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2398-6352&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2398-6352&client=summon |