Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine

Chatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a general education, could affect the practice of medicine.

Saved in:
Bibliographic Details
Published inThe New England journal of medicine Vol. 388; no. 13; pp. 1233 - 1239
Main Authors Lee, Peter, Bubeck, Sebastien, Petro, Joseph
Format Journal Article
LanguageEnglish
Published Boston Massachusetts Medical Society 30.03.2023
SeriesAI in Medicine
Subjects
Adolescent Medicine
and Education
and Education General
Artificial intelligence
Chatbots
Clinical Medicine
Clinical Medicine General
Cognition & reasoning
Cognitive ability
Computer programs
Interoperability
Medical Practice
Medicine
Pediatrics
Pediatrics General
Teenagers
Training
Online AccessGet full text

Cover

Abstract Chatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a general education, could affect the practice of medicine.
AbstractList Chatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a general education, could affect the practice of medicine.
GPT-4, a General AI Chatbot for MedicineChatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a general education, could affect the practice of medicine.
Author Lee, Peter
Bubeck, Sebastien
Petro, Joseph
Author_xml – sequence: 1
  givenname: Peter
  orcidid: 0000-0002-6757-301X
  surname: Lee
  fullname: Lee, Peter
  organization: From Microsoft Research, Redmond, WA (P.L., S.B.); and Nuance Communications, Burlington, MA (J.P.)
– sequence: 2
  givenname: Sebastien
  surname: Bubeck
  fullname: Bubeck, Sebastien
  organization: From Microsoft Research, Redmond, WA (P.L., S.B.); and Nuance Communications, Burlington, MA (J.P.)
– sequence: 3
  givenname: Joseph
  surname: Petro
  fullname: Petro, Joseph
  organization: From Microsoft Research, Redmond, WA (P.L., S.B.); and Nuance Communications, Burlington, MA (J.P.)
BookMark eNpVUMFOwzAUi9CQ6AZH7pEQNwovzUvWHLdqjKEOEBrnKm0S0UJTaLr_X2Fc8MWyZdmSp2TiO28JuWRwy0DIu6fV4zb0ScKQpXhCIiY4jxFBTkgEkKQxzhU_I9MQGhjBUEVkubTeunoINzSv21_W3tDXOnwE2jm6ftnFSHUYXbrY0OxdD2U3UNf1dGtNXdXenpNTpz-DvfjjGXm7X-2yhzh_Xm-yRR63DPkQG-MAUUqrE8EN4650gkutHIBQZanKSnHnjOAOlBTVKK2GCtFIVkGVMj4jV8fer7773tswFE237_04WSRzlQiJKoUxdX1MtW0ovG3agkHxc0_x7x5-AKExVtc
ContentType Journal Article
Copyright Copyright © 2023 Massachusetts Medical Society. All rights reserved.
Copyright_xml – notice: Copyright © 2023 Massachusetts Medical Society. All rights reserved.
DBID 7RV
7X7
7XB
8AO
8C1
8FE
8FH
8FI
ABUWG
AFKRA
AN0
AZQEC
BBNVY
BEC
BENPR
BHPHI
CCPQU
DWQXO
FYUFA
GHDGH
GNUQQ
GUQSH
HCIFZ
K0Y
LK8
M0R
M0T
M1P
M2M
M2O
M2P
M7P
MBDVC
NAPCQ
PHGZM
PHGZT
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PSYQQ
Q9U
DOI 10.1056/NEJMsr2214184
DatabaseName Nursing & Allied Health Database
Health & Medical Collection
ProQuest Central (purchase pre-March 2016)
ProQuest Pharma Collection
Public Health Database
ProQuest SciTech Collection
ProQuest Natural Science Collection
ProQuest Hospital Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
British Nursing Database
ProQuest Central Essentials
Biological Science Collection
eLibrary
ProQuest Central
Natural Science Collection
ProQuest One Community College
ProQuest Central Korea
ProQuest Health Research Premium Collection
Health Research Premium Collection (Alumni)
ProQuest Central Student
ProQuest Research Library
SciTech Premium Collection
New England Journal of Medicine
Biological Sciences
Consumer Health Database
Healthcare Administration Database
Medical Database
Psychology Database
ProQuest Research Library
Science Database
Biological Science Database
Research Library (Corporate)
Nursing & Allied Health Premium
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest Health & Medical Research Collection
ProQuest One Academic Middle East (New)
ProQuest One Health & Nursing
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
ProQuest One Psychology
ProQuest Central Basic
DatabaseTitle ProQuest One Psychology
Research Library Prep
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
elibrary
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest One Health & Nursing
New England Journal of Medicine
ProQuest Natural Science Collection
ProQuest Pharma Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Health & Medical Research Collection
Health Research Premium Collection
Natural Science Collection
ProQuest Central Korea
Health & Medical Research Collection
Biological Science Collection
ProQuest Research Library
ProQuest Central (New)
ProQuest Public Health
ProQuest Biological Science Collection
ProQuest Central Basic
ProQuest Science Journals
ProQuest Family Health
ProQuest One Academic Eastern Edition
British Nursing Index with Full Text
ProQuest Health Management
ProQuest Nursing & Allied Health Source
ProQuest Hospital Collection
Health Research Premium Collection (Alumni)
Biological Science Database
ProQuest SciTech Collection
Nursing & Allied Health Premium
ProQuest Health & Medical Complete
ProQuest Medical Library
ProQuest Psychology Journals
ProQuest One Academic UKI Edition
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList
ProQuest One Psychology
Database_xml – sequence: 1
  dbid: BENPR
  name: ProQuest Central
  url: https://www.proquest.com/central
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
EISSN 1533-4406
Editor Leong, Tze-Yun
Drazen, Jeffrey M.
Kohane, Isaac S.
Editor_xml – sequence: 1
  givenname: Jeffrey M.
  surname: Drazen
  fullname: Drazen, Jeffrey M.
– sequence: 2
  givenname: Isaac S.
  surname: Kohane
  fullname: Kohane, Isaac S.
– sequence: 3
  givenname: Tze-Yun
  surname: Leong
  fullname: Leong, Tze-Yun
EndPage 1239
ExternalDocumentID NJ202303303881320
Genre Special Report
GroupedDBID ---
-DZ
-ET
-~X
.-4
.55
.CO
.GJ
0R~
0WA
123
1VV
2KS
2WC
34G
36B
39C
4.4
5RE
7FN
7RV
7X7
85S
8C1
8W4
9M8
AACLI
AAEJM
AAIKC
AAMNW
AAQQT
AARDX
AAUTI
AAWTL
ABACO
ABEHJ
ABFLS
ABIVO
ABOCM
ABPPZ
ABPTK
ABQIJ
ABWJO
ACGFS
ACGOD
ACKOT
ACNCT
ACPFK
ACPRK
ACPVT
ACRZS
ADBBV
AENEX
AETEA
AFFNX
AFHKK
AFOSN
AFUVZ
AGFXO
AGNAY
AHMBA
AJJEV
AKALU
ALMA_UNASSIGNED_HOLDINGS
BBNVY
BENPR
BHPHI
C45
CJ0
CS3
DCD
DU5
EBS
EX3
F5P
FD8
FM.
FYUFA
HCIFZ
HF~
HZ~
I4R
K-O
KOO
L7B
M0R
M0T
M1P
M2M
M2O
M2P
M7P
MQT
MVM
N4W
NEJ
O9-
OK1
OMK
OVD
P-O
P2P
RHI
RWL
RXW
S10
SJN
TAE
TAF
TEORI
TN5
TWZ
UCV
UKR
UMD
VQA
W2G
WH7
WOQ
WOW
X7M
XJT
XYN
XZL
YCJ
YFH
YR2
YRY
YYP
YZZ
ZA5
ZCA
ZR0
ZVN
~KM
29N
53G
7XB
8AO
8FE
8FH
8FI
ABBLC
ABCQX
ABDQB
ABJNI
ABUWG
ADUKH
AERZD
AFKRA
AGHSJ
AN0
AQUVI
AZQEC
BCU
BEC
BKEYQ
BKNYI
BNQBC
BPHCQ
BVXVI
BYPQX
CCPQU
DWQXO
GNUQQ
GUQSH
HMCUK
K0Y
LK8
MBDVC
NAPCQ
PCD
PHGZM
PHGZT
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PROAC
PSQYO
PSYQQ
PUEGO
Q9U
SJFOW
TUQ
UKHRP
YR5
ID FETCH-LOGICAL-m143t-ddf04466ea253d13fbf536a9f0059bb9bc93ffd53f0965cbc9ea0c44d61c0c813
IEDL.DBID 7X7
ISSN 0028-4793
IngestDate Sat Aug 23 14:02:39 EDT 2025
Sun Apr 02 23:58:45 EDT 2023
IsPeerReviewed true
IsScholarly true
Issue 13
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-m143t-ddf04466ea253d13fbf536a9f0059bb9bc93ffd53f0965cbc9ea0c44d61c0c813
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-6757-301X
PQID 2792564980
PQPubID 40644
PageCount 7
ParticipantIDs proquest_journals_2792564980
mms_nejm_10_1056_NEJMsr2214184
PublicationCentury 2000
PublicationDate 20230330
PublicationDateYYYYMMDD 2023-03-30
PublicationDate_xml – month: 03
  year: 2023
  text: 20230330
  day: 30
PublicationDecade 2020
PublicationPlace Boston
PublicationPlace_xml – name: Boston
PublicationSeriesTitle AI in Medicine
PublicationTitle The New England journal of medicine
PublicationYear 2023
Publisher Massachusetts Medical Society
Publisher_xml – name: Massachusetts Medical Society
References Ker, J, Wang, L, Rao, J, Lim, T (r1) 2018; 6
Milosevic, N, Thielemann, W (r4) 2022
Cancarevic, I (r11) 2021
Beaulieu-Jones, BK, Yuan, W, Brat, GA (r3) 2021; 4
Kung, TH, Cheatham, M, Medenilla, A (r8) 2023; 2
Kazi, N, Kuntz, M, Kanewala, U, Kahanda, I, Bristow, C, Arzubi, E (r10) 2020
(r5) 2022
r6
r9
Han, K, Cao, P, Wang, Y (r2) 2022; 12
Singhal, K, Azizi, S, Tu, T (r7) 2022
References_xml – year: 2021
  ident: r11
  article-title: International medical graduates in the United States ;The US medical licensing examination
  publication-title: Springer ;New York
– volume: 4
  start-page: 62
  year: 2021
  end-page: 62
  ident: r3
  article-title: Machine learning for patient risk stratification: standing on, or looking over, the shoulders of clinicians?
  publication-title: NPJ Digit Med
– year: 2022
  ident: r4
  article-title: Comparison of biomedical relationship extraction methods and models for knowledge graph creation. ;(https://arxiv.org/abs/2201.01647)
  publication-title: Journal of Web Semantics
– ident: r9
  article-title: Automatically document care with the Dragon Ambient eXperience ;(https://www.nuance.com/healthcare/ambient-clinical-intelligence.html)
– volume: 12
  start-page: 814858
  year: 2022
  end-page: 814858
  ident: r2
  article-title: A review of approaches for predicting drug-drug interactions based on machine learning.
  publication-title: Front Pharmacol
– year: 2022
  ident: r5
  article-title: Introducing ChatGPT ;(https://openai.com/blog/chatgpt)
– year: 2022
  ident: r7
  article-title: Large language models encode clinical knowledge. ;(https://arxiv.org/abs/2212.13138)
  publication-title: arXiv
– year: 2020
  ident: r10
  article-title: Dataset for automated medical transcription ;(https://zenodo.org/record/4279041#.Y_uCZh_MI2w)
  publication-title: Zenodo
– ident: r6
  article-title: Corbelle JG , Bugarín-Diz A , Alonso-Moral J , Taboada J . Dealing with hallucination and omission in neural Natural Language Generation: a use case on meteorology . In: Proceedings and Abstracts of the 15th International Conference on Natural Language Generation , July 18–22, 2022 . Waterville, ME : Arria , 2022 .
– volume: 6
  start-page: 9375
  year: 2018
  end-page: 9389
  ident: r1
  article-title: Deep learning applications in medical image analysis.
  publication-title: IEEE Access
– volume: 2
  start-page: e0000198
  issue: 2
  year: 2023
  end-page: e0000198
  ident: r8
  article-title: Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models.
  publication-title: PLOS Digit Health
SSID ssj0000149
Score 2.751881
Snippet Chatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a...
GPT-4, a General AI Chatbot for MedicineChatbots are computer programs with which one can have a conversation. In this article, the authors describe how the...
SourceID proquest
mms
SourceType Aggregation Database
Publisher
StartPage 1233
SubjectTerms Adolescent Medicine
and Education
and Education General
Artificial intelligence
Chatbots
Clinical Medicine
Clinical Medicine General
Cognition & reasoning
Cognitive ability
Computer programs
Interoperability
Medical Practice
Medicine
Pediatrics
Pediatrics General
Teenagers
Training
SubjectTermsDisplay Adolescent Medicine
Clinical Medicine
Clinical Medicine General
Medical Practice, Training, and Education
Medical Practice, Training, and Education General
Pediatrics
Pediatrics General
Title Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
URI https://nejm.org/doi/full/10.1056/NEJMsr2214184
https://www.proquest.com/docview/2792564980
Volume 388
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LSwMxEA62BfEiPrFaSw4eDd1Hkt09SVuqVWgppYXels0Lq-xWm_X_m8QUFcHLht2FHGbCzMdM5vsAuJEkE9a3yIINhJWkiDEcokxKSmWQitiVBiZTOl7ipxVZ-YKb9tcqdzHRBWqx4bZG3rNEd4TiLA3u3t6RVY2y3VUvodEALUtdZq90JavkB32Uh7--guQ5Nk3O71mleb2NohCHlti0UZb6TzR2Keb-CBx6bAj7X848BnuyOgH7E9_9PgWDgQlMal3rW-jmksxaVALO1_pVw42CD7MFwrDQ5ivsP8Lhc1GzTQ0NLIW7Tc7A8n60GI6R10BApUEyNRJCuZarLCISizBWTJGYFpmyU6OMZYxnsVKCxMrSuHDzKouAYyxoyAOehvE5aFabSl4AyEOSCEF4UUQxVkmWRtJgRZLgVKYiYVkbdI0V8kq-lLlrTROa_zJTG3R2Bsr9Sdf5t18u__99BQ6sVLub5ws6oFlvP-S1Seg16zqvmWc6DLugNRhNZ_NPnbKdFg
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1NS8NAEB1qBfUifmK11j3ozcUku5smB5G2Vlu1RaRCbzGb3cUqTbWJiH_K3-humqAieOspJIE9zEwmb2d23gM4lMwXxrfYgA1MlXQx59TGvpSuKy1PkKw00Ou7nXt6NWTDEnwWszDmWGWRE7NELSaRqZGfGKI75lLfs85eXrFRjTLd1UJCYxYW1_LjXW_ZktPuufbvkeNctAetDs5VBfBYY4MUC6GyJqYMHUaETRRXjLihr8wcJuc-j3yilGBEGWKUSN_K0IooFa4dWZFnE73uAixSorcyZVhstvu3dz8Iq3LAndesclZPjTJOjLZ9MnUcm9qGSnVhPE7-5P_sp3axBqs5GkWNWfisQ0nGG7DUy_vtm9Bs6lSoRmlyjLJJKH0NY4HuRslzgiYKXd4OMEVhop-iRhe1HsOUT1KkgTAqFtmC-7nYZxvK8SSWO4Aim9WFYFEYOoSquu85UqNTVqee9ESd-xWoaSsEsXwaB1kznLnBLzNVoFoYKMi_rST4joTd_18fwHJn0LsJbrr96z1YMULx2TShVYVyOn2T-xpOpLyW-xDBw7zD5gv_UNo2
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LSwMxEB5sBfEiPvFRaw56M3R3k-zjINKHtVVbRCz0tm42CT7oVrsr4l_z15lsd1ERvHlasoEcZr5MvsxkZgAOJQuE0S02ZANTJV3MObVxIKXrSssXJHcNDIZub0Qvxmy8AB9lLox5VlnaxNxQi2lsfOQNU-iOuTTwrYYqnkVcd7qnzy_YdJAykdayncYcIpfy_U1f39KTfkfr-shxume37R4uOgzgieYJGRZC5QFNGTmMCJsorhhxo0CZnEzOAx4HRCnBiDJFUmI9lJEVUypcO7Zi3yZ63QoseoTZZo95Y-9b6aqCehfeq6K-p-YbDdPlPp05jk1tU1S1Mpmkv06C_HjrrsJKwUtRcw6kNViQyTosDYrI-wa0WtooqocsPUZ5TpT-RolANw_pU4qmCp1f32KKolT_Rc0-at9HGZ9mSFNiVC6yCaN_kc4WVJNpIrcBxTbzhGBxFDmEKi_wHal5KvOoL33h8WAH6loKYSIfJ2EeFmdu-ENMO1ArBRQWuywNvzCx-_f0ASxpsIRX_eHlHiybjvF5WqFVg2o2e5X7mldkvJ4rEMHdfyPmEw973QY
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Benefits%2C+Limits%2C+and+Risks+of+GPT-4+as+an+AI+Chatbot+for+Medicine&rft.jtitle=The+New+England+journal+of+medicine&rft.au=Lee%2C+Peter&rft.au=Bubeck%2C+Sebastien&rft.au=Petro%2C+Joseph&rft.date=2023-03-30&rft.pub=Massachusetts+Medical+Society&rft.issn=0028-4793&rft.eissn=1533-4406&rft.volume=388&rft.issue=13&rft.spage=1233&rft.epage=1239&rft_id=info:doi/10.1056%2FNEJMsr2214184&rft.externalDBID=HAS_PDF_LINK
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0028-4793&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0028-4793&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0028-4793&client=summon