Performance of a Large Language Model on the Anesthesiology Continuing Education Exam

Saved in:
Bibliographic Details
Published inAnesthesiology (Philadelphia) Vol. 141; no. 6; pp. 1196 - 1199
Main Authors Gupta, Vardaan, Gu, Yang, Lustik, Stewart J., Park, Won, Yin, Shichen, Rubinger, Daniel, Chang, Francis M., Panda, Kunal, Besharat, Soroush, Sadhra, Hamza, Glance, Laurent G.
Format Journal Article
LanguageEnglish
Published 01.12.2024
Online AccessGet full text

Cover

Author Gupta, Vardaan
Chang, Francis M.
Rubinger, Daniel
Besharat, Soroush
Park, Won
Sadhra, Hamza
Lustik, Stewart J.
Yin, Shichen
Gu, Yang
Panda, Kunal
Glance, Laurent G.
Author_xml – sequence: 1
  givenname: Vardaan
  orcidid: 0000-0002-7701-350X
  surname: Gupta
  fullname: Gupta, Vardaan
– sequence: 2
  givenname: Yang
  surname: Gu
  fullname: Gu, Yang
– sequence: 3
  givenname: Stewart J.
  surname: Lustik
  fullname: Lustik, Stewart J.
– sequence: 4
  givenname: Won
  surname: Park
  fullname: Park, Won
– sequence: 5
  givenname: Shichen
  surname: Yin
  fullname: Yin, Shichen
– sequence: 6
  givenname: Daniel
  surname: Rubinger
  fullname: Rubinger, Daniel
– sequence: 7
  givenname: Francis M.
  surname: Chang
  fullname: Chang, Francis M.
– sequence: 8
  givenname: Kunal
  surname: Panda
  fullname: Panda, Kunal
– sequence: 9
  givenname: Soroush
  surname: Besharat
  fullname: Besharat, Soroush
– sequence: 10
  givenname: Hamza
  surname: Sadhra
  fullname: Sadhra, Hamza
– sequence: 11
  givenname: Laurent G.
  surname: Glance
  fullname: Glance, Laurent G.
BookMark eNpdUMtOwzAQtFCRaAt_wMFHLil-4EeOVVUoUngcytlynU0ISuxiNxL9e4zKAbGHndnVaLQ7MzTxwQNC15QsKCnV7bJ6XpA_JaimZ2hKBdMFpUpM0DRvecEJYxdoltJHHpXgeoreXiE2IQ7WO8ChwRZXNraQu29Hm8lTqKHHwePDO-Clh5QxdaEP7RGvgj90fux8i9f16Oyhy7r1lx0u0Xlj-wRXvzhH2_v1drUpqpeHx9WyKpzSrOCyLkGXTlC5c3xHGAgCvKRCOl3qGmquG1aS2klaE6YaLoW0LPP8x05ayefo5mS7j-FzzKeZoUsO-t56CGMynDKthFKSZendSepiSClCY_axG2w8GkrMT4gmh2j-h8i_AW3lZVg
Cites_doi 10.1371/journal.pdig.0000198
10.1001/jamapediatrics.2023.2373
10.1016/j.bja.2023.04.017
10.1097/ALN.0000000000004824
10.1038/s41562-023-01659-w
10.1227/neu.0000000000002551
10.1038/s41586-023-06291-2
10.1186/s13054-023-04393-x
10.1016/j.bja.2023.10.025
ContentType Journal Article
DBID AAYXX
CITATION
7X8
DOI 10.1097/ALN.0000000000005181
DatabaseName CrossRef
MEDLINE - Academic
DatabaseTitle CrossRef
MEDLINE - Academic
DeliveryMethod fulltext_linktorsrc
EISSN 1528-1175
EndPage 1199
ExternalDocumentID 10_1097_ALN_0000000000005181
GroupedDBID ---
-~X
.-D
.XZ
.Z2
01R
026
0R~
1CY
1J1
23M
2WC
354
40H
4Q1
4Q2
4Q3
53G
5GY
5RE
5VS
6J9
71W
77Y
7O~
AAAAV
AAAXR
AAGIX
AAHPQ
AAIQE
AAJCS
AAMOA
AAMTA
AAQKA
AARTV
AASCR
AASOK
AASXQ
AAUEB
AAWTL
AAXQO
AAYXX
ABASU
ABBUW
ABDIG
ABJNI
ABOCM
ABVCZ
ABXVJ
ABZAD
ACDDN
ACEWG
ACGFO
ACGFS
ACILI
ACLDA
ACLED
ACOAL
ACWDW
ACWRI
ACXJB
ACXNZ
ADBBV
ADGGA
ADHPY
AE3
AE6
AEBDS
AENEX
AFDTB
AFEXH
AFSOK
AFUWQ
AGINI
AHOMT
AHQNM
AHVBC
AHXIK
AIJEX
AINUH
AJIOK
AJNWD
AJRGT
AJZMW
AKULP
ALMA_UNASSIGNED_HOLDINGS
ALMTX
AMJPA
AMKUR
AMNEI
AOHHW
AWKKM
BAWUL
BCGUY
BOYCO
BQLVK
BYPQX
C45
CITATION
CS3
DIK
DIWNM
E.X
EBS
EEVPB
ERAAH
EX3
F2K
F2L
F2M
F2N
F5P
FCALG
FL-
GNXGY
GQDEL
GX1
H0~
HLJTE
HZ~
IKREB
IKYAY
IN~
IPNFZ
JF7
JK3
JK8
K-A
K-F
K8S
KD2
KMI
L-C
L7B
N9A
N~7
N~B
O9-
OAG
OAH
OB3
OBH
ODA
ODMTH
ODZKP
OGROG
OHH
OHYEH
OJAPA
OK1
OL1
OLB
OLG
OLH
OLL
OLU
OLV
OLW
OLY
OLZ
OPUJH
OVD
OVDNE
OVIDH
OVLEI
OVOZU
OWU
OWV
OWW
OWX
OWY
OWZ
OXXIT
P2P
RIG
RLZ
S4R
S4S
TEORI
TR2
TSPGW
TWZ
V2I
W2D
W3M
WH7
WOQ
WOW
X3V
X3W
XXN
XYM
YFH
YOC
ZFV
ZY1
7X8
ID FETCH-LOGICAL-c782-36d9e89c516bc3b02e50e39156c898ded38f290dc61d027f3656a21d0302b6a63
ISSN 0003-3022
1528-1175
IngestDate Fri Nov 15 20:27:10 EST 2024
Wed Nov 13 12:37:44 EST 2024
IsPeerReviewed true
IsScholarly true
Issue 6
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c782-36d9e89c516bc3b02e50e39156c898ded38f290dc61d027f3656a21d0302b6a63
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0000-0002-7701-350X
PQID 3128757762
PQPubID 23479
PageCount 4
ParticipantIDs proquest_miscellaneous_3128757762
crossref_primary_10_1097_ALN_0000000000005181
PublicationCentury 2000
PublicationDate 2024-12-01
20241201
PublicationDateYYYYMMDD 2024-12-01
PublicationDate_xml – month: 12
  year: 2024
  text: 2024-12-01
  day: 01
PublicationDecade 2020
PublicationTitle Anesthesiology (Philadelphia)
PublicationYear 2024
References Azamfirei (2024111214004646300_R7) 2023; 27
Singhal (2024111214004646300_R11) 2023; 620
Shay (2024111214004646300_R8) 2024; 132
Kung (2024111214004646300_R3) 2023; 2
American Society of Anesthesiologists: ACE 2023. Available at (2024111214004646300_R10)
Beam (2024111214004646300_R5) 2023; 177
Shay (2024111214004646300_R6) 2023; 131
Segal (2024111214004646300_R9) 2024; 140
Tong (2024111214004646300_R1) 2023
Webb (2024111214004646300_R2) 2023; 7
Ali (2024111214004646300_R4) 2023; 93
References_xml – volume: 2
  start-page: e0000198
  year: 2023
  ident: 2024111214004646300_R3
  article-title: Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models.
  publication-title: PLOS Digit Health
  doi: 10.1371/journal.pdig.0000198
  contributor:
    fullname: Kung
– volume: 177
  start-page: 977
  year: 2023
  ident: 2024111214004646300_R5
  article-title: Performance of a large language model on practice questions for the neonatal board examination.
  publication-title: JAMA Pediatr
  doi: 10.1001/jamapediatrics.2023.2373
  contributor:
    fullname: Beam
– volume: 131
  start-page: e31
  year: 2023
  ident: 2024111214004646300_R6
  article-title: Assessment of ChatGPT success with specialty medical knowledge using anaesthesiology board examination practice questions.
  publication-title: Br J Anaesth
  doi: 10.1016/j.bja.2023.04.017
  contributor:
    fullname: Shay
– volume: 140
  start-page: 333
  year: 2024
  ident: 2024111214004646300_R9
  article-title: Appropriateness of answers to common preanesthesia patient questions composed by the large language model GPT-4 compared to human authors.
  publication-title: Anesthesiology
  doi: 10.1097/ALN.0000000000004824
  contributor:
    fullname: Segal
– ident: 2024111214004646300_R10
  contributor:
    fullname: American Society of Anesthesiologists: ACE 2023. Available at
– volume: 7
  start-page: 1526
  year: 2023
  ident: 2024111214004646300_R2
  article-title: Emergent analogical reasoning in large language models.
  publication-title: Nat Hum Behav
  doi: 10.1038/s41562-023-01659-w
  contributor:
    fullname: Webb
– volume: 93
  start-page: 1090
  year: 2023
  ident: 2024111214004646300_R4
  article-title: Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank.
  publication-title: Neurosurgery
  doi: 10.1227/neu.0000000000002551
  contributor:
    fullname: Ali
– volume: 620
  start-page: 172
  year: 2023
  ident: 2024111214004646300_R11
  article-title: Large language models encode clinical knowledge.
  publication-title: Nature
  doi: 10.1038/s41586-023-06291-2
  contributor:
    fullname: Singhal
– volume: 27
  start-page: 120
  year: 2023
  ident: 2024111214004646300_R7
  article-title: Large language models and the perils of their hallucinations.
  publication-title: Crit Care
  doi: 10.1186/s13054-023-04393-x
  contributor:
    fullname: Azamfirei
– volume: 132
  start-page: 172
  year: 2024
  ident: 2024111214004646300_R8
  article-title: Could ChatGPT-4 pass an anaesthesiology board examination? Follow-up assessment of a comprehensive set of board examination practice questions.
  publication-title: Br J Anaesth
  doi: 10.1016/j.bja.2023.10.025
  contributor:
    fullname: Shay
– year: 2023
  ident: 2024111214004646300_R1
  article-title: Exclusive: ChatGPT traffic slips again for third month in a row
  contributor:
    fullname: Tong
SSID ssj0007538
Score 2.5084355
SourceID proquest
crossref
SourceType Aggregation Database
StartPage 1196
Title Performance of a Large Language Model on the Anesthesiology Continuing Education Exam
URI https://www.proquest.com/docview/3128757762
Volume 141
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3fT9swELY69sLLBNoQbICMxFvlEieOEz9WCFpVCO2hjL5FduKIaVta0UZD_Bv8w5xj50erahr0wU0j1Up8n8535-_uEDoP8zj0cs1IrKgkjOUZUanwiZY6NPxc8LoqtsUtH9-xySyc9XovHdZSuVKD9HlrXsl7pAr3QK4mS_YNkm0mhRtwDfKFESQM43_J-HuH9V_lOd4YXjeMNgZZNTr77Y4D-kNQavC9dFWXTFmqn0VpIgUNyaN_9ST_dM3Vjf-ANWoCMKay5OLBsGybKMKoXFgz9AcgTraIG5WVjpdufzTMH9M-7JcjmP2Fl-pPBu05liVu3zusuGiEzzrMjlrDBiTwbK7xQDul6oOnSm2HlEbrMtqBV1eHUip4Zz-Gn2Krrrc1hIc3t7YGpfuE1LaAWS-tvbHlNUTE-ggeZkk2Z_mAPvqgvYzaHM1a3hD4d3HdhtG8aJ2PKaKLbc-ybu-sb_eVDTPdQ5-c84GHFkn7qKeLz-iugyI8z7HEFYpwjSJcoQjPCwxIwOuIwC2KcIMibFD0BU2vr6aXY-KabZAUjEQS8EzoWKQh5SoNlOfr0NOmeQBPYxFnOgvi3BdelnKaeX6UB-AHSB-uYQkUlzw4QDvFvNCHCLNc5h5PKQdXlXElVAw2PvjFgknuRVIdIVKvSLKwJVWSf8nhCJ3Vy5aA7jMHWrLQ83KZBGBcRWEE-_nXN875De226D1GO6vHUp-AdblSp5W0XwHS6XFT
link.rule.ids 315,783,787,27936,27937
linkProvider Geneva Foundation for Medical Education and Research
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Performance+of+a+Large+Language+Model+on+the+Anesthesiology+Continuing+Education+Exam&rft.jtitle=Anesthesiology+%28Philadelphia%29&rft.au=Gupta%2C+Vardaan&rft.au=Gu%2C+Yang&rft.au=Lustik%2C+Stewart+J.&rft.au=Park%2C+Won&rft.date=2024-12-01&rft.issn=0003-3022&rft.eissn=1528-1175&rft.volume=141&rft.issue=6&rft.spage=1196&rft.epage=1199&rft_id=info:doi/10.1097%2FALN.0000000000005181&rft.externalDBID=n%2Fa&rft.externalDocID=10_1097_ALN_0000000000005181
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0003-3022&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0003-3022&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0003-3022&client=summon