ChatGPT (GPT-4) versus doctors on complex cases of the Swedish family medicine specialist examination: an observational comparative study

• Published in: BMJ open Vol. 14; no. 12; p. e086148
• Main Authors: Arvidsson, Rasmus, Gunnarsson, Ronny, Entezarjou, Artin, Sundemo, David, Wikberg, Carl
• Format: Journal Article
• Language: English
• Published: England British Medical Journal Publishing Group 26.12.2024; BMJ Publishing Group LTD; BMJ Publishing Group
• Subjects: Allmänmedicin; Artificial Intelligence; Chatbots; Clinical Competence; Computer Systems; Computer Vision and learning System; Datorseende och lärande system; Datorsystem; Educational Measurement - methods; Family Practice; General Medicine; General practice / Family practice; Health informatics; Humans; Male; Medicine; Multiple choice; Original Research; Patients; Physicians; Primary care; Primary Health Care; Statistical analysis; Sweden; Sweden; Artificial Intelligence; Primary Health Care; Health informatics

BackgroundRecent breakthroughs in artificial intelligence research include the development of generative pretrained transformers (GPT). ChatGPT has been shown to perform well when answering several sets of medical multiple-choice questions. However, it has not been tested for writing free-text asses...