Evaluating the Performance of Large Language Models (LLMs) in Answering and Analysing the Chinese Dental Licensing Examination

• Published in: European journal of dental education Vol. 29; no. 2; pp. 332 - 340
• Main Authors: Xiong, Yu‐Tao, Zhan, Zheng‐Zhe, Zhong, Cheng‐Lan, Zeng, Wei, Guo, Ji‐Xiang, Tang, Wei, Liu, Chang
• Format: Journal Article
• Language: English
• Published: England Blackwell Publishing Ltd 01.05.2025
• Subjects: Accuracy; China; chinese language; dentistry; Education, Dental; Educational Measurement - methods; Large Language Models; Licensure, Dental; Medical education; question‐answering; Statistical analysis; Statistical sampling; China; large language models; question‐answering; dentistry; chinese language

ABSTRACT Background This study aimed to simulate diverse scenarios of students employing LLMs for CDLE examination preparation, providing a detailed evaluation of their performance in medical education. Methods A stratified random sampling strategy was implemented to select and subsequently revise 2...