Qualitatively Assessing ChatGPT Responses to Frequently Asked Questions Regarding Sexually Transmitted Diseases

• Published in: Sexually transmitted diseases Vol. 52; no. 3; p. 188
• Main Authors: Moothedan, Elijah, Jhumkhawala, Vama, Burgoa, Sara, Martinez, Lisa, Sacca, Lea
• Format: Journal Article
• Language: English
• Published: United States 01.03.2025
• Subjects: Artificial Intelligence; Generative Artificial Intelligence; Humans; Natural Language Processing; Patient Education as Topic - methods; Public Health; Sexually Transmitted Diseases - diagnosis; Sexually Transmitted Diseases - prevention & control; Surveys and Questionnaires
• ISSN: 1537-4521
• DOI: 10.1097/OLQ.0000000000002088

ChatGPT, a large language model artificial intelligence platform that uses natural language processing, has seen its implementation across a number of sectors, notably in health care. However, there remains limited understanding regarding the efficacy of ChatGPT in addressing commonly asked questions on public health subjects. This study aimed to investigate whether ChatGPT could appropriately answer frequently asked questions related to sexually transmitted diseases (STDs). Ten frequently asked questions on STDs were gathered from 25 different government agency websites. The questions were inputted into ChatGPT, and subsequent responses were analyzed for accuracy, clarity, and appropriateness using an evidence-based approach on a 4-point grading scale. Of the responses provided by ChatGPT, 4 were determined to be excellent requiring no clarification and 6 requiring minimal clarification. No responses were graded as unsatisfactory. Additionally, the responses appropriately emphasized consulting a health care specialist. Although the majority of responses required minimal clarification, ChatGPT has the potential to be an effective supplementary tool for patient education. Additional research is necessary to explore possible public health strategies that incorporate artificial intelligence to address concerns related to STDs.