{"title":"Artificial Intelligence in Periodontology: Performance Evaluation of ChatGPT, Claude, and Gemini on the In-service Examination","authors":"Bushra Ahmad, Khaled Saleh, Saleh Alharbi, Hend Alqaderi, Y. Natalie Jeong","doi":"10.1101/2024.05.29.24308155","DOIUrl":null,"url":null,"abstract":"<strong>Background</strong> Artificial intelligence (AI) language models have shown potential as educational tools in healthcare, but their accuracy and reliability in periodontology education require further evaluation. In this study we aimed to assess and compare the performance of three prominent AI language models—ChatGPT-4o, Claude 3 Opus, and Gemini Advanced—with second-year periodontics residents across the United States on the American Academy of Periodontology 2024 in-service examination.","PeriodicalId":501363,"journal":{"name":"medRxiv - Dentistry and Oral Medicine","volume":"43 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Dentistry and Oral Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.05.29.24308155","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background Artificial intelligence (AI) language models have shown potential as educational tools in healthcare, but their accuracy and reliability in periodontology education require further evaluation. In this study we aimed to assess and compare the performance of three prominent AI language models—ChatGPT-4o, Claude 3 Opus, and Gemini Advanced—with second-year periodontics residents across the United States on the American Academy of Periodontology 2024 in-service examination.