Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe
{"title":"Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios","authors":"Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe","doi":"10.1101/2024.05.31.24308044","DOIUrl":null,"url":null,"abstract":"<strong>Introduction</strong> While previous studies have demonstrated that generative artificial intelligence (AI) can pass medical licensing exams, AI’s role as an examiner in complex, interactive assessments remains unknown. AI-powered chatbots could serve as educational tools to simulate oral examination dialogues. Here, we present initial validity evidence for an AI-powered chatbot designed for general surgery residents to prepare for the American Board of Surgery (ABS) Certifying Exam (CE).","PeriodicalId":501387,"journal":{"name":"medRxiv - Medical Education","volume":"59 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Medical Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.05.31.24308044","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction While previous studies have demonstrated that generative artificial intelligence (AI) can pass medical licensing exams, AI’s role as an examiner in complex, interactive assessments remains unknown. AI-powered chatbots could serve as educational tools to simulate oral examination dialogues. Here, we present initial validity evidence for an AI-powered chatbot designed for general surgery residents to prepare for the American Board of Surgery (ABS) Certifying Exam (CE).
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
