Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe
{"title":"评估用于口试场景的新型大语言模型（LLM）聊天机器人","authors":"Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe","doi":"10.1101/2024.05.31.24308044","DOIUrl":null,"url":null,"abstract":"<strong>Introduction</strong> While previous studies have demonstrated that generative artificial intelligence (AI) can pass medical licensing exams, AI’s role as an examiner in complex, interactive assessments remains unknown. AI-powered chatbots could serve as educational tools to simulate oral examination dialogues. Here, we present initial validity evidence for an AI-powered chatbot designed for general surgery residents to prepare for the American Board of Surgery (ABS) Certifying Exam (CE).","PeriodicalId":501387,"journal":{"name":"medRxiv - Medical Education","volume":"59 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios\",\"authors\":\"Caitlin Silvestri, Joshua Roshal, Meghal Shah, Warren D. Widmann, Courtney Townsend, Riley Brian, Joseph C. L’Huillier, Sergio M. Navarro, Sarah Lund, Tejas S. Sathe\",\"doi\":\"10.1101/2024.05.31.24308044\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<strong>Introduction</strong> While previous studies have demonstrated that generative artificial intelligence (AI) can pass medical licensing exams, AI’s role as an examiner in complex, interactive assessments remains unknown. AI-powered chatbots could serve as educational tools to simulate oral examination dialogues. Here, we present initial validity evidence for an AI-powered chatbot designed for general surgery residents to prepare for the American Board of Surgery (ABS) Certifying Exam (CE).\",\"PeriodicalId\":501387,\"journal\":{\"name\":\"medRxiv - Medical Education\",\"volume\":\"59 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"medRxiv - Medical Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1101/2024.05.31.24308044\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Medical Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.05.31.24308044","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Evaluation of a Novel Large Language Model (LLM) Powered Chatbot for Oral-Boards Scenarios
Introduction While previous studies have demonstrated that generative artificial intelligence (AI) can pass medical licensing exams, AI’s role as an examiner in complex, interactive assessments remains unknown. AI-powered chatbots could serve as educational tools to simulate oral examination dialogues. Here, we present initial validity evidence for an AI-powered chatbot designed for general surgery residents to prepare for the American Board of Surgery (ABS) Certifying Exam (CE).
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
