An explorative assessment of ChatGPT as an aid in medical education: Use it with caution.

IF 3.3 2区教育学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES Medical Teacher Pub Date : 2024-05-01 Epub Date: 2023-10-20 DOI:10.1080/0142159X.2023.2271159

Zhiyong Han, Fortunato Battaglia, Abinav Udaiyar, Allen Fooks, Stanley R Terlecky

{"title":"An explorative assessment of ChatGPT as an aid in medical education: Use it with caution.","authors":"Zhiyong Han, Fortunato Battaglia, Abinav Udaiyar, Allen Fooks, Stanley R Terlecky","doi":"10.1080/0142159X.2023.2271159","DOIUrl":null,"url":null,"abstract":"Objective: To explore the use of ChatGPT by educators and students in a medical school setting.Method: This study used the public version of ChatGPT launched by OpenAI on November 30, 2022 (https://openai.com/blog/chatgpt/). We employed prompts to ask ChatGPT to 1) generate a content outline for a session on the topics of cholesterol, lipoproteins, and hyperlipidemia for medical students; 2) produce a list of learning objectives for the session; and 3) write assessment questions with and without clinical vignettes related to the identified learning objectives. We assessed the responses by ChatGPT for accuracy and reliability to determine the potential of the chatbot as an aid to educators and as a \"know-it-all\" medical information provider for students.Results: ChatGPT can function as an aid to educators, but it is not yet suitable as a reliable information resource for educators and medical students.Conclusion: ChatGPT can be a useful tool to assist medical educators in drafting course and session content outlines and create assessment questions. At the same time, caution must be taken as ChatGPT is prone to providing incorrect information; expert oversight and caution are necessary to ensure the information generated is accurate and beneficial to students. Therefore, it is premature for medical students to use the current version of ChatGPT as a \"know-it-all\" information provider. In the future, medical educators should work with programming experts to explore and grow the full potential of AI in medical education.","PeriodicalId":18643,"journal":{"name":"Medical Teacher","volume":" ","pages":"657-664"},"PeriodicalIF":3.3000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Teacher","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/0142159X.2023.2271159","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/10/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Objective: To explore the use of ChatGPT by educators and students in a medical school setting.

Method: This study used the public version of ChatGPT launched by OpenAI on November 30, 2022 (https://openai.com/blog/chatgpt/). We employed prompts to ask ChatGPT to 1) generate a content outline for a session on the topics of cholesterol, lipoproteins, and hyperlipidemia for medical students; 2) produce a list of learning objectives for the session; and 3) write assessment questions with and without clinical vignettes related to the identified learning objectives. We assessed the responses by ChatGPT for accuracy and reliability to determine the potential of the chatbot as an aid to educators and as a "know-it-all" medical information provider for students.

Results: ChatGPT can function as an aid to educators, but it is not yet suitable as a reliable information resource for educators and medical students.

Conclusion: ChatGPT can be a useful tool to assist medical educators in drafting course and session content outlines and create assessment questions. At the same time, caution must be taken as ChatGPT is prone to providing incorrect information; expert oversight and caution are necessary to ensure the information generated is accurate and beneficial to students. Therefore, it is premature for medical students to use the current version of ChatGPT as a "know-it-all" information provider. In the future, medical educators should work with programming experts to explore and grow the full potential of AI in medical education.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

ChatGPT作为医学教育辅助手段的探索性评估：谨慎使用。

目的：探讨教育工作者和学生在医学院环境中使用ChatGPT的情况。方法：本研究使用了OpenAI于2022年11月30日推出的ChatGPT的公共版本(https://openai.com/blog/chatgpt/)。我们使用提示要求ChatGPT：1）为医学生的胆固醇、脂蛋白和高脂血症主题课程生成内容大纲；2）为会议编制一份学习目标清单；以及3）写与所确定的学习目标相关的带有和不带有临床小插曲的评估问题。我们评估了ChatGPT的反应的准确性和可靠性，以确定聊天机器人作为教育工作者的辅助工具和学生的“无所不知”医疗信息提供者的潜力。结果：ChatGPT可以作为教育工作者的辅助工具，但它还不适合作为教育工作者和医学生的可靠信息资源。结论：ChatGPT是一个有用的工具，可以帮助医学教育工作者起草课程和课程内容大纲，并创建评估问题。同时，必须谨慎，因为ChatGPT容易提供不正确的信息；专家的监督和谨慎是必要的，以确保生成的信息是准确的，对学生有益。因此，医学生使用当前版本的ChatGPT作为“无所不知”的信息提供者还为时过早。未来，医学教育工作者应该与编程专家合作，探索和发展人工智能在医学教育中的全部潜力。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Medical Teacher 医学-卫生保健

CiteScore

7.80

自引率

8.50%

发文量

396

审稿时长

3-6 weeks

期刊介绍： Medical Teacher provides accounts of new teaching methods, guidance on structuring courses and assessing achievement, and serves as a forum for communication between medical teachers and those involved in general education. In particular, the journal recognizes the problems teachers have in keeping up-to-date with the developments in educational methods that lead to more effective teaching and learning at a time when the content of the curriculum—from medical procedures to policy changes in health care provision—is also changing. The journal features reports of innovation and research in medical education, case studies, survey articles, practical guidelines, reviews of current literature and book reviews. All articles are peer reviewed.