{"title":"Assessment of ChatGPT generated educational material for head and neck surgery counseling","authors":"Lana Mnajjed , Rusha J. Patel","doi":"10.1016/j.amjoto.2024.104410","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>ChatGPT is becoming very popular as an information source for the public. The adequacy of ChatGPT generated patient counseling material has not yet been extensively assessed.</p></div><div><h3>Methods</h3><p>ChatGPT was presented with perioperative counseling and complication questions regarding five different procedure, and accuracy of responses was assessed. The chat was then asked to present an explanation of each procedure, and quality of the responses were compared to online educational material.</p></div><div><h3>Results</h3><p>ChatGPT responses were comprehensive when discussing counseling points commonly discussed by a provider prior to a procedure. Responses to questions on surgical complications were less accurate and comprehensive. In comparison to online educational material, ChatGPT scored at or above the median SAM and PEMAT scores for all procedures.</p></div><div><h3>Conclusions</h3><p>ChatGPT did well addressing basic counseling points during the perioperative period, although it did not perform as well when addressing surgical complications. Chat response quality was comparable to currently available online educational material.</p></div>","PeriodicalId":7591,"journal":{"name":"American Journal of Otolaryngology","volume":"45 5","pages":"Article 104410"},"PeriodicalIF":1.8000,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Otolaryngology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0196070924001960","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OTORHINOLARYNGOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background
ChatGPT is becoming very popular as an information source for the public. The adequacy of ChatGPT generated patient counseling material has not yet been extensively assessed.
Methods
ChatGPT was presented with perioperative counseling and complication questions regarding five different procedure, and accuracy of responses was assessed. The chat was then asked to present an explanation of each procedure, and quality of the responses were compared to online educational material.
Results
ChatGPT responses were comprehensive when discussing counseling points commonly discussed by a provider prior to a procedure. Responses to questions on surgical complications were less accurate and comprehensive. In comparison to online educational material, ChatGPT scored at or above the median SAM and PEMAT scores for all procedures.
Conclusions
ChatGPT did well addressing basic counseling points during the perioperative period, although it did not perform as well when addressing surgical complications. Chat response quality was comparable to currently available online educational material.
期刊介绍：
Be fully informed about developments in otology, neurotology, audiology, rhinology, allergy, laryngology, speech science, bronchoesophagology, facial plastic surgery, and head and neck surgery. Featured sections include original contributions, grand rounds, current reviews, case reports and socioeconomics.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
