Evaluating the Use of ChatGPT to Accurately Simplify Patient-centered Information about Breast Cancer Prevention and Screening.

IF 5.6 Q1 ONCOLOGY Radiology. Imaging cancer Pub Date : 2024-03-01 DOI:10.1148/rycan.230086
Hana L Haver, Anuj K Gupta, Emily B Ambinder, Manisha Bahl, Eniola T Oluyemi, Jean Jeudy, Paul H Yi
{"title":"Evaluating the Use of ChatGPT to Accurately Simplify Patient-centered Information about Breast Cancer Prevention and Screening.","authors":"Hana L Haver, Anuj K Gupta, Emily B Ambinder, Manisha Bahl, Eniola T Oluyemi, Jean Jeudy, Paul H Yi","doi":"10.1148/rycan.230086","DOIUrl":null,"url":null,"abstract":"<p><p>Purpose To evaluate the use of ChatGPT as a tool to simplify answers to common questions about breast cancer prevention and screening. Materials and Methods In this retrospective, exploratory study, ChatGPT was requested to simplify responses to 25 questions about breast cancer to a sixth-grade reading level in March and August 2023. Simplified responses were evaluated for clinical appropriateness. All original and simplified responses were assessed for reading ease on the Flesch Reading Ease Index and for readability on five scales: Flesch-Kincaid Grade Level, Gunning Fog Index, Coleman-Liau Index, Automated Readability Index, and the Simple Measure of Gobbledygook (ie, SMOG) Index. Mean reading ease, readability, and word count were compared between original and simplified responses using paired <i>t</i> tests. McNemar test was used to compare the proportion of responses with adequate reading ease (score of 60 or greater) and readability (sixth-grade level). Results ChatGPT improved mean reading ease (original responses, 46 vs simplified responses, 70; <i>P</i> < .001) and readability (original, grade 13 vs simplified, grade 8.9; <i>P</i> < .001) and decreased word count (original, 193 vs simplified, 173; <i>P</i> < .001). Ninety-two percent (23 of 25) of simplified responses were considered clinically appropriate. All 25 (100%) simplified responses met criteria for adequate reading ease, compared with only two of 25 original responses (<i>P</i> < .001). Two of the 25 simplified responses (8%) met criteria for adequate readability. Conclusion ChatGPT simplified answers to common breast cancer screening and prevention questions by improving the readability by four grade levels, though the potential to produce incorrect information necessitates physician oversight when using this tool. <b>Keywords:</b> Mammography, Screening, Informatics, Breast, Education, Health Policy and Practice, Oncology, Technology Assessment <i>Supplemental material is available for this article.</i> © RSNA, 2023.</p>","PeriodicalId":20786,"journal":{"name":"Radiology. Imaging cancer","volume":null,"pages":null},"PeriodicalIF":5.6000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10988327/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Radiology. Imaging cancer","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1148/rycan.230086","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose To evaluate the use of ChatGPT as a tool to simplify answers to common questions about breast cancer prevention and screening. Materials and Methods In this retrospective, exploratory study, ChatGPT was requested to simplify responses to 25 questions about breast cancer to a sixth-grade reading level in March and August 2023. Simplified responses were evaluated for clinical appropriateness. All original and simplified responses were assessed for reading ease on the Flesch Reading Ease Index and for readability on five scales: Flesch-Kincaid Grade Level, Gunning Fog Index, Coleman-Liau Index, Automated Readability Index, and the Simple Measure of Gobbledygook (ie, SMOG) Index. Mean reading ease, readability, and word count were compared between original and simplified responses using paired t tests. McNemar test was used to compare the proportion of responses with adequate reading ease (score of 60 or greater) and readability (sixth-grade level). Results ChatGPT improved mean reading ease (original responses, 46 vs simplified responses, 70; P < .001) and readability (original, grade 13 vs simplified, grade 8.9; P < .001) and decreased word count (original, 193 vs simplified, 173; P < .001). Ninety-two percent (23 of 25) of simplified responses were considered clinically appropriate. All 25 (100%) simplified responses met criteria for adequate reading ease, compared with only two of 25 original responses (P < .001). Two of the 25 simplified responses (8%) met criteria for adequate readability. Conclusion ChatGPT simplified answers to common breast cancer screening and prevention questions by improving the readability by four grade levels, though the potential to produce incorrect information necessitates physician oversight when using this tool. Keywords: Mammography, Screening, Informatics, Breast, Education, Health Policy and Practice, Oncology, Technology Assessment Supplemental material is available for this article. © RSNA, 2023.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
评估使用 ChatGPT 准确简化以患者为中心的乳腺癌预防和筛查信息。
目的 评估将 ChatGPT 用作简化乳腺癌预防和筛查常见问题答案的工具的使用情况。材料和方法 在这项回顾性探索研究中,要求 ChatGPT 在 2023 年 3 月和 8 月将 25 个有关乳腺癌问题的回答简化为六年级的阅读水平。对简化后的回答进行了临床适宜性评估。根据 Flesch 阅读容易程度指数和五个量表对所有原始和简化回复的阅读容易程度进行了评估:弗莱什-金凯德等级水平、古宁雾指数、科尔曼-利亚指数、自动可读性指数和简单拗口指数(即 SMOG)。使用配对 t 检验比较了原始答案和简化答案的平均阅读难易度、可读性和字数。McNemar 检验用于比较具有适当阅读难度(60 分或以上)和可读性(六年级水平)的答卷比例。结果 ChatGPT 提高了平均阅读难度(原始答案 46 分,简化答案 70 分;P < .001)和可读性(原始答案 13 级,简化答案 8.9 级;P < .001),减少了字数(原始答案 193 字,简化答案 173 字;P < .001)。92%的简化回复(25 份中的 23 份)被认为符合临床需要。所有 25 份(100%)简化答卷都符合足够易读性的标准,而 25 份原始答卷中只有 2 份符合标准(P < .001)。25 个简化回复中有两个(8%)符合充分易读性标准。结论 ChatGPT 简化了常见的乳腺癌筛查和预防问题的答案,将可读性提高了四个等级,但由于可能会产生错误信息,因此医生在使用该工具时有必要进行监督。关键词乳房 X 线照相术 筛查 信息学 乳腺癌 教育 卫生政策与实践 肿瘤学 技术评估 本文有补充材料。© RSNA, 2023.
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
5.00
自引率
2.30%
发文量
0
期刊最新文献
Multifrequency MR Elastography for Tumor Stiffness Outperforms Conventional Imaging and Clinical Variables in Determining Lymphovascular Space Invasion in Endometrial Cancer. Assessing the Value of 68Ga-FAPI PET/CT in Gastric Mucinous Adenocarcinoma or Signet Ring Cell Carcinoma. External Validation of a Previously Developed Deep Learning-based Prostate Lesion Detection Algorithm on Paired External and In-House Biparametric MRI Scans. Mathematical 3D Liver Model for Surgical versus Ablative Therapy Treatment Planning for Colorectal Liver Metastases: Recommendations from the COLLISION and COLDFIRE Trial Expert Panels. A New Acquisition Protocol for Optimized Dynamic Susceptibility Perfusion Imaging of Brain Tumors.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1