ChatGPT and Patient Information in Nuclear Medicine: GPT-3.5 Versus GPT-4.

IF 1 Q4 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING Journal of nuclear medicine technology Pub Date : 2023-12-05 DOI:10.2967/jnmt.123.266151
Geoff Currie, Stephanie Robbie, Peter Tually
{"title":"ChatGPT and Patient Information in Nuclear Medicine: GPT-3.5 Versus GPT-4.","authors":"Geoff Currie, Stephanie Robbie, Peter Tually","doi":"10.2967/jnmt.123.266151","DOIUrl":null,"url":null,"abstract":"<p><p>The GPT-3.5-powered ChatGPT was released in late November 2022 powered by the generative pretrained transformer (GPT) version 3.5. It has emerged as a readily accessible source of patient information ahead of medical procedures. Although ChatGPT has purported benefits for supporting patient education and information, actual capability has not been evaluated. Moreover, the March 2023 emergence of paid subscription access to GPT-4 promises further enhanced capabilities requiring evaluation. <b>Methods:</b> ChatGPT was used to generate patient information sheets suitable for gaining informed consent for 7 common procedures in nuclear medicine. Responses were generated independently for both GPT-3.5 and GPT-4 architectures. Specific procedures were selected that had a long-standing history of use to avoid any bias associated with the September 2021 learning cutoff that constrains both GPT-3.5 and GPT-4 architectures. Each information sheet was independently evaluated by 3 expert assessors and ranked on the basis of accuracy, appropriateness, currency, and fitness for purpose. <b>Results:</b> ChatGPT powered by GPT-3.5 provided patient information that was appropriate in terms of being patient-facing but lacked accuracy and currency and omitted important information. GPT-3.5 produced patient information deemed not fit for the purpose. GPT-4 provided patient information enhanced across appropriateness, accuracy, and currency, despite some omission of information. GPT-4 produced patient information that was largely fit for the purpose. <b>Conclusion:</b> Although ChatGPT powered by GPT-3.5 is accessible and provides plausible patient information, inaccuracies and omissions present a risk to patients and informed consent. Conversely, GPT-4 is more accurate and fit for the purpose but, at the time of writing, was available only through a paid subscription.</p>","PeriodicalId":16548,"journal":{"name":"Journal of nuclear medicine technology","volume":null,"pages":null},"PeriodicalIF":1.0000,"publicationDate":"2023-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of nuclear medicine technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2967/jnmt.123.266151","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 2

Abstract

The GPT-3.5-powered ChatGPT was released in late November 2022 powered by the generative pretrained transformer (GPT) version 3.5. It has emerged as a readily accessible source of patient information ahead of medical procedures. Although ChatGPT has purported benefits for supporting patient education and information, actual capability has not been evaluated. Moreover, the March 2023 emergence of paid subscription access to GPT-4 promises further enhanced capabilities requiring evaluation. Methods: ChatGPT was used to generate patient information sheets suitable for gaining informed consent for 7 common procedures in nuclear medicine. Responses were generated independently for both GPT-3.5 and GPT-4 architectures. Specific procedures were selected that had a long-standing history of use to avoid any bias associated with the September 2021 learning cutoff that constrains both GPT-3.5 and GPT-4 architectures. Each information sheet was independently evaluated by 3 expert assessors and ranked on the basis of accuracy, appropriateness, currency, and fitness for purpose. Results: ChatGPT powered by GPT-3.5 provided patient information that was appropriate in terms of being patient-facing but lacked accuracy and currency and omitted important information. GPT-3.5 produced patient information deemed not fit for the purpose. GPT-4 provided patient information enhanced across appropriateness, accuracy, and currency, despite some omission of information. GPT-4 produced patient information that was largely fit for the purpose. Conclusion: Although ChatGPT powered by GPT-3.5 is accessible and provides plausible patient information, inaccuracies and omissions present a risk to patients and informed consent. Conversely, GPT-4 is more accurate and fit for the purpose but, at the time of writing, was available only through a paid subscription.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
核医学中的ChatGPT与患者信息:GPT-3.5 vs GPT-4。
基于GPT-3.5的ChatGPT于2022年11月底发布,由生成式预训练变压器(GPT) 3.5版本提供支持。它已成为在医疗程序之前易于获取的患者信息来源。尽管ChatGPT声称在支持患者教育和信息方面有好处,但实际能力尚未得到评估。此外,2023年3月出现的GPT-4付费订阅访问承诺进一步增强需要评估的功能。方法:采用ChatGPT生成适用于核医学7种常用程序知情同意的患者信息表。分别针对GPT-3.5和GPT-4架构独立生成响应。我们选择了具有长期使用历史的特定程序,以避免与2021年9月的学习截止日期相关的任何偏差,该截止日期限制了GPT-3.5和GPT-4架构。每个信息表由3位专家评估人员独立评估,并根据准确性、适当性、适用性和适用性进行排名。结果:基于GPT-3.5的ChatGPT提供的患者信息在面向患者方面是适当的,但缺乏准确性和时效性,遗漏了重要信息。GPT-3.5产生的患者信息被认为不符合目的。尽管有一些信息遗漏,GPT-4提供的患者信息在适当性、准确性和时效性方面得到了增强。GPT-4产生的患者信息在很大程度上符合目的。结论:尽管基于GPT-3.5的ChatGPT是可访问的,并且提供了合理的患者信息,但不准确和遗漏对患者和知情同意存在风险。相反,GPT-4更准确,更适合这一目的,但在撰写本文时,只能通过付费订阅获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of nuclear medicine technology
Journal of nuclear medicine technology RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING-
CiteScore
1.90
自引率
15.40%
发文量
57
期刊最新文献
A Rare Case of Orbital Metastasis from Invasive Lobular Carcinoma: Challenges of 18F-FDG PET/CT and the Search for Consensus on Imaging. Brain Imaging: Amyloid-β PET. Gender and Ethnicity Bias of Text-to-Image Generative Artificial Intelligence in Medical Imaging, Part 1: Preliminary Evaluation. Gender and Ethnicity Bias of Text-to-Image Generative Artificial Intelligence in Medical Imaging, Part 2: Analysis of DALL-E 3. Comment Regarding "Vapocoolant Analgesia for Breast Lymphoscintigraphy: A Prospective Clinical Trial".
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1