Enhancing Diagnostic Accuracy and Efficiency with GPT-4-Generated Structured Reports: A Comprehensive Study

IF 1.6 4区 医学 Q4 ENGINEERING, BIOMEDICAL Journal of Medical and Biological Engineering Pub Date : 2024-02-22 DOI:10.1007/s40846-024-00849-9
{"title":"Enhancing Diagnostic Accuracy and Efficiency with GPT-4-Generated Structured Reports: A Comprehensive Study","authors":"","doi":"10.1007/s40846-024-00849-9","DOIUrl":null,"url":null,"abstract":"<h3>Abstract</h3> <span> <h3>Purpose</h3> <p>Interpreting free-text contrast-enhanced ultrasound (CEUS) reports can lead to diagnostic errors and prolonged patient waiting times. Generative Pre-trained Transformer (GPT)-4, a state-of-the-art natural language processing model, may improve diagnostic efficiency by generating structured medical reports from unstructured data. This experimental study investigates the impact of GPT-4-generated structured reports on doctors’ diagnostic efficiency in liver nodule CEUS examinations, comparing their performance with that of doctors using conventional free-text reports.</p> </span> <span> <h3>Methods</h3> <p>A total of 159 CEUS reports were collected and structured using GPT-4, and 30 doctors of varying experience levels participated in the study. The performance of doctors using free-text reports was compared with those using structured reports in terms of diagnostic efficiency and accuracy.</p> </span> <span> <h3>Results</h3> <p>The study revealed significant improvements in diagnostic efficiency (20 vs. 17 min) and accuracy (73% vs. 79%) for doctors using GPT-4-generated structured reports compared to traditional free-text reports. This trend was consistent across all experience levels. Qualitative insights from frontline ultrasound doctors provided valuable feedback on the strengths and weaknesses of GPT-4-generated structured reports.</p> </span> <span> <h3>Conclusion</h3> <p>GPT-4-generated structured reports show potential in enhancing diagnostic efficiency and accuracy in liver nodule CEUS examinations. Despite certain limitations, refining GPT-4 or similar natural language processing models in future iterations can yield greater benefits. Future research should explore broader clinical applications and investigate GPT models and natural language processing techniques in areas such as decision support, patient communication, and medical research, ultimately contributing to improved patient care and healthcare outcomes.</p> </span> <span> <h3>Clinical Relevance</h3> <p>This study suggests that GPT-4-generated structured reports enhance diagnostic efficiency and accuracy in liver nodule CEUS examinations, potentially improving patient care and outcomes by reducing diagnostic errors and patient wait times.</p> </span>","PeriodicalId":50133,"journal":{"name":"Journal of Medical and Biological Engineering","volume":"10 1","pages":""},"PeriodicalIF":1.6000,"publicationDate":"2024-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical and Biological Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s40846-024-00849-9","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose

Interpreting free-text contrast-enhanced ultrasound (CEUS) reports can lead to diagnostic errors and prolonged patient waiting times. Generative Pre-trained Transformer (GPT)-4, a state-of-the-art natural language processing model, may improve diagnostic efficiency by generating structured medical reports from unstructured data. This experimental study investigates the impact of GPT-4-generated structured reports on doctors’ diagnostic efficiency in liver nodule CEUS examinations, comparing their performance with that of doctors using conventional free-text reports.

Methods

A total of 159 CEUS reports were collected and structured using GPT-4, and 30 doctors of varying experience levels participated in the study. The performance of doctors using free-text reports was compared with those using structured reports in terms of diagnostic efficiency and accuracy.

Results

The study revealed significant improvements in diagnostic efficiency (20 vs. 17 min) and accuracy (73% vs. 79%) for doctors using GPT-4-generated structured reports compared to traditional free-text reports. This trend was consistent across all experience levels. Qualitative insights from frontline ultrasound doctors provided valuable feedback on the strengths and weaknesses of GPT-4-generated structured reports.

Conclusion

GPT-4-generated structured reports show potential in enhancing diagnostic efficiency and accuracy in liver nodule CEUS examinations. Despite certain limitations, refining GPT-4 or similar natural language processing models in future iterations can yield greater benefits. Future research should explore broader clinical applications and investigate GPT models and natural language processing techniques in areas such as decision support, patient communication, and medical research, ultimately contributing to improved patient care and healthcare outcomes.

Clinical Relevance

This study suggests that GPT-4-generated structured reports enhance diagnostic efficiency and accuracy in liver nodule CEUS examinations, potentially improving patient care and outcomes by reducing diagnostic errors and patient wait times.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用 GPT-4 生成的结构化报告提高诊断准确性和效率:综合研究
摘要 目的 对自由文本对比增强超声(CEUS)报告的解读可能会导致诊断错误和延长患者等待时间。生成式预训练转换器(GPT)-4 是一种最先进的自然语言处理模型,可通过从非结构化数据生成结构化医疗报告来提高诊断效率。本实验研究探讨了 GPT-4 生成的结构化报告对医生在肝结节 CEUS 检查中诊断效率的影响,并比较了他们与使用传统自由文本报告的医生的表现。 方法 共收集了 159 份 CEUS 报告,并使用 GPT-4 进行了结构化处理,30 名不同经验水平的医生参与了研究。比较了使用自由文本报告和使用结构化报告的医生在诊断效率和准确性方面的表现。 结果 研究显示,与传统的自由文本报告相比,使用 GPT-4 生成的结构化报告的医生在诊断效率(20 分钟对 17 分钟)和准确性(73% 对 79%)方面有明显提高。这一趋势在所有经验水平的医生中都是一致的。来自一线超声医生的定性见解为 GPT-4 生成的结构化报告的优缺点提供了宝贵的反馈意见。 结论 GPT-4 生成的结构化报告在提高肝结节 CEUS 检查的诊断效率和准确性方面显示出潜力。尽管存在一定的局限性,但在未来的迭代中完善 GPT-4 或类似的自然语言处理模型可以产生更大的效益。未来的研究应探索更广泛的临床应用,并研究 GPT 模型和自然语言处理技术在决策支持、患者沟通和医学研究等领域的应用,最终为改善患者护理和医疗效果做出贡献。 临床意义 本研究表明,GPT-4 生成的结构化报告可提高肝结节 CEUS 检查的诊断效率和准确性,通过减少诊断错误和患者等待时间来改善患者护理和治疗效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
4.30
自引率
5.00%
发文量
81
审稿时长
3 months
期刊介绍: The purpose of Journal of Medical and Biological Engineering, JMBE, is committed to encouraging and providing the standard of biomedical engineering. The journal is devoted to publishing papers related to clinical engineering, biomedical signals, medical imaging, bio-informatics, tissue engineering, and so on. Other than the above articles, any contributions regarding hot issues and technological developments that help reach the purpose are also included.
期刊最新文献
Influence of Different Stages of Post-Traumatic Elbow Joint Capsule Healing on Pronation Movement Attribute and Malignancy Analysis of Lung Nodule on Chest CT with Cause-and-Effect Logic Biomechanical Performance of Different Implant Spacings and Placement Angles in Partial Fixed Denture Prosthesis Restorations: A Finite Element Analysis Enhancing Myocardial Infarction Diagnosis: LSTM-based Deep Learning Approach Integrating Echocardiographic Wall Motion Analysis Investigation of Image Quality for Cuboid and Tapered Array microPET Systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1