Appropriateness and Comprehensiveness of Using ChatGPT for Perioperative Patient Education in Thoracic Surgery in Different Language Contexts: Survey Study.

IF 1.9 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Interactive Journal of Medical Research Pub Date : 2023-08-14 DOI:10.2196/46900
Chen-Ye Shao, Hui Li, Xiao-Long Liu, Chang Li, Li-Qin Yang, Yue-Juan Zhang, Jing Luo, Jun Zhao
{"title":"Appropriateness and Comprehensiveness of Using ChatGPT for Perioperative Patient Education in Thoracic Surgery in Different Language Contexts: Survey Study.","authors":"Chen-Ye Shao,&nbsp;Hui Li,&nbsp;Xiao-Long Liu,&nbsp;Chang Li,&nbsp;Li-Qin Yang,&nbsp;Yue-Juan Zhang,&nbsp;Jing Luo,&nbsp;Jun Zhao","doi":"10.2196/46900","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>ChatGPT, a dialogue-based artificial intelligence language model, has shown promise in assisting clinical workflows and patient-clinician communication. However, there is a lack of feasibility assessments regarding its use for perioperative patient education in thoracic surgery.</p><p><strong>Objective: </strong>This study aimed to assess the appropriateness and comprehensiveness of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts.</p><p><strong>Methods: </strong>This pilot study was conducted in February 2023. A total of 37 questions focused on perioperative patient education in thoracic surgery were created based on guidelines and clinical experience. Two sets of inquiries were made to ChatGPT for each question, one in English and the other in Chinese. The responses generated by ChatGPT were evaluated separately by experienced thoracic surgical clinicians for appropriateness and comprehensiveness based on a hypothetical draft response to a patient's question on the electronic information platform. For a response to be qualified, it required at least 80% of reviewers to deem it appropriate and 50% to deem it comprehensive. Statistical analyses were performed using the unpaired chi-square test or Fisher exact test, with a significance level set at P<.05.</p><p><strong>Results: </strong>The set of 37 commonly asked questions covered topics such as disease information, diagnostic procedures, perioperative complications, treatment measures, disease prevention, and perioperative care considerations. In both the English and Chinese contexts, 34 (92%) out of 37 responses were qualified in terms of both appropriateness and comprehensiveness. The remaining 3 (8%) responses were unqualified in these 2 contexts. The unqualified responses primarily involved the diagnosis of disease symptoms and surgical-related complications symptoms. The reasons for determining the responses as unqualified were similar in both contexts. There was no statistically significant difference (34/37, 92% vs 34/37, 92%; P=.99) in the qualification rate between the 2 language sets.</p><p><strong>Conclusions: </strong>This pilot study demonstrates the potential feasibility of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts. ChatGPT is expected to enhance patient satisfaction, reduce anxiety, and improve compliance during the perioperative period. In the future, there will be remarkable potential application for using artificial intelligence, in conjunction with human review, for patient education and health consultation after patients have provided their informed consent.</p>","PeriodicalId":51757,"journal":{"name":"Interactive Journal of Medical Research","volume":null,"pages":null},"PeriodicalIF":1.9000,"publicationDate":"2023-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10463083/pdf/","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Interactive Journal of Medical Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/46900","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
引用次数: 3

Abstract

Background: ChatGPT, a dialogue-based artificial intelligence language model, has shown promise in assisting clinical workflows and patient-clinician communication. However, there is a lack of feasibility assessments regarding its use for perioperative patient education in thoracic surgery.

Objective: This study aimed to assess the appropriateness and comprehensiveness of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts.

Methods: This pilot study was conducted in February 2023. A total of 37 questions focused on perioperative patient education in thoracic surgery were created based on guidelines and clinical experience. Two sets of inquiries were made to ChatGPT for each question, one in English and the other in Chinese. The responses generated by ChatGPT were evaluated separately by experienced thoracic surgical clinicians for appropriateness and comprehensiveness based on a hypothetical draft response to a patient's question on the electronic information platform. For a response to be qualified, it required at least 80% of reviewers to deem it appropriate and 50% to deem it comprehensive. Statistical analyses were performed using the unpaired chi-square test or Fisher exact test, with a significance level set at P<.05.

Results: The set of 37 commonly asked questions covered topics such as disease information, diagnostic procedures, perioperative complications, treatment measures, disease prevention, and perioperative care considerations. In both the English and Chinese contexts, 34 (92%) out of 37 responses were qualified in terms of both appropriateness and comprehensiveness. The remaining 3 (8%) responses were unqualified in these 2 contexts. The unqualified responses primarily involved the diagnosis of disease symptoms and surgical-related complications symptoms. The reasons for determining the responses as unqualified were similar in both contexts. There was no statistically significant difference (34/37, 92% vs 34/37, 92%; P=.99) in the qualification rate between the 2 language sets.

Conclusions: This pilot study demonstrates the potential feasibility of using ChatGPT for perioperative patient education in thoracic surgery in both English and Chinese contexts. ChatGPT is expected to enhance patient satisfaction, reduce anxiety, and improve compliance during the perioperative period. In the future, there will be remarkable potential application for using artificial intelligence, in conjunction with human review, for patient education and health consultation after patients have provided their informed consent.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
不同语言背景下胸外科围手术期患者教育中ChatGPT的适宜性和全面性:调查研究。
背景:ChatGPT是一种基于对话的人工智能语言模型,在辅助临床工作流程和患者-临床医生沟通方面显示出前景。然而,缺乏对胸外科围手术期患者教育的可行性评估。目的:本研究旨在评估中英文胸外科围手术期患者教育中使用ChatGPT的适宜性和全面性。方法:本研究于2023年2月进行。根据指南和临床经验,编制了37个胸外科围手术期患者教育问题。每个问题都向ChatGPT进行了两组查询,一组用英文,另一组用中文。ChatGPT生成的回复由经验丰富的胸外科医生根据对电子信息平台上患者问题的假设回复草稿,分别评估其适当性和全面性。对于合格的回应,至少需要80%的审稿人认为它是适当的,50%的审稿人认为它是全面的。采用非配对卡方检验或Fisher精确检验进行统计分析,显著性水平为:37个常见问题涵盖疾病信息、诊断程序、围手术期并发症、治疗措施、疾病预防和围手术期护理注意事项等主题。在中英文语境中,37个回答中有34个(92%)在适当性和全面性方面都是合格的。其余3个(8%)回答在这两种情况下是不合格的。不合格反应主要涉及疾病症状和手术相关并发症症状的诊断。在这两种情况下,将答复确定为不合格的原因是相似的。差异无统计学意义(34/ 37,92% vs 34/ 37,92%;P=.99)。结论:本初步研究证明了在中英文背景下使用ChatGPT进行胸外科围手术期患者教育的潜在可行性。ChatGPT有望在围手术期提高患者满意度,减少焦虑,提高依从性。在未来,将人工智能与人类审查相结合,在患者提供知情同意后进行患者教育和健康咨询,将有显著的潜在应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Interactive Journal of Medical Research
Interactive Journal of Medical Research MEDICINE, RESEARCH & EXPERIMENTAL-
自引率
0.00%
发文量
45
审稿时长
12 weeks
期刊最新文献
Screening for Depression Using Natural Language Processing: Literature Review. Telemedicine for Patients With Systemic Lupus Erythematosus in a Publicly Funded Hospital System: Retrospective Study. Blended Psychological Therapy for the Treatment of Psychological Disorders in Adult Patients: Systematic Review and Meta-Analysis. Portuguese Version of the Oral Frailty Index-8: Instrument Validation Study. Correction: Automated Psychotherapy in a Spaceflight Environment: Advantages, Drawbacks, and Unknowns.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1