Patient preferences for carpal tunnel release education: a comparison of education materials from popular healthcare websites and ChatGPT

IF 0.9 4区医学 Q4 ORTHOPEDICS Hand Surgery & Rehabilitation Pub Date : 2025-02-01 DOI:10.1016/j.hansur.2024.102073

Nicholas B. Pohl, Omar H. Tarawneh, Evan Johnson, Daren Aita, Madeline Tadley, Daniel J. Fletcher

{"title":"Patient preferences for carpal tunnel release education: a comparison of education materials from popular healthcare websites and ChatGPT","authors":"Nicholas B. Pohl, Omar H. Tarawneh, Evan Johnson, Daren Aita, Madeline Tadley, Daniel J. Fletcher","doi":"10.1016/j.hansur.2024.102073","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>ChatGPT has been increasingly utilized to create, simplify, and revise hand surgery patient education materials. While significant research has examined the quality and readability of ChatGPT-derived hand surgery patient education, the patient perspective has not previously been evaluated. This study compared patient reported clarity and readability grades as well as patient preferences for carpal tunnel surgery educational information from medical education websites and ChatGPT.</div></div><div><h3>Methods</h3><div>Patients without a history of carpal tunnel release surgery at two orthopaedic hand surgery outpatient clinics were asked to complete an anonymous survey which gathered demographic information and included a blinded educational passage on carpal tunnel release surgery from ChatGPT, WebMD, or Mayo Clinic. Patients graded the blinded passages regarding clarity, readability, length, likeliness to recommend to others, and overall satisfaction with the education material.</div></div><div><h3>Results</h3><div>There were no significant differences in clarity (p = 0.682),readability (p = 0.328), or likeliness to recommend to others (p = 0.106) between the different educational sources. When stratified by age, younger patients (under 55) were more likely to recommend Mayo Clinic over other resources (p = 0.002). When further stratified to include only those who reported previously using websites for healthcare information, patients tended to have a higher likelihood of recommending Mayo Clinic compared to other sources, but this was not a statistically significant difference.</div></div><div><h3>Conclusions</h3><div>There were no differences in clarity, readability, or preference ratings between patient education materials that were produced by ChatGPT, WebMD and Mayo Clinic. However, while ChatGPT-generated materials are comparable in quality based on patient ratings, younger patients may still favor well-established sources for medical education. This information regarding patient preferences provides valuable insights for hand surgeons when selecting suitable educational resources for their patients.</div></div>","PeriodicalId":54301,"journal":{"name":"Hand Surgery & Rehabilitation","volume":"44 1","pages":"Article 102073"},"PeriodicalIF":0.9000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Hand Surgery & Rehabilitation","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2468122924005139","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ORTHOPEDICS","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction

ChatGPT has been increasingly utilized to create, simplify, and revise hand surgery patient education materials. While significant research has examined the quality and readability of ChatGPT-derived hand surgery patient education, the patient perspective has not previously been evaluated. This study compared patient reported clarity and readability grades as well as patient preferences for carpal tunnel surgery educational information from medical education websites and ChatGPT.

Methods

Patients without a history of carpal tunnel release surgery at two orthopaedic hand surgery outpatient clinics were asked to complete an anonymous survey which gathered demographic information and included a blinded educational passage on carpal tunnel release surgery from ChatGPT, WebMD, or Mayo Clinic. Patients graded the blinded passages regarding clarity, readability, length, likeliness to recommend to others, and overall satisfaction with the education material.

Results

There were no significant differences in clarity (p = 0.682),readability (p = 0.328), or likeliness to recommend to others (p = 0.106) between the different educational sources. When stratified by age, younger patients (under 55) were more likely to recommend Mayo Clinic over other resources (p = 0.002). When further stratified to include only those who reported previously using websites for healthcare information, patients tended to have a higher likelihood of recommending Mayo Clinic compared to other sources, but this was not a statistically significant difference.

Conclusions

There were no differences in clarity, readability, or preference ratings between patient education materials that were produced by ChatGPT, WebMD and Mayo Clinic. However, while ChatGPT-generated materials are comparable in quality based on patient ratings, younger patients may still favor well-established sources for medical education. This information regarding patient preferences provides valuable insights for hand surgeons when selecting suitable educational resources for their patients.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

标题：患者对腕管松解术教育的偏好：流行医疗保健网站和 ChatGPT 教育材料的比较。

ChatGPT已越来越多地用于创建、简化和修改手外科患者教育材料。虽然重要的研究已经检查了chatgpt衍生的手外科患者教育的质量和可读性，但患者的观点以前没有被评估过。本研究比较了患者报告的清晰度和可读性等级，以及患者对来自医学教育网站和ChatGPT的腕管手术教育信息的偏好。方法：在两家骨科手外科门诊没有腕管松解手术史的患者被要求完成一项匿名调查，该调查收集了人口统计信息，并包括ChatGPT、WebMD或Mayo诊所关于腕管松解手术的盲法教育文章。患者对盲法文章的清晰度、可读性、长度、向他人推荐的可能性以及对教育材料的总体满意度进行评分。结果：不同教育资源在清晰度（p = 0.682）、可读性（p = 0.328）和向他人推荐的可能性（p = 0.106）上均无显著差异。当按年龄分层时，年轻患者（55岁以下）更有可能推荐梅奥诊所而不是其他资源（p = 0.002）。当进一步分层，只包括那些报告以前使用过网站的医疗保健信息，患者倾向于有更高的可能性推荐梅奥诊所与其他来源相比，但这并没有统计学上的显著差异。结论：ChatGPT、WebMD和Mayo诊所制作的患者教育材料在清晰度、可读性或偏好评级方面没有差异。然而，虽然chatgpt生成的材料在质量上与患者评分相当，但年轻患者可能仍然倾向于成熟的医学教育来源。这些关于患者偏好的信息为手外科医生为患者选择合适的教育资源提供了有价值的见解。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Hand Surgery & Rehabilitation Medicine-Surgery

CiteScore

1.70

自引率

27.30%

发文量

审稿时长

49 days

期刊介绍： As the official publication of the French, Belgian and Swiss Societies for Surgery of the Hand, as well as of the French Society of Rehabilitation of the Hand & Upper Limb, ''Hand Surgery and Rehabilitation'' - formerly named "Chirurgie de la Main" - publishes original articles, literature reviews, technical notes, and clinical cases. It is indexed in the main international databases (including Medline). Initially a platform for French-speaking hand surgeons, the journal will now publish its articles in English to disseminate its author''s scientific findings more widely. The journal also includes a biannual supplement in French, the monograph of the French Society for Surgery of the Hand, where comprehensive reviews in the fields of hand, peripheral nerve and upper limb surgery are presented. Organe officiel de la Société française de chirurgie de la main, de la Société française de Rééducation de la main (SFRM-GEMMSOR), de la Société suisse de chirurgie de la main et du Belgian Hand Group, indexée dans les grandes bases de données internationales (Medline, Embase, Pascal, Scopus), Hand Surgery and Rehabilitation - anciennement titrée Chirurgie de la main - publie des articles originaux, des revues de la littérature, des notes techniques, des cas clinique. Initialement plateforme d''expression francophone de la spécialité, la revue s''oriente désormais vers l''anglais pour devenir une référence scientifique et de formation de la spécialité en France et en Europe. Avec 6 publications en anglais par an, la revue comprend également un supplément biannuel, la monographie du GEM, où sont présentées en français, des mises au point complètes dans les domaines de la chirurgie de la main, des nerfs périphériques et du membre supérieur.