人工智能促进邓宁-克鲁格效应:评估 ChatGPT 对青少年特发性脊柱侧凸常见问题的回答。

IF 2.6 2区 医学 Q1 ORTHOPEDICS Journal of the American Academy of Orthopaedic Surgeons Pub Date : 2024-09-20 DOI:10.5435/JAAOS-D-24-00297
Lambert T Li, Jeremy M Adelstein, Margaret A Sinkler, R Justin Mistovich
{"title":"人工智能促进邓宁-克鲁格效应:评估 ChatGPT 对青少年特发性脊柱侧凸常见问题的回答。","authors":"Lambert T Li, Jeremy M Adelstein, Margaret A Sinkler, R Justin Mistovich","doi":"10.5435/JAAOS-D-24-00297","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Patients have long turned to the Internet for answers to common medical questions. As the ability to access information evolves beyond standard search engines, patients with adolescent idiopathic scoliosis (AIS) and their parents may use artificial intelligence chatbots such as ChatGPT as a new source of information.</p><p><strong>Methods: </strong>Ten frequently asked questions regarding AIS were posed to ChatGPT. The accuracy and adequacy of the responses were graded as excellent not requiring clarification, satisfactory requiring minimal clarification, satisfactory requiring moderate clarification, and unsatisfactory requiring substantial clarification.</p><p><strong>Results: </strong>ChatGPT gave one response that was excellent not requiring clarification, four responses that were satisfactory requiring minimal clarification, three responses that were satisfactory requiring moderate clarification, and two responses that were unsatisfactory requiring substantial clarification, with information about higher level, more complex areas of discussion such as surgical options being less accurate.</p><p><strong>Conclusion: </strong>ChatGPT provides answers to FAQs about AIS that were generally accurate, although correction was needed on specific surgical treatments. Patients may be at risk of developing a Dunning-Kruger effect by proxy from the superficial and sometimes inaccurate information provided by ChatGPT on more complex aspects of AIS.</p>","PeriodicalId":51098,"journal":{"name":"Journal of the American Academy of Orthopaedic Surgeons","volume":" ","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Artificial Intelligence Promotes the Dunning Kruger Effect: Evaluating ChatGPT Answers to Frequently Asked Questions About Adolescent Idiopathic Scoliosis.\",\"authors\":\"Lambert T Li, Jeremy M Adelstein, Margaret A Sinkler, R Justin Mistovich\",\"doi\":\"10.5435/JAAOS-D-24-00297\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Patients have long turned to the Internet for answers to common medical questions. As the ability to access information evolves beyond standard search engines, patients with adolescent idiopathic scoliosis (AIS) and their parents may use artificial intelligence chatbots such as ChatGPT as a new source of information.</p><p><strong>Methods: </strong>Ten frequently asked questions regarding AIS were posed to ChatGPT. The accuracy and adequacy of the responses were graded as excellent not requiring clarification, satisfactory requiring minimal clarification, satisfactory requiring moderate clarification, and unsatisfactory requiring substantial clarification.</p><p><strong>Results: </strong>ChatGPT gave one response that was excellent not requiring clarification, four responses that were satisfactory requiring minimal clarification, three responses that were satisfactory requiring moderate clarification, and two responses that were unsatisfactory requiring substantial clarification, with information about higher level, more complex areas of discussion such as surgical options being less accurate.</p><p><strong>Conclusion: </strong>ChatGPT provides answers to FAQs about AIS that were generally accurate, although correction was needed on specific surgical treatments. Patients may be at risk of developing a Dunning-Kruger effect by proxy from the superficial and sometimes inaccurate information provided by ChatGPT on more complex aspects of AIS.</p>\",\"PeriodicalId\":51098,\"journal\":{\"name\":\"Journal of the American Academy of Orthopaedic Surgeons\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the American Academy of Orthopaedic Surgeons\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.5435/JAAOS-D-24-00297\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ORTHOPEDICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Academy of Orthopaedic Surgeons","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.5435/JAAOS-D-24-00297","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0

摘要

介绍:长期以来,患者一直在互联网上寻找常见医疗问题的答案。随着获取信息的能力超越了标准搜索引擎,青少年特发性脊柱侧弯症(AIS)患者及其家长可以使用人工智能聊天机器人(如 ChatGPT)作为新的信息来源:方法:向 ChatGPT 提出了 10 个有关 AIS 的常见问题。回答的准确性和充分性被分为不需要澄清的优秀、需要少量澄清的满意、需要适度澄清的满意和需要大量澄清的不满意:结果:ChatGPT 提供了一个不需要澄清的优秀回复,四个需要最低程度澄清的满意回复,三个需要中等程度澄清的满意回复,两个需要实质性澄清的不满意回复,其中关于更高层次、更复杂的讨论领域(如手术方案)的信息准确性较低:结论:ChatGPT 提供的有关 AIS 的常见问题答案总体上是准确的,但在具体的手术治疗方法上还需要修正。由于 ChatGPT 提供的有关 AIS 更复杂方面的信息过于肤浅,有时甚至不准确,因此患者可能会有产生邓宁-克鲁格效应的风险。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Artificial Intelligence Promotes the Dunning Kruger Effect: Evaluating ChatGPT Answers to Frequently Asked Questions About Adolescent Idiopathic Scoliosis.

Introduction: Patients have long turned to the Internet for answers to common medical questions. As the ability to access information evolves beyond standard search engines, patients with adolescent idiopathic scoliosis (AIS) and their parents may use artificial intelligence chatbots such as ChatGPT as a new source of information.

Methods: Ten frequently asked questions regarding AIS were posed to ChatGPT. The accuracy and adequacy of the responses were graded as excellent not requiring clarification, satisfactory requiring minimal clarification, satisfactory requiring moderate clarification, and unsatisfactory requiring substantial clarification.

Results: ChatGPT gave one response that was excellent not requiring clarification, four responses that were satisfactory requiring minimal clarification, three responses that were satisfactory requiring moderate clarification, and two responses that were unsatisfactory requiring substantial clarification, with information about higher level, more complex areas of discussion such as surgical options being less accurate.

Conclusion: ChatGPT provides answers to FAQs about AIS that were generally accurate, although correction was needed on specific surgical treatments. Patients may be at risk of developing a Dunning-Kruger effect by proxy from the superficial and sometimes inaccurate information provided by ChatGPT on more complex aspects of AIS.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.10
自引率
6.20%
发文量
529
审稿时长
4-8 weeks
期刊介绍: The Journal of the American Academy of Orthopaedic Surgeons was established in the fall of 1993 by the Academy in response to its membership’s demand for a clinical review journal. Two issues were published the first year, followed by six issues yearly from 1994 through 2004. In September 2005, JAAOS began publishing monthly issues. Each issue includes richly illustrated peer-reviewed articles focused on clinical diagnosis and management. Special features in each issue provide commentary on developments in pharmacotherapeutics, materials and techniques, and computer applications.
期刊最新文献
The 2024 Kappa Delta and OREF Awards. The 2024 Kappa Delta Young Investigator Award: Leveraging Insights From Development to Improve Adult Repair: Hedgehog Signaling as a Master Regulator of Enthesis Fibrocartilage Formation. The Role of Amino Acid Supplementation in Orthopaedic Surgery: Erratum. Risk Factors of Failure to Discharge Before "Two Midnights" in Outpatient-Designated Total Hip Arthroplasty. Cost Difference in Performing Total Knee Arthroplasty at Ambulatory Surgical Centers Compared With Hospital-Based Outpatient Departments: Observational Study.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1