Patrick P Nian, Jayson Saleet, Matthew Magruder, Ian J Wellington, Jack Choueka, John K Houten, Ahmed Saleh, Afshin E Razi, Mitchell K Ng
{"title":"ChatGPT as a Source of Patient Information for Lumbar Spinal Fusion and Laminectomy: A Comparative Analysis Against Google Web Search.","authors":"Patrick P Nian, Jayson Saleet, Matthew Magruder, Ian J Wellington, Jack Choueka, John K Houten, Ahmed Saleh, Afshin E Razi, Mitchell K Ng","doi":"10.1097/BSD.0000000000001582","DOIUrl":null,"url":null,"abstract":"<p><strong>Study design: </strong>Retrospective Observational Study.</p><p><strong>Objective: </strong>The objective of this study was to assess the utility of ChatGPT, an artificial intelligence chatbot, in providing patient information for lumbar spinal fusion and lumbar laminectomy in comparison with the Google search engine.</p><p><strong>Summary of background data: </strong>ChatGPT, an artificial intelligence chatbot with seemingly unlimited functionality, may present an alternative to a Google web search for patients seeking information about medical questions. With widespread misinformation and suboptimal quality of online health information, it is imperative to assess ChatGPT as a resource for this purpose.</p><p><strong>Methods: </strong>The first 10 frequently asked questions (FAQs) related to the search terms \"lumbar spinal fusion\" and \"lumbar laminectomy\" were extracted from Google and ChatGPT. Responses to shared questions were compared regarding length and readability, using the Flesch Reading Ease score and Flesch-Kincaid Grade Level. Numerical FAQs from Google were replicated in ChatGPT.</p><p><strong>Results: </strong>Two of 10 (20%) questions for both lumbar spinal fusion and lumbar laminectomy were asked similarly between ChatGPT and Google. Compared with Google, ChatGPT's responses were lengthier (340.0 vs. 159.3 words) and of lower readability (Flesch Reading Ease score: 34.0 vs. 58.2; Flesch-Kincaid grade level: 11.6 vs. 8.8). Subjectively, we evaluated these responses to be accurate and adequately nonspecific. Each response concluded with a recommendation to discuss further with a health care provider. Over half of the numerical questions from Google produced a varying or nonnumerical response in ChatGPT.</p><p><strong>Conclusions: </strong>FAQs and responses regarding lumbar spinal fusion and lumbar laminectomy were highly variable between Google and ChatGPT. While ChatGPT may be able to produce relatively accurate responses in select questions, its role remains as a supplement or starting point to a consultation with a physician, not as a replacement, and should be taken with caution until its functionality can be validated.</p>","PeriodicalId":10457,"journal":{"name":"Clinical Spine Surgery","volume":" ","pages":"E394-E403"},"PeriodicalIF":1.6000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Spine Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/BSD.0000000000001582","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/2/20 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Study design: Retrospective Observational Study.
Objective: The objective of this study was to assess the utility of ChatGPT, an artificial intelligence chatbot, in providing patient information for lumbar spinal fusion and lumbar laminectomy in comparison with the Google search engine.
Summary of background data: ChatGPT, an artificial intelligence chatbot with seemingly unlimited functionality, may present an alternative to a Google web search for patients seeking information about medical questions. With widespread misinformation and suboptimal quality of online health information, it is imperative to assess ChatGPT as a resource for this purpose.
Methods: The first 10 frequently asked questions (FAQs) related to the search terms "lumbar spinal fusion" and "lumbar laminectomy" were extracted from Google and ChatGPT. Responses to shared questions were compared regarding length and readability, using the Flesch Reading Ease score and Flesch-Kincaid Grade Level. Numerical FAQs from Google were replicated in ChatGPT.
Results: Two of 10 (20%) questions for both lumbar spinal fusion and lumbar laminectomy were asked similarly between ChatGPT and Google. Compared with Google, ChatGPT's responses were lengthier (340.0 vs. 159.3 words) and of lower readability (Flesch Reading Ease score: 34.0 vs. 58.2; Flesch-Kincaid grade level: 11.6 vs. 8.8). Subjectively, we evaluated these responses to be accurate and adequately nonspecific. Each response concluded with a recommendation to discuss further with a health care provider. Over half of the numerical questions from Google produced a varying or nonnumerical response in ChatGPT.
Conclusions: FAQs and responses regarding lumbar spinal fusion and lumbar laminectomy were highly variable between Google and ChatGPT. While ChatGPT may be able to produce relatively accurate responses in select questions, its role remains as a supplement or starting point to a consultation with a physician, not as a replacement, and should be taken with caution until its functionality can be validated.
期刊介绍：
Clinical Spine Surgery is the ideal journal for the busy practicing spine surgeon or trainee, as it is the only journal necessary to keep up to date with new clinical research and surgical techniques. Readers get to watch leaders in the field debate controversial topics in a new controversies section, and gain access to evidence-based reviews of important pathologies in the systematic reviews section. The journal features a surgical technique complete with a video, and a tips and tricks section that allows surgeons to review the important steps prior to a complex procedure.
Clinical Spine Surgery provides readers with primary research studies, specifically level 1, 2 and 3 studies, ensuring that articles that may actually change a surgeon’s practice will be read and published. Each issue includes a brief article that will help a surgeon better understand the business of healthcare, as well as an article that will help a surgeon understand how to interpret increasingly complex research methodology. Clinical Spine Surgery is your single source for up-to-date, evidence-based recommendations for spine care.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
