William J Hlavinka, Tarun R Sontam, Anuj Gupta, Brett J Croen, Mohammed S Abdullah, Casey J Humbyrd
{"title":"Are large language models a useful resource to address common patient concerns on hallux valgus? A readability analysis.","authors":"William J Hlavinka, Tarun R Sontam, Anuj Gupta, Brett J Croen, Mohammed S Abdullah, Casey J Humbyrd","doi":"10.1016/j.fas.2024.08.002","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>This study evaluates the accuracy and readability of Google, ChatGPT-3.5, and 4.0 (two versions of an artificial intelligence model) responses to common questions regarding bunion surgery.</p><p><strong>Methods: </strong>A Google search of \"bunionectomy\" was performed, and the first ten questions under \"People Also Ask\" were recorded. ChatGPT-3.5 and 4.0 were asked these ten questions individually, and their answers were analyzed using the Flesch-Kincaid Reading Ease and Gunning-Fog Level algorithms.</p><p><strong>Results: </strong>When compared to Google, ChatGPT-3.5 and 4.0 had a larger word count with 315 ± 39 words (p < .0001) and 294 ± 39 words (p < .0001), respectively. A significant difference was found between ChatGPT-3.5 and 4.0 compared to Google using Flesch-Kincaid Reading Ease (p < .0001).</p><p><strong>Conclusions: </strong>Our findings demonstrate that ChatGPT provided significantly lengthier responses than Google and there was a significant difference in reading ease. Both platforms exceeded the seventh to eighth-grade reading level of the U.S.</p><p><strong>Population: </strong></p><p><strong>Level of evidence: </strong>N/A.</p>","PeriodicalId":48743,"journal":{"name":"Foot and Ankle Surgery","volume":null,"pages":null},"PeriodicalIF":1.9000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Foot and Ankle Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.fas.2024.08.002","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: This study evaluates the accuracy and readability of Google, ChatGPT-3.5, and 4.0 (two versions of an artificial intelligence model) responses to common questions regarding bunion surgery.
Methods: A Google search of "bunionectomy" was performed, and the first ten questions under "People Also Ask" were recorded. ChatGPT-3.5 and 4.0 were asked these ten questions individually, and their answers were analyzed using the Flesch-Kincaid Reading Ease and Gunning-Fog Level algorithms.
Results: When compared to Google, ChatGPT-3.5 and 4.0 had a larger word count with 315 ± 39 words (p < .0001) and 294 ± 39 words (p < .0001), respectively. A significant difference was found between ChatGPT-3.5 and 4.0 compared to Google using Flesch-Kincaid Reading Ease (p < .0001).
Conclusions: Our findings demonstrate that ChatGPT provided significantly lengthier responses than Google and there was a significant difference in reading ease. Both platforms exceeded the seventh to eighth-grade reading level of the U.S.
期刊介绍：
Foot and Ankle Surgery is essential reading for everyone interested in the foot and ankle and its disorders. The approach is broad and includes all aspects of the subject from basic science to clinical management. Problems of both children and adults are included, as is trauma and chronic disease. Foot and Ankle Surgery is the official journal of European Foot and Ankle Society.
The aims of this journal are to promote the art and science of ankle and foot surgery, to publish peer-reviewed research articles, to provide regular reviews by acknowledged experts on common problems, and to provide a forum for discussion with letters to the Editors. Reviews of books are also published. Papers are invited for possible publication in Foot and Ankle Surgery on the understanding that the material has not been published elsewhere or accepted for publication in another journal and does not infringe prior copyright.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
