{"title":"人工智能聊天机器人在回答日本植入式乳房再造实用指南临床问题中的表现。","authors":"Makoto Shiraishi, Yoshihiro Sowa, Koichi Tomita, Yasunobu Terao, Toshihiko Satake, Mayu Muto, Yuhei Morita, Shino Higai, Yoshihiro Toyohara, Yasue Kurokawa, Ataru Sunaga, Mutsumi Okazaki","doi":"10.1007/s00266-024-04515-y","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Artificial intelligence (AI) chatbots, including ChatGPT-4 (GPT-4) and Grok-1 (Grok), have been shown to be potentially useful in several medical fields, but have not been examined in plastic and aesthetic surgery. The aim of this study is to evaluate the responses of these AI chatbots for clinical questions (CQs) related to the guidelines for implant-based breast reconstruction (IBBR) published by the Japan Society of Plastic and Reconstructive Surgery (JSPRS) in 2021.</p><p><strong>Methods: </strong>CQs in the JSPRS guidelines were used as question sources. Responses from two AI chatbots, GPT-4 and Grok, were evaluated for accuracy, informativeness, and readability by five Japanese Board-certified breast reconstruction specialists and five Japanese clinical fellows of plastic surgery.</p><p><strong>Results: </strong>GPT-4 outperformed Grok significantly in terms of accuracy (p < 0.001), informativeness (p < 0.001), and readability (p < 0.001) when evaluated by plastic surgery fellows. Compared to the original guidelines, Grok scored significantly lower in all three areas (all p < 0.001). The accuracy of GPT-4 was rated to be significantly higher based on scores given by plastic surgery fellows compared to those of breast reconstruction specialists (p = 0.012), whereas there was no significant difference between these scores for Grok.</p><p><strong>Conclusions: </strong>The study suggests that GPT-4 has the potential to assist in interpreting and applying clinical guidelines for IBBR but importantly there is still a risk that AI chatbots can misinform. Further studies are needed to understand the broader role of current and future AI chatbots in breast reconstruction surgery.</p><p><strong>Level of evidence iv: </strong>This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine Ratings, please refer to Table of Contents or online Instructions to Authors www.springer.com/00266 .</p>","PeriodicalId":7609,"journal":{"name":"Aesthetic Plastic Surgery","volume":" ","pages":""},"PeriodicalIF":2.0000,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Performance of Artificial Intelligence Chatbots in Answering Clinical Questions on Japanese Practical Guidelines for Implant-based Breast Reconstruction.\",\"authors\":\"Makoto Shiraishi, Yoshihiro Sowa, Koichi Tomita, Yasunobu Terao, Toshihiko Satake, Mayu Muto, Yuhei Morita, Shino Higai, Yoshihiro Toyohara, Yasue Kurokawa, Ataru Sunaga, Mutsumi Okazaki\",\"doi\":\"10.1007/s00266-024-04515-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Artificial intelligence (AI) chatbots, including ChatGPT-4 (GPT-4) and Grok-1 (Grok), have been shown to be potentially useful in several medical fields, but have not been examined in plastic and aesthetic surgery. The aim of this study is to evaluate the responses of these AI chatbots for clinical questions (CQs) related to the guidelines for implant-based breast reconstruction (IBBR) published by the Japan Society of Plastic and Reconstructive Surgery (JSPRS) in 2021.</p><p><strong>Methods: </strong>CQs in the JSPRS guidelines were used as question sources. Responses from two AI chatbots, GPT-4 and Grok, were evaluated for accuracy, informativeness, and readability by five Japanese Board-certified breast reconstruction specialists and five Japanese clinical fellows of plastic surgery.</p><p><strong>Results: </strong>GPT-4 outperformed Grok significantly in terms of accuracy (p < 0.001), informativeness (p < 0.001), and readability (p < 0.001) when evaluated by plastic surgery fellows. Compared to the original guidelines, Grok scored significantly lower in all three areas (all p < 0.001). The accuracy of GPT-4 was rated to be significantly higher based on scores given by plastic surgery fellows compared to those of breast reconstruction specialists (p = 0.012), whereas there was no significant difference between these scores for Grok.</p><p><strong>Conclusions: </strong>The study suggests that GPT-4 has the potential to assist in interpreting and applying clinical guidelines for IBBR but importantly there is still a risk that AI chatbots can misinform. Further studies are needed to understand the broader role of current and future AI chatbots in breast reconstruction surgery.</p><p><strong>Level of evidence iv: </strong>This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine Ratings, please refer to Table of Contents or online Instructions to Authors www.springer.com/00266 .</p>\",\"PeriodicalId\":7609,\"journal\":{\"name\":\"Aesthetic Plastic Surgery\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2024-11-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Aesthetic Plastic Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1007/s00266-024-04515-y\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"SURGERY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Aesthetic Plastic Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00266-024-04515-y","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SURGERY","Score":null,"Total":0}
Performance of Artificial Intelligence Chatbots in Answering Clinical Questions on Japanese Practical Guidelines for Implant-based Breast Reconstruction.
Background: Artificial intelligence (AI) chatbots, including ChatGPT-4 (GPT-4) and Grok-1 (Grok), have been shown to be potentially useful in several medical fields, but have not been examined in plastic and aesthetic surgery. The aim of this study is to evaluate the responses of these AI chatbots for clinical questions (CQs) related to the guidelines for implant-based breast reconstruction (IBBR) published by the Japan Society of Plastic and Reconstructive Surgery (JSPRS) in 2021.
Methods: CQs in the JSPRS guidelines were used as question sources. Responses from two AI chatbots, GPT-4 and Grok, were evaluated for accuracy, informativeness, and readability by five Japanese Board-certified breast reconstruction specialists and five Japanese clinical fellows of plastic surgery.
Results: GPT-4 outperformed Grok significantly in terms of accuracy (p < 0.001), informativeness (p < 0.001), and readability (p < 0.001) when evaluated by plastic surgery fellows. Compared to the original guidelines, Grok scored significantly lower in all three areas (all p < 0.001). The accuracy of GPT-4 was rated to be significantly higher based on scores given by plastic surgery fellows compared to those of breast reconstruction specialists (p = 0.012), whereas there was no significant difference between these scores for Grok.
Conclusions: The study suggests that GPT-4 has the potential to assist in interpreting and applying clinical guidelines for IBBR but importantly there is still a risk that AI chatbots can misinform. Further studies are needed to understand the broader role of current and future AI chatbots in breast reconstruction surgery.
Level of evidence iv: This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine Ratings, please refer to Table of Contents or online Instructions to Authors www.springer.com/00266 .
期刊介绍：
Aesthetic Plastic Surgery is a publication of the International Society of Aesthetic Plastic Surgery and the official journal of the European Association of Societies of Aesthetic Plastic Surgery (EASAPS), Società Italiana di Chirurgia Plastica Ricostruttiva ed Estetica (SICPRE), Vereinigung der Deutschen Aesthetisch Plastischen Chirurgen (VDAPC), the Romanian Aesthetic Surgery Society (RASS), Asociación Española de Cirugía Estética Plástica (AECEP), La Sociedad Argentina de Cirugía Plástica, Estética y Reparadora (SACPER), the Rhinoplasty Society of Europe (RSE), the Iranian Society of Plastic and Aesthetic Surgeons (ISPAS), the Singapore Association of Plastic Surgeons (SAPS), the Australasian Society of Aesthetic Plastic Surgeons (ASAPS), the Egyptian Society of Plastic and Reconstructive Surgeons (ESPRS), and the Sociedad Chilena de Cirugía Plástica, Reconstructiva y Estética (SCCP).
Aesthetic Plastic Surgery provides a forum for original articles advancing the art of aesthetic plastic surgery. Many describe surgical craftsmanship; others deal with complications in surgical procedures and methods by which to treat or avoid them. Coverage includes "second thoughts" on established techniques, which might be abandoned, modified, or improved. Also included are case histories; improvements in surgical instruments, pharmaceuticals, and operating room equipment; and discussions of problems such as the role of psychosocial factors in the doctor-patient and the patient-public interrelationships.
Aesthetic Plastic Surgery is covered in Current Contents/Clinical Medicine, SciSearch, Research Alert, Index Medicus-Medline, and Excerpta Medica/Embase.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
