Rosa Klotz, Thomas M Pausch, Jörg Kaiser, Maximilian C Joos, Rüdiger Hecktor, Azaz Ahmed, Colette Dörr-Harim, Arianeb Mehrabi, Martin Loos, Susanne Roth, Christoph W Michalski, Christoph Kahlert
{"title":"ChatGPT vs. surgeons on pancreatic cancer queries: accuracy & empathy evaluated by patients and experts.","authors":"Rosa Klotz, Thomas M Pausch, Jörg Kaiser, Maximilian C Joos, Rüdiger Hecktor, Azaz Ahmed, Colette Dörr-Harim, Arianeb Mehrabi, Martin Loos, Susanne Roth, Christoph W Michalski, Christoph Kahlert","doi":"10.1016/j.hpb.2024.11.012","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Artificial intelligence (AI) offers potential support in patient-clinician interactions, but its impact on such communication remains unexplored.</p><p><strong>Methods: </strong>In this study, ChatGPT was compared with two pancreatic surgeons in responding to ten pancreatic cancer surgery-related questions, co-designed with the Patient Advisory Board of the Surgical Society's Study Center. A blind evaluation of these responses, considering content congruency and clarity for non-specialists, was conducted by patients and surgeons.</p><p><strong>Results: </strong>From June 23 to July 21, 2023, 24 patients and 25 surgeons participated, of which eleven patients and ten surgeons completed the survey in full. Utilizing a quantitative scale from 1 (strong-disagreement) to 5 (full-agreement), consensus was observed among patients and specialists concerning the content delivered by ChatGPT. The metrics for comprehensibility to a non-specialist audience consistently showed positive reception. In the evaluation of empathetic resonance, ChatGPT's responses mirrored those of the surgeons in the patient's view. A significant proportion ranked Surgeon 1's contributions foremost, followed closely by ChatGPT.</p><p><strong>Discussion: </strong>This study demonstrates that surgeons and ChatGPT answer common queries from patients regarding pancreatic cancer surgery comparable regarding reliability, lay comprehension and empathy as evaluated by patients and surgical experts. These findings highlight the potential of AI in enhancing patient-provider interactions.</p>","PeriodicalId":13229,"journal":{"name":"Hpb","volume":" ","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Hpb","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.hpb.2024.11.012","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Artificial intelligence (AI) offers potential support in patient-clinician interactions, but its impact on such communication remains unexplored.
Methods: In this study, ChatGPT was compared with two pancreatic surgeons in responding to ten pancreatic cancer surgery-related questions, co-designed with the Patient Advisory Board of the Surgical Society's Study Center. A blind evaluation of these responses, considering content congruency and clarity for non-specialists, was conducted by patients and surgeons.
Results: From June 23 to July 21, 2023, 24 patients and 25 surgeons participated, of which eleven patients and ten surgeons completed the survey in full. Utilizing a quantitative scale from 1 (strong-disagreement) to 5 (full-agreement), consensus was observed among patients and specialists concerning the content delivered by ChatGPT. The metrics for comprehensibility to a non-specialist audience consistently showed positive reception. In the evaluation of empathetic resonance, ChatGPT's responses mirrored those of the surgeons in the patient's view. A significant proportion ranked Surgeon 1's contributions foremost, followed closely by ChatGPT.
Discussion: This study demonstrates that surgeons and ChatGPT answer common queries from patients regarding pancreatic cancer surgery comparable regarding reliability, lay comprehension and empathy as evaluated by patients and surgical experts. These findings highlight the potential of AI in enhancing patient-provider interactions.
期刊介绍：
HPB is an international forum for clinical, scientific and educational communication.
Twelve issues a year bring the reader leading articles, expert reviews, original articles, images, editorials, and reader correspondence encompassing all aspects of benign and malignant hepatobiliary disease and its management. HPB features relevant aspects of clinical and translational research and practice.
Specific areas of interest include HPB diseases encountered globally by clinical practitioners in this specialist field of gastrointestinal surgery. The journal addresses the challenges faced in the management of cancer involving the liver, biliary system and pancreas. While surgical oncology represents a large part of HPB practice, submission of manuscripts relating to liver and pancreas transplantation, the treatment of benign conditions such as acute and chronic pancreatitis, and those relating to hepatobiliary infection and inflammation are also welcomed. There will be a focus on developing a multidisciplinary approach to diagnosis and treatment with endoscopic and laparoscopic approaches, radiological interventions and surgical techniques being strongly represented. HPB welcomes submission of manuscripts in all these areas and in scientific focused research that has clear clinical relevance to HPB surgical practice.
HPB aims to help its readers - surgeons, physicians, radiologists and basic scientists - to develop their knowledge and practice. HPB will be of interest to specialists involved in the management of hepatobiliary and pancreatic disease however will also inform those working in related fields.
Abstracted and Indexed in:
MEDLINE®
EMBASE
PubMed
Science Citation Index Expanded
Academic Search (EBSCO)
HPB is owned by the International Hepato-Pancreato-Biliary Association (IHPBA) and is also the official Journal of the American Hepato-Pancreato-Biliary Association (AHPBA), the Asian-Pacific Hepato Pancreatic Biliary Association (A-PHPBA) and the European-African Hepato-Pancreatic Biliary Association (E-AHPBA).
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
