Ekin Yiğit Köroğlu, Reyhan Ersoy, Muhammed Saçıkara, Fatma Dilek Dellal Kahramanca, Şefika Burçak Polat, Oya Topaloğlu, Bekir Çakır
{"title":"Evaluation of the impact Of ChatGPT support on acromegaly management and patient education.","authors":"Ekin Yiğit Köroğlu, Reyhan Ersoy, Muhammed Saçıkara, Fatma Dilek Dellal Kahramanca, Şefika Burçak Polat, Oya Topaloğlu, Bekir Çakır","doi":"10.1007/s12020-024-04086-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>ChatGPT is a widely used artificial intelligence modeling tool. Healthcare is one potential area of use of ChatGPT. This study aimed to test the usability and reliability of ChatGPT in acromegaly, which is less known in society and should be evaluated by a group of specialized physicians.</p><p><strong>Methods: </strong>The study is designed in two parts. For the first part, 35 questions regarding acromegaly that patients frequently ask were identified, and these questions were asked to ChatGPT. In the second part, four patient examples were presented to ChatGPT using medical terminology. Three experts evaluated ChatGPT's answers to the questions and approaches in case management using 7-point scales in terms of safety, reliability, correctness, and usability.</p><p><strong>Results: </strong>When the ChatGPT answers to the patient's questions were evaluated, a mean score of 6.78 ± 0.55 was given for correctness and 6.69 ± 0.60 for reliability. The mean scores given by the raters for correctness, safety and usability in the evaluation of the cases were as follows: 6.33 ± 0.88, 6.16 ± 0. 71 and 6.08 ± 0.79 points for case 1; 5.35 ± 1.88, 5.29 ± 1.80 and 5.20 ± 1.86 points for case 2; 6.08 ± 0.97, 6.00 ± 0.93 and 5.91 ± 0.82 points for case 3; 6.10 ± 1.29, 6.13 ± 1.30 and 6.16 ± 1.14 points for case 4.</p><p><strong>Conclusion: </strong>ChatGPT can actively answer the questions of acromegaly patients. Although it is not a reliable source alone in managing patients with acromegaly, it can be a supportive tool for physicians.</p>","PeriodicalId":49211,"journal":{"name":"Endocrine","volume":" ","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Endocrine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s12020-024-04086-7","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENDOCRINOLOGY & METABOLISM","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: ChatGPT is a widely used artificial intelligence modeling tool. Healthcare is one potential area of use of ChatGPT. This study aimed to test the usability and reliability of ChatGPT in acromegaly, which is less known in society and should be evaluated by a group of specialized physicians.
Methods: The study is designed in two parts. For the first part, 35 questions regarding acromegaly that patients frequently ask were identified, and these questions were asked to ChatGPT. In the second part, four patient examples were presented to ChatGPT using medical terminology. Three experts evaluated ChatGPT's answers to the questions and approaches in case management using 7-point scales in terms of safety, reliability, correctness, and usability.
Results: When the ChatGPT answers to the patient's questions were evaluated, a mean score of 6.78 ± 0.55 was given for correctness and 6.69 ± 0.60 for reliability. The mean scores given by the raters for correctness, safety and usability in the evaluation of the cases were as follows: 6.33 ± 0.88, 6.16 ± 0. 71 and 6.08 ± 0.79 points for case 1; 5.35 ± 1.88, 5.29 ± 1.80 and 5.20 ± 1.86 points for case 2; 6.08 ± 0.97, 6.00 ± 0.93 and 5.91 ± 0.82 points for case 3; 6.10 ± 1.29, 6.13 ± 1.30 and 6.16 ± 1.14 points for case 4.
Conclusion: ChatGPT can actively answer the questions of acromegaly patients. Although it is not a reliable source alone in managing patients with acromegaly, it can be a supportive tool for physicians.
期刊介绍:
Well-established as a major journal in today’s rapidly advancing experimental and clinical research areas, Endocrine publishes original articles devoted to basic (including molecular, cellular and physiological studies), translational and clinical research in all the different fields of endocrinology and metabolism. Articles will be accepted based on peer-reviews, priority, and editorial decision. Invited reviews, mini-reviews and viewpoints on relevant pathophysiological and clinical topics, as well as Editorials on articles appearing in the Journal, are published. Unsolicited Editorials will be evaluated by the editorial team. Outcomes of scientific meetings, as well as guidelines and position statements, may be submitted. The Journal also considers special feature articles in the field of endocrine genetics and epigenetics, as well as articles devoted to novel methods and techniques in endocrinology.
Endocrine covers controversial, clinical endocrine issues. Meta-analyses on endocrine and metabolic topics are also accepted. Descriptions of single clinical cases and/or small patients studies are not published unless of exceptional interest. However, reports of novel imaging studies and endocrine side effects in single patients may be considered. Research letters and letters to the editor related or unrelated to recently published articles can be submitted.
Endocrine covers leading topics in endocrinology such as neuroendocrinology, pituitary and hypothalamic peptides, thyroid physiological and clinical aspects, bone and mineral metabolism and osteoporosis, obesity, lipid and energy metabolism and food intake control, insulin, Type 1 and Type 2 diabetes, hormones of male and female reproduction, adrenal diseases pediatric and geriatric endocrinology, endocrine hypertension and endocrine oncology.