Assessment of artificial intelligence applications in responding to dental trauma

IF 2.3 3区医学 Q2 DENTISTRY, ORAL SURGERY & MEDICINE Dental Traumatology Pub Date : 2024-05-14 DOI:10.1111/edt.12965

Idil Ozden, Merve Gokyar, Mustafa Enes Ozden, Hesna Sazak Ovecoglu

{"title":"Assessment of artificial intelligence applications in responding to dental trauma","authors":"Idil Ozden, Merve Gokyar, Mustafa Enes Ozden, Hesna Sazak Ovecoglu","doi":"10.1111/edt.12965","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>This study assessed the consistency and accuracy of responses provided by two artificial intelligence (AI) applications, ChatGPT and Google Bard (Gemini), to questions related to dental trauma.</p>\n </section>\n \n <section>\n \n <h3> Materials and Methods</h3>\n \n <p>Based on the International Association of Dental Traumatology guidelines, 25 dichotomous (yes/no) questions were posed to ChatGPT and Google Bard over 10 days. The responses were recorded and compared with the correct answers. Statistical analyses, including Fleiss kappa, were conducted to determine the agreement and consistency of the responses.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Analysis of 4500 responses revealed that both applications provided correct answers to 57.5% of the questions. Google Bard demonstrated a moderate level of agreement, with varying rates of incorrect answers and referrals to physicians.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>Although ChatGPT and Google Bard are potential knowledge resources, their consistency and accuracy in responding to dental trauma queries remain limited. Further research involving specially trained AI models in endodontics is warranted to assess their suitability for clinical use.</p>\n </section>\n </div>","PeriodicalId":55180,"journal":{"name":"Dental Traumatology","volume":"40 6","pages":"722-729"},"PeriodicalIF":2.3000,"publicationDate":"2024-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Dental Traumatology","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/edt.12965","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}

引用次数: 0

Abstract

Background

This study assessed the consistency and accuracy of responses provided by two artificial intelligence (AI) applications, ChatGPT and Google Bard (Gemini), to questions related to dental trauma.

Materials and Methods

Based on the International Association of Dental Traumatology guidelines, 25 dichotomous (yes/no) questions were posed to ChatGPT and Google Bard over 10 days. The responses were recorded and compared with the correct answers. Statistical analyses, including Fleiss kappa, were conducted to determine the agreement and consistency of the responses.

Results

Analysis of 4500 responses revealed that both applications provided correct answers to 57.5% of the questions. Google Bard demonstrated a moderate level of agreement, with varying rates of incorrect answers and referrals to physicians.

Conclusions

Although ChatGPT and Google Bard are potential knowledge resources, their consistency and accuracy in responding to dental trauma queries remain limited. Further research involving specially trained AI models in endodontics is warranted to assess their suitability for clinical use.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

评估人工智能在应对牙科创伤中的应用。

背景：本研究评估了 ChatGPT 和 Google Bard (Gemini) 这两款人工智能（AI）应用程序对牙科创伤相关问题所做回答的一致性和准确性：根据国际牙科创伤协会指南，在 10 天内向 ChatGPT 和 Google Bard 提出了 25 个二分法（是/否）问题。对回答进行记录，并与正确答案进行比较。进行了包括弗莱斯卡帕在内的统计分析，以确定回答的一致性和连贯性：对 4500 个回答的分析表明，两个应用程序都为 57.5%的问题提供了正确答案。Google Bard 显示出中等程度的一致性，错误答案和向医生转诊的比例各不相同：结论：虽然 ChatGPT 和 Google Bard 是潜在的知识资源，但它们在回答牙科创伤问题时的一致性和准确性仍然有限。有必要在牙髓病学领域对经过专门训练的人工智能模型进行进一步研究，以评估它们是否适合临床使用。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Dental Traumatology 医学-牙科与口腔外科

CiteScore

6.40

自引率

32.00%

发文量

审稿时长

6-12 weeks

期刊介绍： Dental Traumatology is an international journal that aims to convey scientific and clinical progress in all areas related to adult and pediatric dental traumatology. This includes the following topics: - Epidemiology, Social Aspects, Education, Diagnostics - Esthetics / Prosthetics/ Restorative - Evidence Based Traumatology & Study Design - Oral & Maxillofacial Surgery/Transplant/Implant - Pediatrics and Orthodontics - Prevention and Sports Dentistry - Endodontics and Periodontal Aspects The journal"s aim is to promote communication among clinicians, educators, researchers, and others interested in the field of dental traumatology.