Lilian Toledo Reyes, J. Knorst, F. R. Ortiz, T. Ardenghi
{"title":"机器学习在龋齿诊断和预后预测中的系统评价","authors":"Lilian Toledo Reyes, J. Knorst, F. R. Ortiz, T. Ardenghi","doi":"10.1159/000524167","DOIUrl":null,"url":null,"abstract":"We performed a systematic review to evaluate the success of machine learning algorithms in the diagnosis and prognostic prediction of dental caries. The review protocol was a priori registered in the PROSPERO, CRD42020183447. The search involved electronic bibliographic databases: PubMed/Medline, Scopus, EMBASE, Web of Science, and grey literature until December 2020. We excluded review articles, case series, case reports, editorials, letters, comments, educational methodologies, assessments of robotic devices, and articles with less than 10 participants or specimens. Two independent reviewers selected the studies and performed the assessment of the methodological quality based on standardized scales. We summarize data on the machine learning algorithms used; software; performance outcomes such as accuracy/precision, sensitivity/recall, specificity, area under the receiver operating characteristic curve (AUC), and positive/negative predictive values related to dental caries. Meta-analyses were not performed due to methodological differences. Our review included 15 studies (10 diagnostic studies and 5 prognostic prediction studies). Cross-sectional design studies were predominant (12). The most frequently used statistical measure of performance reported in diagnostic studies was AUC value, which ranged from 0.745 to 0.987. For most diagnostic studies, data from contingency tables were not available. Reported sensitivities were higher in low risk of bias prognostic prediction studies (median [IQR] of 0.996 [0.971–1.000] vs. unclear/high risk of bias studies 0.189 [0–0.340]; p value 0.025). While there were no significant differences in the specificity between these subgroups, we concluded that the use of these technologies for the diagnosis and prognostic prediction of dental caries, although promising, is at an early stage. The general applicability of the evidence was limited given that most models were developed outside the real clinical setting with a prevalence of unclear/high risk of bias. Researchers must increase the overall quality of their research protocols by providing a comprehensive report on the methods implemented.","PeriodicalId":9620,"journal":{"name":"Caries Research","volume":"56 1","pages":"161 - 170"},"PeriodicalIF":2.9000,"publicationDate":"2022-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Machine Learning in the Diagnosis and Prognostic Prediction of Dental Caries: A Systematic Review\",\"authors\":\"Lilian Toledo Reyes, J. Knorst, F. R. Ortiz, T. Ardenghi\",\"doi\":\"10.1159/000524167\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We performed a systematic review to evaluate the success of machine learning algorithms in the diagnosis and prognostic prediction of dental caries. The review protocol was a priori registered in the PROSPERO, CRD42020183447. The search involved electronic bibliographic databases: PubMed/Medline, Scopus, EMBASE, Web of Science, and grey literature until December 2020. We excluded review articles, case series, case reports, editorials, letters, comments, educational methodologies, assessments of robotic devices, and articles with less than 10 participants or specimens. Two independent reviewers selected the studies and performed the assessment of the methodological quality based on standardized scales. We summarize data on the machine learning algorithms used; software; performance outcomes such as accuracy/precision, sensitivity/recall, specificity, area under the receiver operating characteristic curve (AUC), and positive/negative predictive values related to dental caries. Meta-analyses were not performed due to methodological differences. Our review included 15 studies (10 diagnostic studies and 5 prognostic prediction studies). Cross-sectional design studies were predominant (12). The most frequently used statistical measure of performance reported in diagnostic studies was AUC value, which ranged from 0.745 to 0.987. For most diagnostic studies, data from contingency tables were not available. Reported sensitivities were higher in low risk of bias prognostic prediction studies (median [IQR] of 0.996 [0.971–1.000] vs. unclear/high risk of bias studies 0.189 [0–0.340]; p value 0.025). While there were no significant differences in the specificity between these subgroups, we concluded that the use of these technologies for the diagnosis and prognostic prediction of dental caries, although promising, is at an early stage. The general applicability of the evidence was limited given that most models were developed outside the real clinical setting with a prevalence of unclear/high risk of bias. Researchers must increase the overall quality of their research protocols by providing a comprehensive report on the methods implemented.\",\"PeriodicalId\":9620,\"journal\":{\"name\":\"Caries Research\",\"volume\":\"56 1\",\"pages\":\"161 - 170\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2022-05-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Caries Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1159/000524167\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Caries Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1159/000524167","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 5
摘要
我们进行了一项系统综述,以评估机器学习算法在龋齿诊断和预后预测方面的成功。审查协议事先在PROSPERO CRD42020183447中登记。搜索涉及电子书目数据库:PubMed/Medline、Scopus、EMBASE、Web of Science和灰色文献,直到2020年12月。我们排除了综述文章、病例系列、病例报告、社论、信件、评论、教育方法、机器人设备评估以及参与者或样本少于10人的文章。两名独立评审员选择了这些研究,并根据标准化量表对方法学质量进行了评估。我们总结了所使用的机器学习算法的数据;软件性能结果,如准确性/精密度、敏感性/召回率、特异性、受试者工作特征曲线下面积(AUC)以及与龋齿相关的阳性/阴性预测值。由于方法学差异,未进行荟萃分析。我们的综述包括15项研究(10项诊断研究和5项预后预测研究)。横断面设计研究占主导地位(12)。诊断研究中报告的最常用的性能统计指标是AUC值,其范围为0.745至0.987。对于大多数诊断性研究,没有列联表中的数据。报道的敏感性在低偏倚风险预后预测研究中更高(中位数[IQR]为0.996[0.971–1.000],而不清楚/高偏倚风险研究为0.189[0–0.340];p值0.025)。虽然这些亚组之间的特异性没有显著差异,但我们得出结论,将这些技术用于龋齿的诊断和预后预测,尽管前景看好,但仍处于早期阶段。鉴于大多数模型是在真实临床环境之外开发的,且普遍存在不清楚/高偏倚风险,因此证据的普遍适用性有限。研究人员必须通过提供关于所实施方法的全面报告来提高研究方案的整体质量。
Machine Learning in the Diagnosis and Prognostic Prediction of Dental Caries: A Systematic Review
We performed a systematic review to evaluate the success of machine learning algorithms in the diagnosis and prognostic prediction of dental caries. The review protocol was a priori registered in the PROSPERO, CRD42020183447. The search involved electronic bibliographic databases: PubMed/Medline, Scopus, EMBASE, Web of Science, and grey literature until December 2020. We excluded review articles, case series, case reports, editorials, letters, comments, educational methodologies, assessments of robotic devices, and articles with less than 10 participants or specimens. Two independent reviewers selected the studies and performed the assessment of the methodological quality based on standardized scales. We summarize data on the machine learning algorithms used; software; performance outcomes such as accuracy/precision, sensitivity/recall, specificity, area under the receiver operating characteristic curve (AUC), and positive/negative predictive values related to dental caries. Meta-analyses were not performed due to methodological differences. Our review included 15 studies (10 diagnostic studies and 5 prognostic prediction studies). Cross-sectional design studies were predominant (12). The most frequently used statistical measure of performance reported in diagnostic studies was AUC value, which ranged from 0.745 to 0.987. For most diagnostic studies, data from contingency tables were not available. Reported sensitivities were higher in low risk of bias prognostic prediction studies (median [IQR] of 0.996 [0.971–1.000] vs. unclear/high risk of bias studies 0.189 [0–0.340]; p value 0.025). While there were no significant differences in the specificity between these subgroups, we concluded that the use of these technologies for the diagnosis and prognostic prediction of dental caries, although promising, is at an early stage. The general applicability of the evidence was limited given that most models were developed outside the real clinical setting with a prevalence of unclear/high risk of bias. Researchers must increase the overall quality of their research protocols by providing a comprehensive report on the methods implemented.
期刊介绍:
''Caries Research'' publishes epidemiological, clinical and laboratory studies in dental caries, erosion and related dental diseases. Some studies build on the considerable advances already made in caries prevention, e.g. through fluoride application. Some aim to improve understanding of the increasingly important problem of dental erosion and the associated tooth wear process. Others monitor the changing pattern of caries in different populations, explore improved methods of diagnosis or evaluate methods of prevention or treatment. The broad coverage of current research has given the journal an international reputation as an indispensable source for both basic scientists and clinicians engaged in understanding, investigating and preventing dental disease.