Flavia Pennisi, Antonio Pinto, Giovanni Emanuele Ricciardi, Carlo Signorelli, Vincenza Gianfredi
{"title":"抗菌药物管理中的人工智能:预测性能和诊断准确性的系统回顾和荟萃分析。","authors":"Flavia Pennisi, Antonio Pinto, Giovanni Emanuele Ricciardi, Carlo Signorelli, Vincenza Gianfredi","doi":"10.1007/s10096-024-05027-y","DOIUrl":null,"url":null,"abstract":"<p><p>The increasing threat of antimicrobial resistance has prompted a need for more effective antimicrobial stewardship programs (AMS). Artificial intelligence (AI) and machine learning (ML) tools have emerged as potential solutions to enhance decision-making and improve patient outcomes in AMS. This systematic review and meta-analysis aims to evaluate the impact of AI in AMS and to assess its predictive performance and diagnostic accuracy. We conducted a comprehensive literature search across PubMed/MEDLINE, Scopus, EMBASE, and Web of Science to identify studies published up to July 2024. Studies included were observational, cohort, or retrospective, focusing on the application of AI/ML in AMS. The outcomes assessed were the area under the curve (AUC), accuracy, sensitivity, specificity, negative predictive value (NPV), and positive predictive value (PPV). We calculated the mean pooled effect size (ES) and its 95% confidence interval (CI) using a random-effects model. The risk of bias was assessed using the QUADAS-AI tool, and the protocol was registered in PROSPERO. Out of 3,458 retrieved articles, 80 studies met the inclusion criteria. Our meta-analysis demonstrated that ML models exhibited strong predictive performance and diagnostic accuracy, with the following results: AUC [ES: 72.28 (70.42-74.14)], accuracy [ES: 74.97 (73.35-76.58)], sensitivity [ES: 76.89; (71.90-81.89)], specificity [ES: 73.77; (67.87-79.67)], NPV [ES:79.92 (76.54-83.31)], and PPV [ES: 69.41 (60.19-78.63)] across various AMS settings. AI and ML tools offer promising enhancements due to their strong predictive performance. The integration of AI into AMS could lead to more precise antimicrobial prescribing, reduced antimicrobial resistance, and better resource utilization.</p>","PeriodicalId":11782,"journal":{"name":"European Journal of Clinical Microbiology & Infectious Diseases","volume":" ","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Artificial intelligence in antimicrobial stewardship: a systematic review and meta-analysis of predictive performance and diagnostic accuracy.\",\"authors\":\"Flavia Pennisi, Antonio Pinto, Giovanni Emanuele Ricciardi, Carlo Signorelli, Vincenza Gianfredi\",\"doi\":\"10.1007/s10096-024-05027-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The increasing threat of antimicrobial resistance has prompted a need for more effective antimicrobial stewardship programs (AMS). Artificial intelligence (AI) and machine learning (ML) tools have emerged as potential solutions to enhance decision-making and improve patient outcomes in AMS. This systematic review and meta-analysis aims to evaluate the impact of AI in AMS and to assess its predictive performance and diagnostic accuracy. We conducted a comprehensive literature search across PubMed/MEDLINE, Scopus, EMBASE, and Web of Science to identify studies published up to July 2024. Studies included were observational, cohort, or retrospective, focusing on the application of AI/ML in AMS. The outcomes assessed were the area under the curve (AUC), accuracy, sensitivity, specificity, negative predictive value (NPV), and positive predictive value (PPV). We calculated the mean pooled effect size (ES) and its 95% confidence interval (CI) using a random-effects model. The risk of bias was assessed using the QUADAS-AI tool, and the protocol was registered in PROSPERO. Out of 3,458 retrieved articles, 80 studies met the inclusion criteria. Our meta-analysis demonstrated that ML models exhibited strong predictive performance and diagnostic accuracy, with the following results: AUC [ES: 72.28 (70.42-74.14)], accuracy [ES: 74.97 (73.35-76.58)], sensitivity [ES: 76.89; (71.90-81.89)], specificity [ES: 73.77; (67.87-79.67)], NPV [ES:79.92 (76.54-83.31)], and PPV [ES: 69.41 (60.19-78.63)] across various AMS settings. AI and ML tools offer promising enhancements due to their strong predictive performance. The integration of AI into AMS could lead to more precise antimicrobial prescribing, reduced antimicrobial resistance, and better resource utilization.</p>\",\"PeriodicalId\":11782,\"journal\":{\"name\":\"European Journal of Clinical Microbiology & Infectious Diseases\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Clinical Microbiology & Infectious Diseases\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1007/s10096-024-05027-y\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INFECTIOUS DISEASES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Clinical Microbiology & Infectious Diseases","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s10096-024-05027-y","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
Artificial intelligence in antimicrobial stewardship: a systematic review and meta-analysis of predictive performance and diagnostic accuracy.
The increasing threat of antimicrobial resistance has prompted a need for more effective antimicrobial stewardship programs (AMS). Artificial intelligence (AI) and machine learning (ML) tools have emerged as potential solutions to enhance decision-making and improve patient outcomes in AMS. This systematic review and meta-analysis aims to evaluate the impact of AI in AMS and to assess its predictive performance and diagnostic accuracy. We conducted a comprehensive literature search across PubMed/MEDLINE, Scopus, EMBASE, and Web of Science to identify studies published up to July 2024. Studies included were observational, cohort, or retrospective, focusing on the application of AI/ML in AMS. The outcomes assessed were the area under the curve (AUC), accuracy, sensitivity, specificity, negative predictive value (NPV), and positive predictive value (PPV). We calculated the mean pooled effect size (ES) and its 95% confidence interval (CI) using a random-effects model. The risk of bias was assessed using the QUADAS-AI tool, and the protocol was registered in PROSPERO. Out of 3,458 retrieved articles, 80 studies met the inclusion criteria. Our meta-analysis demonstrated that ML models exhibited strong predictive performance and diagnostic accuracy, with the following results: AUC [ES: 72.28 (70.42-74.14)], accuracy [ES: 74.97 (73.35-76.58)], sensitivity [ES: 76.89; (71.90-81.89)], specificity [ES: 73.77; (67.87-79.67)], NPV [ES:79.92 (76.54-83.31)], and PPV [ES: 69.41 (60.19-78.63)] across various AMS settings. AI and ML tools offer promising enhancements due to their strong predictive performance. The integration of AI into AMS could lead to more precise antimicrobial prescribing, reduced antimicrobial resistance, and better resource utilization.
期刊介绍:
EJCMID is an interdisciplinary journal devoted to the publication of communications on infectious diseases of bacterial, viral and parasitic origin.