Sebastián Quintero Montealegre, Andrés Felipe Flórez Monroy, Javier Ricardo Garzón Herazo, Wilfran Perez Mendez, Natalia María Piraquive, Gloria Cortes Fraile, Oscar Mauricio Muñoz Velandia
{"title":"外部验证ID-BactER和Shapiro评分预测急诊科菌血症。","authors":"Sebastián Quintero Montealegre, Andrés Felipe Flórez Monroy, Javier Ricardo Garzón Herazo, Wilfran Perez Mendez, Natalia María Piraquive, Gloria Cortes Fraile, Oscar Mauricio Muñoz Velandia","doi":"10.1177/20499361241304508","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>The blood culture positivity rate in the emergency department (ED) is <20%; however, the mortality associated with Community-acquired bacteraemia (CAB) is as high as 37.8%. For this reason, several models have been developed to predict blood culture positivity for the diagnosis of CAB.</p><p><strong>Objective: </strong>To validate two bacteraemia prediction models in a high-complexity hospital in Colombia.</p><p><strong>Design: </strong>External validation study of the ID-BactER and Shapiro scores based on a consecutive cohort of patients who underwent blood culture within 48 h of ED admission.</p><p><strong>Methods: </strong>Scale calibration was assessed by comparing expected and observed events (calibration belt). Discriminatory ability was assessed by area under the ROC curve (AUC-ROC).</p><p><strong>Results: </strong>We included 1347 patients, of whom 18.85% were diagnosed with CAB. The most common focus of infection was the respiratory tract (36.23%), and the most common microorganism was <i>Escherichia coli</i> (52.15%). The Shapiro score underestimated the risk in all categories and its discriminatory ability was poor (AUC 0.68 CI 95% 0.64-0.73). In contrast, the ID-BactER score showed an adequate observed/expected event ratio of 1.07 (CI 0.85-1.36; <i>p</i> = 0.018) and adequate calibration when expected events were greater than 20%, in addition to good discriminatory ability (AUC 0.74 95% CI 0.70-0.78).</p><p><strong>Conclusion: </strong>The Shapiro score is not calibrated, and its discriminatory ability is poor. ID-BactER has an adequate calibration when the expected events are higher than 20%. Limiting blood culture collection to patients with an ID-BactER score ⩾4 could reduce unnecessary blood culture collection and thus health care costs.</p>","PeriodicalId":46154,"journal":{"name":"Therapeutic Advances in Infectious Disease","volume":"11 ","pages":"20499361241304508"},"PeriodicalIF":3.8000,"publicationDate":"2024-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624545/pdf/","citationCount":"0","resultStr":"{\"title\":\"External validation of ID-BactER and Shapiro scores for predicting bacteraemia in the emergency department.\",\"authors\":\"Sebastián Quintero Montealegre, Andrés Felipe Flórez Monroy, Javier Ricardo Garzón Herazo, Wilfran Perez Mendez, Natalia María Piraquive, Gloria Cortes Fraile, Oscar Mauricio Muñoz Velandia\",\"doi\":\"10.1177/20499361241304508\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>The blood culture positivity rate in the emergency department (ED) is <20%; however, the mortality associated with Community-acquired bacteraemia (CAB) is as high as 37.8%. For this reason, several models have been developed to predict blood culture positivity for the diagnosis of CAB.</p><p><strong>Objective: </strong>To validate two bacteraemia prediction models in a high-complexity hospital in Colombia.</p><p><strong>Design: </strong>External validation study of the ID-BactER and Shapiro scores based on a consecutive cohort of patients who underwent blood culture within 48 h of ED admission.</p><p><strong>Methods: </strong>Scale calibration was assessed by comparing expected and observed events (calibration belt). Discriminatory ability was assessed by area under the ROC curve (AUC-ROC).</p><p><strong>Results: </strong>We included 1347 patients, of whom 18.85% were diagnosed with CAB. The most common focus of infection was the respiratory tract (36.23%), and the most common microorganism was <i>Escherichia coli</i> (52.15%). The Shapiro score underestimated the risk in all categories and its discriminatory ability was poor (AUC 0.68 CI 95% 0.64-0.73). In contrast, the ID-BactER score showed an adequate observed/expected event ratio of 1.07 (CI 0.85-1.36; <i>p</i> = 0.018) and adequate calibration when expected events were greater than 20%, in addition to good discriminatory ability (AUC 0.74 95% CI 0.70-0.78).</p><p><strong>Conclusion: </strong>The Shapiro score is not calibrated, and its discriminatory ability is poor. ID-BactER has an adequate calibration when the expected events are higher than 20%. Limiting blood culture collection to patients with an ID-BactER score ⩾4 could reduce unnecessary blood culture collection and thus health care costs.</p>\",\"PeriodicalId\":46154,\"journal\":{\"name\":\"Therapeutic Advances in Infectious Disease\",\"volume\":\"11 \",\"pages\":\"20499361241304508\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2024-12-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624545/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Therapeutic Advances in Infectious Disease\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/20499361241304508\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"INFECTIOUS DISEASES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Therapeutic Advances in Infectious Disease","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/20499361241304508","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
引用次数: 0
摘要
前言:急诊科(ED)血培养阳性率为目的:验证哥伦比亚某高复杂度医院两种菌血症预测模型的有效性。设计:ID-BactER和Shapiro评分的外部验证研究基于ED入院48小时内接受血培养的连续队列患者。方法:通过比较预期事件和观测事件(校准带)来评估量表校准。判别能力采用ROC曲线下面积(AUC-ROC)评价。结果:纳入1347例患者,其中18.85%诊断为CAB。最常见的感染部位为呼吸道(36.23%),最常见的微生物为大肠杆菌(52.15%)。夏皮罗评分低估了所有类别的风险,其区分能力较差(AUC 0.68 CI 95% 0.64-0.73)。相比之下,ID-BactER评分显示足够的观察/预期事件比为1.07 (CI 0.85-1.36;p = 0.018),当预期事件大于20%时进行适当的校准,此外还有良好的区分能力(AUC 0.74 95% CI 0.70-0.78)。结论:夏皮罗评分未经过校准,其判别能力较差。当预期事件高于20%时,ID-BactER具有充分的校准。将血液培养收集限制在ID-BactER评分大于或等于4的患者中可以减少不必要的血液培养收集,从而减少医疗保健费用。
External validation of ID-BactER and Shapiro scores for predicting bacteraemia in the emergency department.
Introduction: The blood culture positivity rate in the emergency department (ED) is <20%; however, the mortality associated with Community-acquired bacteraemia (CAB) is as high as 37.8%. For this reason, several models have been developed to predict blood culture positivity for the diagnosis of CAB.
Objective: To validate two bacteraemia prediction models in a high-complexity hospital in Colombia.
Design: External validation study of the ID-BactER and Shapiro scores based on a consecutive cohort of patients who underwent blood culture within 48 h of ED admission.
Methods: Scale calibration was assessed by comparing expected and observed events (calibration belt). Discriminatory ability was assessed by area under the ROC curve (AUC-ROC).
Results: We included 1347 patients, of whom 18.85% were diagnosed with CAB. The most common focus of infection was the respiratory tract (36.23%), and the most common microorganism was Escherichia coli (52.15%). The Shapiro score underestimated the risk in all categories and its discriminatory ability was poor (AUC 0.68 CI 95% 0.64-0.73). In contrast, the ID-BactER score showed an adequate observed/expected event ratio of 1.07 (CI 0.85-1.36; p = 0.018) and adequate calibration when expected events were greater than 20%, in addition to good discriminatory ability (AUC 0.74 95% CI 0.70-0.78).
Conclusion: The Shapiro score is not calibrated, and its discriminatory ability is poor. ID-BactER has an adequate calibration when the expected events are higher than 20%. Limiting blood culture collection to patients with an ID-BactER score ⩾4 could reduce unnecessary blood culture collection and thus health care costs.