Herdiantri Sufriyana, Chieh Chen, Hua-Sheng Chiu, Pavel Sumazin, Po-Yu Yang, Jiunn-Horng Kang, Emily Chia-Yu Su
{"title":"Estimating individual risk of catheter-associated urinary tract infections using explainable artificial intelligence on clinical data.","authors":"Herdiantri Sufriyana, Chieh Chen, Hua-Sheng Chiu, Pavel Sumazin, Po-Yu Yang, Jiunn-Horng Kang, Emily Chia-Yu Su","doi":"10.1016/j.ajic.2024.10.027","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Catheter-associated urinary tract infections (CAUTIs) increase clinical burdens. Identifying the high-risk patients is crucial. We aimed to develop and externally validate an explainable, prognostic prediction model of CAUTIs among hospitalized individuals receiving urinary catheterization.</p><p><strong>Methods: </strong>A retrospective cohort paradigm was applied for model development and validation using data from two hospitals and used the third hospital's data for external validation. Machine learning algorithms were applied for predictive modeling. We evaluated the calibration, clinical utility, and discrimination ability to choose the best model by the validation set. The best model was assessed for the explainability.</p><p><strong>Results: </strong>We included 122,417 instances from 20-to-75-year-old subjects. Fourteen predictors were selected from 20 candidates. The best model was the RF for prediction within 6 days. It detected 97.63% (95% confidence interval [CI]: ±0.06%) CAUTI positive, and 97.36% (95% CI: ±0.07%) of individuals that were predicted to be CAUTI negative were true negatives. Among those predicted to be CAUTI positives, we expected 22.85% (95% CI: ±0.07%) of them to truly be high-risk individuals. We provide a web-based application and a paper-based nomogram for using this model.</p><p><strong>Conclusions: </strong>Our prediction model accurately detected most CAUTI positive cases, while most predicted negative individuals were correctly ruled out.</p>","PeriodicalId":7621,"journal":{"name":"American journal of infection control","volume":null,"pages":null},"PeriodicalIF":3.8000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American journal of infection control","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.ajic.2024.10.027","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Catheter-associated urinary tract infections (CAUTIs) increase clinical burdens. Identifying the high-risk patients is crucial. We aimed to develop and externally validate an explainable, prognostic prediction model of CAUTIs among hospitalized individuals receiving urinary catheterization.
Methods: A retrospective cohort paradigm was applied for model development and validation using data from two hospitals and used the third hospital's data for external validation. Machine learning algorithms were applied for predictive modeling. We evaluated the calibration, clinical utility, and discrimination ability to choose the best model by the validation set. The best model was assessed for the explainability.
Results: We included 122,417 instances from 20-to-75-year-old subjects. Fourteen predictors were selected from 20 candidates. The best model was the RF for prediction within 6 days. It detected 97.63% (95% confidence interval [CI]: ±0.06%) CAUTI positive, and 97.36% (95% CI: ±0.07%) of individuals that were predicted to be CAUTI negative were true negatives. Among those predicted to be CAUTI positives, we expected 22.85% (95% CI: ±0.07%) of them to truly be high-risk individuals. We provide a web-based application and a paper-based nomogram for using this model.
Conclusions: Our prediction model accurately detected most CAUTI positive cases, while most predicted negative individuals were correctly ruled out.
期刊介绍:
AJIC covers key topics and issues in infection control and epidemiology. Infection control professionals, including physicians, nurses, and epidemiologists, rely on AJIC for peer-reviewed articles covering clinical topics as well as original research. As the official publication of the Association for Professionals in Infection Control and Epidemiology (APIC)