Karina-Doris Vihta, Emma Pritchard, Koen B. Pouwels, Susan Hopkins, Rebecca L. Guy, Katherine Henderson, Dimple Chudasama, Russell Hope, Berit Muller-Pebody, Ann Sarah Walker, David Clifton, David W. Eyre
{"title":"利用机器学习预测未来医院的抗菌药耐药性流行率。","authors":"Karina-Doris Vihta, Emma Pritchard, Koen B. Pouwels, Susan Hopkins, Rebecca L. Guy, Katherine Henderson, Dimple Chudasama, Russell Hope, Berit Muller-Pebody, Ann Sarah Walker, David Clifton, David W. Eyre","doi":"10.1038/s43856-024-00606-8","DOIUrl":null,"url":null,"abstract":"Predicting antimicrobial resistance (AMR), a top global health threat, nationwide at an aggregate hospital level could help target interventions. Using machine learning, we exploit historical AMR and antimicrobial usage to predict future AMR. Antimicrobial use and AMR prevalence in bloodstream infections in hospitals in England were obtained per hospital group (Trust) and financial year (FY, April–March) for 22 pathogen–antibiotic combinations (FY2016-2017 to FY2021-2022). Extreme Gradient Boosting (XGBoost) model predictions were compared to the previous value taken forwards, the difference between the previous two years taken forwards and linear trend forecasting (LTF). XGBoost feature importances were calculated to aid interpretability. Here we show that XGBoost models achieve the best predictive performance. Relatively limited year-to-year variability in AMR prevalence within Trust–pathogen–antibiotic combinations means previous value taken forwards also achieves a low mean absolute error (MAE), similar to or slightly higher than XGBoost. Using the difference between the previous two years taken forward or LTF performs consistently worse. XGBoost considerably outperforms all other methods in Trusts with a larger change in AMR prevalence from FY2020-2021 (last training year) to FY2021-2022 (held-out test set). Feature importance values indicate that besides historical resistance to the same pathogen–antibiotic combination as the outcome, complex relationships between resistance in different pathogens to the same antibiotic/antibiotic class and usage are exploited for predictions. These are generally among the top ten features ranked according to their mean absolute SHAP values. Year-to-year resistance has generally changed little within Trust–pathogen–antibiotic combinations. In those with larger changes, XGBoost models can improve predictions, enabling informed decisions, efficient resource allocation, and targeted interventions. Antibiotics play an important role in treating serious bacterial infections. However, with the increased usage of antibiotics, they are becoming less effective. In our study, we use machine learning to learn from past antibiotic resistance and usage in order to predict what resistance will look like in the future. Different hospitals across England have very different resistance levels, however, within each hospital, these levels remain stable over time. When larger changes in resistance occurred over time in individual hospitals, our methods were able to predict these. Understanding how much resistance there is in hospital populations, and what may occur in the future can help determine where resources and interventions should be directed. Vihta et al. use past hospital data including bloodstream infection cases, susceptibilities, and antimicrobial use to predict future resistance prevalence. Machine learning can improve the accuracy of predictions potentially impacting interventions.","PeriodicalId":72646,"journal":{"name":"Communications medicine","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s43856-024-00606-8.pdf","citationCount":"0","resultStr":"{\"title\":\"Predicting future hospital antimicrobial resistance prevalence using machine learning\",\"authors\":\"Karina-Doris Vihta, Emma Pritchard, Koen B. Pouwels, Susan Hopkins, Rebecca L. Guy, Katherine Henderson, Dimple Chudasama, Russell Hope, Berit Muller-Pebody, Ann Sarah Walker, David Clifton, David W. Eyre\",\"doi\":\"10.1038/s43856-024-00606-8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Predicting antimicrobial resistance (AMR), a top global health threat, nationwide at an aggregate hospital level could help target interventions. Using machine learning, we exploit historical AMR and antimicrobial usage to predict future AMR. Antimicrobial use and AMR prevalence in bloodstream infections in hospitals in England were obtained per hospital group (Trust) and financial year (FY, April–March) for 22 pathogen–antibiotic combinations (FY2016-2017 to FY2021-2022). Extreme Gradient Boosting (XGBoost) model predictions were compared to the previous value taken forwards, the difference between the previous two years taken forwards and linear trend forecasting (LTF). XGBoost feature importances were calculated to aid interpretability. Here we show that XGBoost models achieve the best predictive performance. Relatively limited year-to-year variability in AMR prevalence within Trust–pathogen–antibiotic combinations means previous value taken forwards also achieves a low mean absolute error (MAE), similar to or slightly higher than XGBoost. Using the difference between the previous two years taken forward or LTF performs consistently worse. XGBoost considerably outperforms all other methods in Trusts with a larger change in AMR prevalence from FY2020-2021 (last training year) to FY2021-2022 (held-out test set). Feature importance values indicate that besides historical resistance to the same pathogen–antibiotic combination as the outcome, complex relationships between resistance in different pathogens to the same antibiotic/antibiotic class and usage are exploited for predictions. These are generally among the top ten features ranked according to their mean absolute SHAP values. Year-to-year resistance has generally changed little within Trust–pathogen–antibiotic combinations. In those with larger changes, XGBoost models can improve predictions, enabling informed decisions, efficient resource allocation, and targeted interventions. Antibiotics play an important role in treating serious bacterial infections. However, with the increased usage of antibiotics, they are becoming less effective. In our study, we use machine learning to learn from past antibiotic resistance and usage in order to predict what resistance will look like in the future. Different hospitals across England have very different resistance levels, however, within each hospital, these levels remain stable over time. When larger changes in resistance occurred over time in individual hospitals, our methods were able to predict these. Understanding how much resistance there is in hospital populations, and what may occur in the future can help determine where resources and interventions should be directed. Vihta et al. use past hospital data including bloodstream infection cases, susceptibilities, and antimicrobial use to predict future resistance prevalence. Machine learning can improve the accuracy of predictions potentially impacting interventions.\",\"PeriodicalId\":72646,\"journal\":{\"name\":\"Communications medicine\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2024-10-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.nature.com/articles/s43856-024-00606-8.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Communications medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.nature.com/articles/s43856-024-00606-8\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, RESEARCH & EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Communications medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.nature.com/articles/s43856-024-00606-8","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
Predicting future hospital antimicrobial resistance prevalence using machine learning
Predicting antimicrobial resistance (AMR), a top global health threat, nationwide at an aggregate hospital level could help target interventions. Using machine learning, we exploit historical AMR and antimicrobial usage to predict future AMR. Antimicrobial use and AMR prevalence in bloodstream infections in hospitals in England were obtained per hospital group (Trust) and financial year (FY, April–March) for 22 pathogen–antibiotic combinations (FY2016-2017 to FY2021-2022). Extreme Gradient Boosting (XGBoost) model predictions were compared to the previous value taken forwards, the difference between the previous two years taken forwards and linear trend forecasting (LTF). XGBoost feature importances were calculated to aid interpretability. Here we show that XGBoost models achieve the best predictive performance. Relatively limited year-to-year variability in AMR prevalence within Trust–pathogen–antibiotic combinations means previous value taken forwards also achieves a low mean absolute error (MAE), similar to or slightly higher than XGBoost. Using the difference between the previous two years taken forward or LTF performs consistently worse. XGBoost considerably outperforms all other methods in Trusts with a larger change in AMR prevalence from FY2020-2021 (last training year) to FY2021-2022 (held-out test set). Feature importance values indicate that besides historical resistance to the same pathogen–antibiotic combination as the outcome, complex relationships between resistance in different pathogens to the same antibiotic/antibiotic class and usage are exploited for predictions. These are generally among the top ten features ranked according to their mean absolute SHAP values. Year-to-year resistance has generally changed little within Trust–pathogen–antibiotic combinations. In those with larger changes, XGBoost models can improve predictions, enabling informed decisions, efficient resource allocation, and targeted interventions. Antibiotics play an important role in treating serious bacterial infections. However, with the increased usage of antibiotics, they are becoming less effective. In our study, we use machine learning to learn from past antibiotic resistance and usage in order to predict what resistance will look like in the future. Different hospitals across England have very different resistance levels, however, within each hospital, these levels remain stable over time. When larger changes in resistance occurred over time in individual hospitals, our methods were able to predict these. Understanding how much resistance there is in hospital populations, and what may occur in the future can help determine where resources and interventions should be directed. Vihta et al. use past hospital data including bloodstream infection cases, susceptibilities, and antimicrobial use to predict future resistance prevalence. Machine learning can improve the accuracy of predictions potentially impacting interventions.