Yuchen Gao, Chunrong Wang, Wenhao Dong, Bianfang Li, Jianhui Wang, Jun Li, Yu Tian, Jia Liu, Yuefu Wang
{"title":"一个可解释的机器学习模型预测心脏手术后急性肾损伤:一项回顾性队列研究","authors":"Yuchen Gao, Chunrong Wang, Wenhao Dong, Bianfang Li, Jianhui Wang, Jun Li, Yu Tian, Jia Liu, Yuefu Wang","doi":"10.2147/clep.s404580","DOIUrl":null,"url":null,"abstract":"<strong>Background:</strong> To derive and validate a machine learning (ML) prediction model of acute kidney injury (AKI) that could be used for AKI surveillance and management to improve clinical outcomes.<br/><strong>Methods:</strong> This retrospective cohort study was conducted in Fuwai Hospital, including patients aged 18 years and above undergoing cardiac surgery admitted between January 1, 2017, and December 31, 2018. Seventy percent of the observations were randomly selected for training and the remaining 30% for testing. The demographics, comorbidities, laboratory examination parameters, and operation details were used to construct a prediction model for AKI by logistic regression and eXtreme gradient boosting (Xgboost). The discrimination of each model was assessed on the test cohort by the area under the receiver operator characteristic (AUROC) curve, while calibration was performed by the calibration plot.<br/><strong>Results:</strong> A total of 15,880 patients were enrolled in this study, and 4845 (30.5%) had developed AKI. Xgboost model had the higher discriminative ability compared with logistic regression (AUROC, 0.849 [95% CI, 0.837– 0.861] vs 0.803[95% CI 0.790– 0.817], <em>P</em>< 0.001) in the test dataset. The estimated glomerular filtration (eGFR) and creatine on intensive care unit (ICU) arrival are the two most important prediction parameters. A SHAP summary plot was used to illustrate the effects of the top 15 features attributed to the Xgboost model.<br/><strong>Conclusion:</strong> ML models can provide clinical decision support to determine which patients should focus on perioperative preventive treatment to preemptively reduce acute kidney injury by predicting which patients are not at risk.<br/><br/>","PeriodicalId":10362,"journal":{"name":"Clinical Epidemiology","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2023-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Explainable Machine Learning Model to Predict Acute Kidney Injury After Cardiac Surgery: A Retrospective Cohort Study\",\"authors\":\"Yuchen Gao, Chunrong Wang, Wenhao Dong, Bianfang Li, Jianhui Wang, Jun Li, Yu Tian, Jia Liu, Yuefu Wang\",\"doi\":\"10.2147/clep.s404580\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<strong>Background:</strong> To derive and validate a machine learning (ML) prediction model of acute kidney injury (AKI) that could be used for AKI surveillance and management to improve clinical outcomes.<br/><strong>Methods:</strong> This retrospective cohort study was conducted in Fuwai Hospital, including patients aged 18 years and above undergoing cardiac surgery admitted between January 1, 2017, and December 31, 2018. Seventy percent of the observations were randomly selected for training and the remaining 30% for testing. The demographics, comorbidities, laboratory examination parameters, and operation details were used to construct a prediction model for AKI by logistic regression and eXtreme gradient boosting (Xgboost). The discrimination of each model was assessed on the test cohort by the area under the receiver operator characteristic (AUROC) curve, while calibration was performed by the calibration plot.<br/><strong>Results:</strong> A total of 15,880 patients were enrolled in this study, and 4845 (30.5%) had developed AKI. Xgboost model had the higher discriminative ability compared with logistic regression (AUROC, 0.849 [95% CI, 0.837– 0.861] vs 0.803[95% CI 0.790– 0.817], <em>P</em>< 0.001) in the test dataset. The estimated glomerular filtration (eGFR) and creatine on intensive care unit (ICU) arrival are the two most important prediction parameters. A SHAP summary plot was used to illustrate the effects of the top 15 features attributed to the Xgboost model.<br/><strong>Conclusion:</strong> ML models can provide clinical decision support to determine which patients should focus on perioperative preventive treatment to preemptively reduce acute kidney injury by predicting which patients are not at risk.<br/><br/>\",\"PeriodicalId\":10362,\"journal\":{\"name\":\"Clinical Epidemiology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2023-12-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical Epidemiology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2147/clep.s404580\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/clep.s404580","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
摘要
背景:推导并验证急性肾损伤(AKI)的机器学习(ML)预测模型,该模型可用于AKI的监测和管理,以改善临床结果。方法:本回顾性队列研究在阜外医院进行,纳入2017年1月1日至2018年12月31日住院的18岁及以上心脏手术患者。70%的观察对象被随机选择用于训练,剩下的30%用于测试。利用人口统计学、合并症、实验室检查参数和手术细节,采用logistic回归和极限梯度增强(Xgboost)方法构建AKI预测模型。通过接收算子特征曲线下面积(AUROC)评估各模型在试验队列中的判别性,并通过校准图进行校准。结果:本研究共纳入15880例患者,其中4845例(30.5%)发生AKI。与logistic回归相比,Xgboost模型具有更高的判别能力(AUROC, 0.849 [95% CI, 0.837 - 0.861] vs 0.803[95% CI 0.790 - 0.817], P<0.001)。重症监护病房(ICU)到达时估计的肾小球滤过(eGFR)和肌酸是两个最重要的预测参数。使用SHAP总结图来说明归因于Xgboost模型的前15个特性的影响。结论:ML模型可以通过预测哪些患者无危险,为确定哪些患者围手术期应重点进行预防性治疗,先发制人地减少急性肾损伤提供临床决策支持。
An Explainable Machine Learning Model to Predict Acute Kidney Injury After Cardiac Surgery: A Retrospective Cohort Study
Background: To derive and validate a machine learning (ML) prediction model of acute kidney injury (AKI) that could be used for AKI surveillance and management to improve clinical outcomes. Methods: This retrospective cohort study was conducted in Fuwai Hospital, including patients aged 18 years and above undergoing cardiac surgery admitted between January 1, 2017, and December 31, 2018. Seventy percent of the observations were randomly selected for training and the remaining 30% for testing. The demographics, comorbidities, laboratory examination parameters, and operation details were used to construct a prediction model for AKI by logistic regression and eXtreme gradient boosting (Xgboost). The discrimination of each model was assessed on the test cohort by the area under the receiver operator characteristic (AUROC) curve, while calibration was performed by the calibration plot. Results: A total of 15,880 patients were enrolled in this study, and 4845 (30.5%) had developed AKI. Xgboost model had the higher discriminative ability compared with logistic regression (AUROC, 0.849 [95% CI, 0.837– 0.861] vs 0.803[95% CI 0.790– 0.817], P< 0.001) in the test dataset. The estimated glomerular filtration (eGFR) and creatine on intensive care unit (ICU) arrival are the two most important prediction parameters. A SHAP summary plot was used to illustrate the effects of the top 15 features attributed to the Xgboost model. Conclusion: ML models can provide clinical decision support to determine which patients should focus on perioperative preventive treatment to preemptively reduce acute kidney injury by predicting which patients are not at risk.
期刊介绍:
Clinical Epidemiology is an international, peer reviewed, open access journal. Clinical Epidemiology focuses on the application of epidemiological principles and questions relating to patients and clinical care in terms of prevention, diagnosis, prognosis, and treatment.
Clinical Epidemiology welcomes papers covering these topics in form of original research and systematic reviews.
Clinical Epidemiology has a special interest in international electronic medical patient records and other routine health care data, especially as applied to safety of medical interventions, clinical utility of diagnostic procedures, understanding short- and long-term clinical course of diseases, clinical epidemiological and biostatistical methods, and systematic reviews.
When considering submission of a paper utilizing publicly-available data, authors should ensure that such studies add significantly to the body of knowledge and that they use appropriate validated methods for identifying health outcomes.
The journal has launched special series describing existing data sources for clinical epidemiology, international health care systems and validation studies of algorithms based on databases and registries.