Construction and validation of predictive models for intravenous immunoglobulin-resistant Kawasaki disease using an interpretable machine learning approach.
Linfan Deng, Jian Zhao, Ting Wang, Bin Liu, Jun Jiang, Peng Jia, Dong Liu, Gang Li
{"title":"Construction and validation of predictive models for intravenous immunoglobulin-resistant Kawasaki disease using an interpretable machine learning approach.","authors":"Linfan Deng, Jian Zhao, Ting Wang, Bin Liu, Jun Jiang, Peng Jia, Dong Liu, Gang Li","doi":"10.3345/cep.2024.00549","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Intravenous immunoglobulin (IVIG)-resistant Kawasaki disease is associated with coronary artery lesion development.</p><p><strong>Purpose: </strong>This study aimed to explore the factors associated with IVIG-resistance and construct and validate an interpretable machine learning (ML) prediction model in clinical practice.</p><p><strong>Methods: </strong>Between December 2014 and November 2022, 602 patients were screened and risk factors for IVIG-resistance investigated. Five ML models are used to establish an optimal prediction model. The SHapley Additive exPlanations (SHAP) method was used to interpret the ML model.</p><p><strong>Results: </strong>Na+, hemoglobin (Hb), C-reactive protein (CRP), and globulin were independent risk factors for IVIG-resistance. A nonlinear relationship was identified between globulin level and IVIG-resistance. The XGBoost model exhibited excellent performance, with an area under the receiver operating characteristic curve of 0.821, accuracy of 0.748, sensitivity of 0.889, and specificity of 0.683 in the testing set. The XGBoost model was interpreted globally and locally using the SHAP method.</p><p><strong>Conclusion: </strong>Na+, Hb, CRP, and globulin levels were independently associated with IVIG-resistance. Our findings demonstrate that ML models can reliably predict IVIG-resistance. Moreover, use of the SHAP method to interpret the established XGBoost model's findings would provide evidence of IVIG-resistance and guide the individualized treatment of Kawasaki disease.</p>","PeriodicalId":36018,"journal":{"name":"Clinical and Experimental Pediatrics","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11298769/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical and Experimental Pediatrics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3345/cep.2024.00549","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/23 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PEDIATRICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Intravenous immunoglobulin (IVIG)-resistant Kawasaki disease is associated with coronary artery lesion development.
Purpose: This study aimed to explore the factors associated with IVIG-resistance and construct and validate an interpretable machine learning (ML) prediction model in clinical practice.
Methods: Between December 2014 and November 2022, 602 patients were screened and risk factors for IVIG-resistance investigated. Five ML models are used to establish an optimal prediction model. The SHapley Additive exPlanations (SHAP) method was used to interpret the ML model.
Results: Na+, hemoglobin (Hb), C-reactive protein (CRP), and globulin were independent risk factors for IVIG-resistance. A nonlinear relationship was identified between globulin level and IVIG-resistance. The XGBoost model exhibited excellent performance, with an area under the receiver operating characteristic curve of 0.821, accuracy of 0.748, sensitivity of 0.889, and specificity of 0.683 in the testing set. The XGBoost model was interpreted globally and locally using the SHAP method.
Conclusion: Na+, Hb, CRP, and globulin levels were independently associated with IVIG-resistance. Our findings demonstrate that ML models can reliably predict IVIG-resistance. Moreover, use of the SHAP method to interpret the established XGBoost model's findings would provide evidence of IVIG-resistance and guide the individualized treatment of Kawasaki disease.