Andrew Kalra BS , Preetham Bachina BS , Benjamin L. Shou BS , Jaeho Hwang MD , Meylakh Barshay BA , Shreyas Kulkarni BS , Isaac Sears BS , Carsten Eickhoff PhD , Christian A. Bermudez MD , Daniel Brodie MD , Corey E. Ventetuolo MD, MS , Glenn J.R. Whitman MD , Adeel Abbasi MD, ScM , Sung-Min Cho DO, MHS
{"title":"Using machine learning to predict neurologic injury in venovenous extracorporeal membrane oxygenation recipients: An ELSO Registry analysis","authors":"Andrew Kalra BS , Preetham Bachina BS , Benjamin L. Shou BS , Jaeho Hwang MD , Meylakh Barshay BA , Shreyas Kulkarni BS , Isaac Sears BS , Carsten Eickhoff PhD , Christian A. Bermudez MD , Daniel Brodie MD , Corey E. Ventetuolo MD, MS , Glenn J.R. Whitman MD , Adeel Abbasi MD, ScM , Sung-Min Cho DO, MHS","doi":"10.1016/j.xjon.2024.06.013","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Venovenous extracorporeal membrane oxygenation (VV-ECMO) is associated with acute brain injury (ABI), including central nervous system (CNS) ischemia (defined as ischemic stroke or hypoxic-ischemic brain injury [HIBI]) and intracranial hemorrhage (ICH). Data on prediction models for neurologic outcomes in VV-ECMO are limited.</div></div><div><h3>Methods</h3><div>We analyzed adult (age ≥18 years) VV-ECMO patients in the Extracorporeal Life Support Organization (ELSO) Registry (2009-2021) from 676 centers. ABI was defined as CNS ischemia, ICH, brain death, and seizures. Data on 67 variables were extracted, including clinical characteristics and pre-ECMO/on-ECMO variables. Random forest, CatBoost, LightGBM, and XGBoost machine learning (ML) algorithms (10-fold leave-one-out cross-validation) were used to predict ABI. Feature importance scores were used to pinpoint the most important variables for predicting ABI.</div></div><div><h3>Results</h3><div>Of 37,473 VV-ECMO patients (median age, 48.1 years; 63% male), 2644 (7.1%) experienced ABI, including 610 (2%) with CNS ischemia and 1591 (4%) with ICH. The areas under the receiver operating characteristic curve for predicting ABI, CNS ischemia, and ICH were 0.70, 0.68, and 0.70, respectively. The accuracy, positive predictive value, and negative predictive value for ABI were 85%, 19%, and 95%, respectively. ML identified higher center volume, pre-ECMO cardiac arrest, higher ECMO pump flow, and elevated on-ECMO serum lactate level as the most important risk factors for ABI and its subtypes.</div></div><div><h3>Conclusions</h3><div>This is the largest study of VV-ECMO patients to use ML to predict ABI reported to date. Performance was suboptimal, likely due to lack of standardization of neuromonitoring/imaging protocols and data granularity in the ELSO Registry. Standardized neurologic monitoring and imaging are needed across ELSO centers to detect the true prevalence of ABI.</div></div>","PeriodicalId":74032,"journal":{"name":"JTCVS open","volume":"21 ","pages":"Pages 140-167"},"PeriodicalIF":0.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JTCVS open","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666273624001736","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Venovenous extracorporeal membrane oxygenation (VV-ECMO) is associated with acute brain injury (ABI), including central nervous system (CNS) ischemia (defined as ischemic stroke or hypoxic-ischemic brain injury [HIBI]) and intracranial hemorrhage (ICH). Data on prediction models for neurologic outcomes in VV-ECMO are limited.
Methods
We analyzed adult (age ≥18 years) VV-ECMO patients in the Extracorporeal Life Support Organization (ELSO) Registry (2009-2021) from 676 centers. ABI was defined as CNS ischemia, ICH, brain death, and seizures. Data on 67 variables were extracted, including clinical characteristics and pre-ECMO/on-ECMO variables. Random forest, CatBoost, LightGBM, and XGBoost machine learning (ML) algorithms (10-fold leave-one-out cross-validation) were used to predict ABI. Feature importance scores were used to pinpoint the most important variables for predicting ABI.
Results
Of 37,473 VV-ECMO patients (median age, 48.1 years; 63% male), 2644 (7.1%) experienced ABI, including 610 (2%) with CNS ischemia and 1591 (4%) with ICH. The areas under the receiver operating characteristic curve for predicting ABI, CNS ischemia, and ICH were 0.70, 0.68, and 0.70, respectively. The accuracy, positive predictive value, and negative predictive value for ABI were 85%, 19%, and 95%, respectively. ML identified higher center volume, pre-ECMO cardiac arrest, higher ECMO pump flow, and elevated on-ECMO serum lactate level as the most important risk factors for ABI and its subtypes.
Conclusions
This is the largest study of VV-ECMO patients to use ML to predict ABI reported to date. Performance was suboptimal, likely due to lack of standardization of neuromonitoring/imaging protocols and data granularity in the ELSO Registry. Standardized neurologic monitoring and imaging are needed across ELSO centers to detect the true prevalence of ABI.