Liam Butler PhD , Ibrahim Karabayir PhD , Dalane W. Kitzman MD , Alvaro Alonso MD, PhD , Geoffrey H. Tison MD, MPH , Lin Yee Chen MD, MS , Patricia P. Chang MD, MHS , Gari Clifford PhD , Elsayed Z. Soliman MD, MS , Oguz Akbilgic DBA, PhD
{"title":"A generalizable electrocardiogram-based artificial intelligence model for 10-year heart failure risk prediction","authors":"Liam Butler PhD , Ibrahim Karabayir PhD , Dalane W. Kitzman MD , Alvaro Alonso MD, PhD , Geoffrey H. Tison MD, MPH , Lin Yee Chen MD, MS , Patricia P. Chang MD, MHS , Gari Clifford PhD , Elsayed Z. Soliman MD, MS , Oguz Akbilgic DBA, PhD","doi":"10.1016/j.cvdhj.2023.11.003","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Heart failure (HF) is a progressive condition with high global incidence. HF has two main subtypes: HF with preserved ejection fraction (HFpEF) and HF with reduced ejection fraction (HFrEF). There is an inherent need for simple yet effective electrocardiogram (ECG)-based artificial intelligence (AI; ECG-AI) models that can predict HF risk early to allow for risk modification.</p></div><div><h3>Objective</h3><p>The main objectives were to validate HF risk prediction models using Multi-Ethnic Study of Atherosclerosis (MESA) data and assess performance on HFpEF and HFrEF classification.</p></div><div><h3>Methods</h3><p>There were six models in comparision derived using ARIC data. 1) The ECG-AI model predicting HF risk was developed using raw 12-lead ECGs with a convolutional neural network. The clinical models from 2) ARIC (ARIC-HF) and 3) Framingham Heart Study (FHS-HF) used 9 and 8 variables, respectively. 4) Cox proportional hazards (CPH) model developed using the clinical risk factors in ARIC-HF or FHS-HF. 5) CPH model using the outcome of ECG-AI and the clinical risk factors used in CPH model (ECG-AI-Cox) and 6) A Light Gradient Boosting Machine model using 288 ECG Characteristics (ECG-Chars). All the models were validated on MESA. The performances of these models were evaluated using the area under the receiver operating characteristic curve (AUC) and compared using the DeLong test.</p></div><div><h3>Results</h3><p>ECG-AI, ECG-Chars, and ECG-AI-Cox resulted in validation AUCs of 0.77, 0.73, and 0.84, respectively. ARIC-HF and FHS-HF yielded AUCs of 0.76 and 0.74, respectively, and CPH resulted in AUC = 0.78. ECG-AI-Cox outperformed all other models. ECG-AI-Cox provided an AUC of 0.85 for HFrEF and 0.83 for HFpEF.</p></div><div><h3>Conclusion</h3><p>ECG-AI using ECGs provides better-validated predictions when compared to HF risk calculators, and the ECG feature model and also works well with HFpEF and HFrEF classification.</p></div>","PeriodicalId":72527,"journal":{"name":"Cardiovascular digital health journal","volume":"4 6","pages":"Pages 183-190"},"PeriodicalIF":2.6000,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666693623000762/pdfft?md5=8ef34da86fd7e31cf9150c7011f22cef&pid=1-s2.0-S2666693623000762-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cardiovascular digital health journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666693623000762","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CARDIAC & CARDIOVASCULAR SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Heart failure (HF) is a progressive condition with high global incidence. HF has two main subtypes: HF with preserved ejection fraction (HFpEF) and HF with reduced ejection fraction (HFrEF). There is an inherent need for simple yet effective electrocardiogram (ECG)-based artificial intelligence (AI; ECG-AI) models that can predict HF risk early to allow for risk modification.
Objective
The main objectives were to validate HF risk prediction models using Multi-Ethnic Study of Atherosclerosis (MESA) data and assess performance on HFpEF and HFrEF classification.
Methods
There were six models in comparision derived using ARIC data. 1) The ECG-AI model predicting HF risk was developed using raw 12-lead ECGs with a convolutional neural network. The clinical models from 2) ARIC (ARIC-HF) and 3) Framingham Heart Study (FHS-HF) used 9 and 8 variables, respectively. 4) Cox proportional hazards (CPH) model developed using the clinical risk factors in ARIC-HF or FHS-HF. 5) CPH model using the outcome of ECG-AI and the clinical risk factors used in CPH model (ECG-AI-Cox) and 6) A Light Gradient Boosting Machine model using 288 ECG Characteristics (ECG-Chars). All the models were validated on MESA. The performances of these models were evaluated using the area under the receiver operating characteristic curve (AUC) and compared using the DeLong test.
Results
ECG-AI, ECG-Chars, and ECG-AI-Cox resulted in validation AUCs of 0.77, 0.73, and 0.84, respectively. ARIC-HF and FHS-HF yielded AUCs of 0.76 and 0.74, respectively, and CPH resulted in AUC = 0.78. ECG-AI-Cox outperformed all other models. ECG-AI-Cox provided an AUC of 0.85 for HFrEF and 0.83 for HFpEF.
Conclusion
ECG-AI using ECGs provides better-validated predictions when compared to HF risk calculators, and the ECG feature model and also works well with HFpEF and HFrEF classification.