Development and validation of the eMCI-CHD tool: A multivariable prediction model for the risk of mild cognitive impairment in patients with coronary heart disease
{"title":"Development and validation of the eMCI-CHD tool: A multivariable prediction model for the risk of mild cognitive impairment in patients with coronary heart disease","authors":"Qing Wang, Yanfei Liu, Shihan Xu, Fenglan Liu, Luqi Huang, Fengqin Xu, Yue Liu","doi":"10.1111/jebm.12632","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Objective</h3>\n \n <p>This study aimed to develop and validate an eMCI-CHD tool based on clinical data to predict mild cognitive impairment (MCI) risk in patients with coronary heart disease (CHD).</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>This cross-sectional study prospectively collected data from 400 patients with coronary heart disease (aged 55–90 years, 62% men) from July 2022 to September 2023 and randomized (7:3 ratio) them into training and validation sets. After determining the modeling variables through least absolute shrinkage and selection operator regression analysis, four ML classifiers were developed: logistic regression, extreme gradient boosting (XGBoost), support vector machine, and random forest. The performance of the models was evaluated using area under the ROC curve, accuracy, sensitivity, specificity, and F1 score. Decision curve analysis was used to assess the clinical performance of the established models. The SHapley Additive exPlanations (SHAP) method was applied to determine the significance of the features, the predictive model was visualized with a nomogram, and an online web-based calculator for predicting CHD-MCI risk scores was developed.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Of 400 CHD patients (average age 70.86 ± 8.74 years), 220 (55%) had MCI. The XGBoost model demonstrated superior performance (AUC: 0.86, accuracy: 78.57%, sensitivity: 0.74, specificity: 0.84, F1: 0.79) and underwent validation. An online tool (https://mr.cscps.com.cn/mci/index.html) with seven predictive variables (<i>APOE</i> gene typing, age, education, TyG index, NT-proBNP, C-reactive protein, and occupation) assessed MCI risk in CHD patients.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>This study highlights the potential for predicting MCI risk among CHD patients using an ML model-driven nomogram and risk scoring tool based on clinical data.</p>\n </section>\n </div>","PeriodicalId":16090,"journal":{"name":"Journal of Evidence‐Based Medicine","volume":"17 3","pages":"535-549"},"PeriodicalIF":3.6000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Evidence‐Based Medicine","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jebm.12632","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective
This study aimed to develop and validate an eMCI-CHD tool based on clinical data to predict mild cognitive impairment (MCI) risk in patients with coronary heart disease (CHD).
Methods
This cross-sectional study prospectively collected data from 400 patients with coronary heart disease (aged 55–90 years, 62% men) from July 2022 to September 2023 and randomized (7:3 ratio) them into training and validation sets. After determining the modeling variables through least absolute shrinkage and selection operator regression analysis, four ML classifiers were developed: logistic regression, extreme gradient boosting (XGBoost), support vector machine, and random forest. The performance of the models was evaluated using area under the ROC curve, accuracy, sensitivity, specificity, and F1 score. Decision curve analysis was used to assess the clinical performance of the established models. The SHapley Additive exPlanations (SHAP) method was applied to determine the significance of the features, the predictive model was visualized with a nomogram, and an online web-based calculator for predicting CHD-MCI risk scores was developed.
Results
Of 400 CHD patients (average age 70.86 ± 8.74 years), 220 (55%) had MCI. The XGBoost model demonstrated superior performance (AUC: 0.86, accuracy: 78.57%, sensitivity: 0.74, specificity: 0.84, F1: 0.79) and underwent validation. An online tool (https://mr.cscps.com.cn/mci/index.html) with seven predictive variables (APOE gene typing, age, education, TyG index, NT-proBNP, C-reactive protein, and occupation) assessed MCI risk in CHD patients.
Conclusion
This study highlights the potential for predicting MCI risk among CHD patients using an ML model-driven nomogram and risk scoring tool based on clinical data.
期刊介绍:
The Journal of Evidence-Based Medicine (EMB) is an esteemed international healthcare and medical decision-making journal, dedicated to publishing groundbreaking research outcomes in evidence-based decision-making, research, practice, and education. Serving as the official English-language journal of the Cochrane China Centre and West China Hospital of Sichuan University, we eagerly welcome editorials, commentaries, and systematic reviews encompassing various topics such as clinical trials, policy, drug and patient safety, education, and knowledge translation.