Jiale Dong, Zhechuan Jin, Chengxiang Li, Jian Yang, Yi Jiang, Zeqian Li, Cheng Chen, Bo Zhang, Zhaofei Ye, Yang Hu, Jianguo Ma, Ping Li, Yulin Li, Dongjin Wang, Zhili Ji
{"title":"机器学习模型在预测冠状动脉搭桥术后胃肠道出血和指导个性化医疗方面的预后意义:多中心队列研究。","authors":"Jiale Dong, Zhechuan Jin, Chengxiang Li, Jian Yang, Yi Jiang, Zeqian Li, Cheng Chen, Bo Zhang, Zhaofei Ye, Yang Hu, Jianguo Ma, Ping Li, Yulin Li, Dongjin Wang, Zhili Ji","doi":"10.2196/68509","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Gastrointestinal bleeding is a serious adverse event of coronary artery bypass grafting and lacks tailored risk assessment tools for personalized prevention.</p><p><strong>Objective: </strong>This study aims to develop and validate predictive models to assess the risk of gastrointestinal bleeding after coronary artery bypass grafting (GIBCG) and to guide personalized prevention.</p><p><strong>Methods: </strong>Participants were recruited from 4 medical centers, including a prospective cohort and the Medical Information Mart for Intensive Care IV (MIMIC-IV) database. From an initial cohort of 18,938 patients, 16,440 were included in the final analysis after applying the exclusion criteria. Thirty combinations of machine learning algorithms were compared, and the optimal model was selected based on integrated performance metrics, including the area under the receiver operating characteristic curve (AUROC) and the Brier score. This model was then developed into a web-based risk prediction calculator. The Shapley Additive Explanations method was used to provide both global and local explanations for the predictions.</p><p><strong>Results: </strong>The model was developed using data from 3 centers and a prospective cohort (n=13,399) and validated on the Drum Tower cohort (n=2745) and the MIMIC cohort (n=296). The optimal model, based on 15 easily accessible admission features, demonstrated an AUROC of 0.8482 (95% CI 0.8328-0.8618) in the derivation cohort. In external validation, the AUROC was 0.8513 (95% CI 0.8221-0.8782) for the Drum Tower cohort and 0.7811 (95% CI 0.7275-0.8343) for the MIMIC cohort. The analysis indicated that high-risk patients identified by the model had a significantly increased mortality risk (odds ratio 2.98, 95% CI 1.784-4.978; P<.001). For these high-risk populations, preoperative use of proton pump inhibitors was an independent protective factor against the occurrence of GIBCG. By contrast, dual antiplatelet therapy and oral anticoagulants were identified as independent risk factors. However, in low-risk populations, the use of proton pump inhibitors (χ<sup>2</sup><sub>1</sub>=0.13, P=.72), dual antiplatelet therapy (χ<sup>2</sup><sub>1</sub>=0.38, P=.54), and oral anticoagulants (χ<sup>2</sup><sub>1</sub>=0.15, P=.69) were not significantly associated with the occurrence of GIBCG.</p><p><strong>Conclusions: </strong>Our machine learning model accurately identified patients at high risk of GIBCG, who had a poor prognosis. This approach can aid in early risk stratification and personalized prevention.</p><p><strong>Trial registration: </strong>Chinese Clinical Registry Center ChiCTR2400086050; http://www.chictr.org.cn/showproj.html?proj=226129.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"27 ","pages":"e68509"},"PeriodicalIF":6.0000,"publicationDate":"2025-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11926454/pdf/","citationCount":"0","resultStr":"{\"title\":\"Machine Learning Models With Prognostic Implications for Predicting Gastrointestinal Bleeding After Coronary Artery Bypass Grafting and Guiding Personalized Medicine: Multicenter Cohort Study.\",\"authors\":\"Jiale Dong, Zhechuan Jin, Chengxiang Li, Jian Yang, Yi Jiang, Zeqian Li, Cheng Chen, Bo Zhang, Zhaofei Ye, Yang Hu, Jianguo Ma, Ping Li, Yulin Li, Dongjin Wang, Zhili Ji\",\"doi\":\"10.2196/68509\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Gastrointestinal bleeding is a serious adverse event of coronary artery bypass grafting and lacks tailored risk assessment tools for personalized prevention.</p><p><strong>Objective: </strong>This study aims to develop and validate predictive models to assess the risk of gastrointestinal bleeding after coronary artery bypass grafting (GIBCG) and to guide personalized prevention.</p><p><strong>Methods: </strong>Participants were recruited from 4 medical centers, including a prospective cohort and the Medical Information Mart for Intensive Care IV (MIMIC-IV) database. From an initial cohort of 18,938 patients, 16,440 were included in the final analysis after applying the exclusion criteria. Thirty combinations of machine learning algorithms were compared, and the optimal model was selected based on integrated performance metrics, including the area under the receiver operating characteristic curve (AUROC) and the Brier score. This model was then developed into a web-based risk prediction calculator. The Shapley Additive Explanations method was used to provide both global and local explanations for the predictions.</p><p><strong>Results: </strong>The model was developed using data from 3 centers and a prospective cohort (n=13,399) and validated on the Drum Tower cohort (n=2745) and the MIMIC cohort (n=296). The optimal model, based on 15 easily accessible admission features, demonstrated an AUROC of 0.8482 (95% CI 0.8328-0.8618) in the derivation cohort. In external validation, the AUROC was 0.8513 (95% CI 0.8221-0.8782) for the Drum Tower cohort and 0.7811 (95% CI 0.7275-0.8343) for the MIMIC cohort. The analysis indicated that high-risk patients identified by the model had a significantly increased mortality risk (odds ratio 2.98, 95% CI 1.784-4.978; P<.001). For these high-risk populations, preoperative use of proton pump inhibitors was an independent protective factor against the occurrence of GIBCG. By contrast, dual antiplatelet therapy and oral anticoagulants were identified as independent risk factors. However, in low-risk populations, the use of proton pump inhibitors (χ<sup>2</sup><sub>1</sub>=0.13, P=.72), dual antiplatelet therapy (χ<sup>2</sup><sub>1</sub>=0.38, P=.54), and oral anticoagulants (χ<sup>2</sup><sub>1</sub>=0.15, P=.69) were not significantly associated with the occurrence of GIBCG.</p><p><strong>Conclusions: </strong>Our machine learning model accurately identified patients at high risk of GIBCG, who had a poor prognosis. This approach can aid in early risk stratification and personalized prevention.</p><p><strong>Trial registration: </strong>Chinese Clinical Registry Center ChiCTR2400086050; http://www.chictr.org.cn/showproj.html?proj=226129.</p>\",\"PeriodicalId\":16337,\"journal\":{\"name\":\"Journal of Medical Internet Research\",\"volume\":\"27 \",\"pages\":\"e68509\"},\"PeriodicalIF\":6.0000,\"publicationDate\":\"2025-03-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11926454/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Medical Internet Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2196/68509\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Internet Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2196/68509","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
摘要
背景:胃肠道出血是冠状动脉搭桥术的严重不良事件,缺乏个性化预防的风险评估工具。目的:建立并验证预测模型,评估冠状动脉旁路移植术(GIBCG)术后消化道出血风险,指导个体化预防。方法:从4个医疗中心招募参与者,包括前瞻性队列和重症监护医学信息市场IV (MIMIC-IV)数据库。在初始队列18,938例患者中,应用排除标准后,最终分析纳入16,440例患者。比较了30种机器学习算法组合,并根据综合性能指标(包括受试者工作特征曲线下面积(AUROC)和Brier评分)选择了最优模型。该模型随后发展成为基于网络的风险预测计算器。沙普利加性解释方法用于提供预测的全局和局部解释。结果:该模型使用了来自3个中心和一个前瞻性队列(n=13,399)的数据,并在鼓楼队列(n=2745)和MIMIC队列(n=296)上进行了验证。基于15个易于获取的入院特征的最优模型在衍生队列中显示AUROC为0.8482 (95% CI 0.8328-0.8618)。在外部验证中,鼓楼队列的AUROC为0.8513 (95% CI 0.8221-0.8782), MIMIC队列的AUROC为0.7811 (95% CI 0.7275-0.8343)。分析表明,模型识别出的高危患者死亡风险显著增加(优势比2.98,95% CI 1.784-4.978;P21=0.13, P= 0.72)、双重抗血小板治疗(χ21=0.38, P= 0.54)和口服抗凝药物(χ21=0.15, P= 0.69)与GIBCG的发生无显著相关。结论:我们的机器学习模型准确识别了预后较差的GIBCG高危患者。这种方法有助于早期风险分层和个性化预防。试验注册:中国临床注册中心ChiCTR2400086050;http://www.chictr.org.cn/showproj.html?proj=226129。
Machine Learning Models With Prognostic Implications for Predicting Gastrointestinal Bleeding After Coronary Artery Bypass Grafting and Guiding Personalized Medicine: Multicenter Cohort Study.
Background: Gastrointestinal bleeding is a serious adverse event of coronary artery bypass grafting and lacks tailored risk assessment tools for personalized prevention.
Objective: This study aims to develop and validate predictive models to assess the risk of gastrointestinal bleeding after coronary artery bypass grafting (GIBCG) and to guide personalized prevention.
Methods: Participants were recruited from 4 medical centers, including a prospective cohort and the Medical Information Mart for Intensive Care IV (MIMIC-IV) database. From an initial cohort of 18,938 patients, 16,440 were included in the final analysis after applying the exclusion criteria. Thirty combinations of machine learning algorithms were compared, and the optimal model was selected based on integrated performance metrics, including the area under the receiver operating characteristic curve (AUROC) and the Brier score. This model was then developed into a web-based risk prediction calculator. The Shapley Additive Explanations method was used to provide both global and local explanations for the predictions.
Results: The model was developed using data from 3 centers and a prospective cohort (n=13,399) and validated on the Drum Tower cohort (n=2745) and the MIMIC cohort (n=296). The optimal model, based on 15 easily accessible admission features, demonstrated an AUROC of 0.8482 (95% CI 0.8328-0.8618) in the derivation cohort. In external validation, the AUROC was 0.8513 (95% CI 0.8221-0.8782) for the Drum Tower cohort and 0.7811 (95% CI 0.7275-0.8343) for the MIMIC cohort. The analysis indicated that high-risk patients identified by the model had a significantly increased mortality risk (odds ratio 2.98, 95% CI 1.784-4.978; P<.001). For these high-risk populations, preoperative use of proton pump inhibitors was an independent protective factor against the occurrence of GIBCG. By contrast, dual antiplatelet therapy and oral anticoagulants were identified as independent risk factors. However, in low-risk populations, the use of proton pump inhibitors (χ21=0.13, P=.72), dual antiplatelet therapy (χ21=0.38, P=.54), and oral anticoagulants (χ21=0.15, P=.69) were not significantly associated with the occurrence of GIBCG.
Conclusions: Our machine learning model accurately identified patients at high risk of GIBCG, who had a poor prognosis. This approach can aid in early risk stratification and personalized prevention.
Trial registration: Chinese Clinical Registry Center ChiCTR2400086050; http://www.chictr.org.cn/showproj.html?proj=226129.
期刊介绍:
The Journal of Medical Internet Research (JMIR) is a highly respected publication in the field of health informatics and health services. With a founding date in 1999, JMIR has been a pioneer in the field for over two decades.
As a leader in the industry, the journal focuses on digital health, data science, health informatics, and emerging technologies for health, medicine, and biomedical research. It is recognized as a top publication in these disciplines, ranking in the first quartile (Q1) by Impact Factor.
Notably, JMIR holds the prestigious position of being ranked #1 on Google Scholar within the "Medical Informatics" discipline.