Andreas Leha, Cynthia Huber, Tim Friede, Timm Bauer, Andreas Beckmann, Raffi Bekeredjian, Sabine Bleiziffer, Eva Herrmann, Helge Möllmann, Thomas Walther, Friedhelm Beyersdorf, Christian Hamm, Arnaud Künzi, Stephan Windecker, Stefan Stortecky, Ingo Kutschka, Gerd Hasenfuß, Stephan Ensminger, Christian Frerker, Tim Seidler
{"title":"经导管主动脉瓣置入术中死亡风险的可解释机器学习模型的开发和验证:TAVI风险机器评分。","authors":"Andreas Leha, Cynthia Huber, Tim Friede, Timm Bauer, Andreas Beckmann, Raffi Bekeredjian, Sabine Bleiziffer, Eva Herrmann, Helge Möllmann, Thomas Walther, Friedhelm Beyersdorf, Christian Hamm, Arnaud Künzi, Stephan Windecker, Stefan Stortecky, Ingo Kutschka, Gerd Hasenfuß, Stephan Ensminger, Christian Frerker, Tim Seidler","doi":"10.1093/ehjdh/ztad021","DOIUrl":null,"url":null,"abstract":"<p><strong>Aims: </strong>Identification of high-risk patients and individualized decision support based on objective criteria for rapid discharge after transcatheter aortic valve implantation (TAVI) are key requirements in the context of contemporary TAVI treatment. This study aimed to predict 30-day mortality following TAVI based on machine learning (ML) using data from the German Aortic Valve Registry.</p><p><strong>Methods and results: </strong>Mortality risk was determined using a random forest ML model that was condensed in the newly developed TAVI Risk Machine (TRIM) scores, designed to represent clinically meaningful risk modelling before (TRIMpre) and in particular after (TRIMpost) TAVI. Algorithm was trained and cross-validated on data of 22 283 patients (729 died within 30 days post-TAVI) and generalisation was examined on data of 5864 patients (146 died). TRIMpost demonstrated significantly better performance than traditional scores [<i>C</i>-statistics value, 0.79; 95% confidence interval (CI)] [0.74; 0.83] compared to Society of Thoracic Surgeons (STS) with <i>C</i>-statistics value 0.69; 95%-CI [0.65; 0.74]). An abridged (aTRIMpost) score comprising 25 features (calculated using a web interface) exhibited significantly higher performance than traditional scores (<i>C</i>-statistics value, 0.74; 95%-CI [0.70; 0.78]). Validation on external data of 6693 patients (205 died within 30 days post-TAVI) of the Swiss TAVI Registry confirmed significantly better performance for the TRIMpost (<i>C</i>-statistics value 0.75, 95%-CI [0.72; 0.79]) compared to STS (<i>C</i>-statistics value 0.67, CI [0.63; 0.70]).</p><p><strong>Conclusion: </strong>TRIM scores demonstrate good performance for risk estimation before and after TAVI. Together with clinical judgement, they may support standardised and objective decision-making before and after TAVI.</p>","PeriodicalId":72965,"journal":{"name":"European heart journal. Digital health","volume":null,"pages":null},"PeriodicalIF":3.9000,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/61/90/ztad021.PMC10232286.pdf","citationCount":"0","resultStr":"{\"title\":\"Development and validation of explainable machine learning models for risk of mortality in transcatheter aortic valve implantation: TAVI risk machine scores.\",\"authors\":\"Andreas Leha, Cynthia Huber, Tim Friede, Timm Bauer, Andreas Beckmann, Raffi Bekeredjian, Sabine Bleiziffer, Eva Herrmann, Helge Möllmann, Thomas Walther, Friedhelm Beyersdorf, Christian Hamm, Arnaud Künzi, Stephan Windecker, Stefan Stortecky, Ingo Kutschka, Gerd Hasenfuß, Stephan Ensminger, Christian Frerker, Tim Seidler\",\"doi\":\"10.1093/ehjdh/ztad021\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Aims: </strong>Identification of high-risk patients and individualized decision support based on objective criteria for rapid discharge after transcatheter aortic valve implantation (TAVI) are key requirements in the context of contemporary TAVI treatment. This study aimed to predict 30-day mortality following TAVI based on machine learning (ML) using data from the German Aortic Valve Registry.</p><p><strong>Methods and results: </strong>Mortality risk was determined using a random forest ML model that was condensed in the newly developed TAVI Risk Machine (TRIM) scores, designed to represent clinically meaningful risk modelling before (TRIMpre) and in particular after (TRIMpost) TAVI. Algorithm was trained and cross-validated on data of 22 283 patients (729 died within 30 days post-TAVI) and generalisation was examined on data of 5864 patients (146 died). TRIMpost demonstrated significantly better performance than traditional scores [<i>C</i>-statistics value, 0.79; 95% confidence interval (CI)] [0.74; 0.83] compared to Society of Thoracic Surgeons (STS) with <i>C</i>-statistics value 0.69; 95%-CI [0.65; 0.74]). An abridged (aTRIMpost) score comprising 25 features (calculated using a web interface) exhibited significantly higher performance than traditional scores (<i>C</i>-statistics value, 0.74; 95%-CI [0.70; 0.78]). Validation on external data of 6693 patients (205 died within 30 days post-TAVI) of the Swiss TAVI Registry confirmed significantly better performance for the TRIMpost (<i>C</i>-statistics value 0.75, 95%-CI [0.72; 0.79]) compared to STS (<i>C</i>-statistics value 0.67, CI [0.63; 0.70]).</p><p><strong>Conclusion: </strong>TRIM scores demonstrate good performance for risk estimation before and after TAVI. Together with clinical judgement, they may support standardised and objective decision-making before and after TAVI.</p>\",\"PeriodicalId\":72965,\"journal\":{\"name\":\"European heart journal. Digital health\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2023-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/61/90/ztad021.PMC10232286.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European heart journal. Digital health\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/ehjdh/ztad021\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CARDIAC & CARDIOVASCULAR SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European heart journal. Digital health","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/ehjdh/ztad021","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CARDIAC & CARDIOVASCULAR SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
目的:在当代主动脉瓣置入术(TAVI)治疗的背景下,根据客观标准识别高危患者和个性化决策支持是TAVI治疗的关键要求。本研究旨在利用德国主动脉瓣登记处的数据,基于机器学习(ML)预测TAVI后30天的死亡率。方法和结果:使用随机森林ML模型确定死亡风险,该模型浓缩在新开发的TAVI风险机器(TRIM)评分中,旨在表示在(TRIMpre) TAVI之前,特别是(TRIMpost) TAVI之后有临床意义的风险模型。对22 283例患者(729例tavi后30天内死亡)的数据进行训练和交叉验证,并对5864例患者(146例死亡)的数据进行泛化检验。TRIMpost的表现明显优于传统评分[c统计值,0.79;95%置信区间[0.74;0.83]而胸外科学会(STS)的c统计值为0.69;95% ci 0.65;0.74])。包含25个特征(使用web界面计算)的精简(aTRIMpost)分数表现出比传统分数显著更高的性能(c统计值,0.74;95% ci 0.70;0.78])。瑞士TAVI注册中心6693例患者(其中205例在TAVI后30天内死亡)的外部数据验证证实TRIMpost的疗效显著更好(c -统计值0.75,95% ci [0.72;0.79])与STS相比(c统计值0.67,CI [0.63;0.70])。结论:TRIM评分对TAVI前后的风险评估有较好的效果。与临床判断相结合,可为TAVI前后的规范化、客观决策提供支持。
Development and validation of explainable machine learning models for risk of mortality in transcatheter aortic valve implantation: TAVI risk machine scores.
Aims: Identification of high-risk patients and individualized decision support based on objective criteria for rapid discharge after transcatheter aortic valve implantation (TAVI) are key requirements in the context of contemporary TAVI treatment. This study aimed to predict 30-day mortality following TAVI based on machine learning (ML) using data from the German Aortic Valve Registry.
Methods and results: Mortality risk was determined using a random forest ML model that was condensed in the newly developed TAVI Risk Machine (TRIM) scores, designed to represent clinically meaningful risk modelling before (TRIMpre) and in particular after (TRIMpost) TAVI. Algorithm was trained and cross-validated on data of 22 283 patients (729 died within 30 days post-TAVI) and generalisation was examined on data of 5864 patients (146 died). TRIMpost demonstrated significantly better performance than traditional scores [C-statistics value, 0.79; 95% confidence interval (CI)] [0.74; 0.83] compared to Society of Thoracic Surgeons (STS) with C-statistics value 0.69; 95%-CI [0.65; 0.74]). An abridged (aTRIMpost) score comprising 25 features (calculated using a web interface) exhibited significantly higher performance than traditional scores (C-statistics value, 0.74; 95%-CI [0.70; 0.78]). Validation on external data of 6693 patients (205 died within 30 days post-TAVI) of the Swiss TAVI Registry confirmed significantly better performance for the TRIMpost (C-statistics value 0.75, 95%-CI [0.72; 0.79]) compared to STS (C-statistics value 0.67, CI [0.63; 0.70]).
Conclusion: TRIM scores demonstrate good performance for risk estimation before and after TAVI. Together with clinical judgement, they may support standardised and objective decision-making before and after TAVI.