Okan İnce, Hakan Önder, Mehmet Gençtürk, Jafar Golzarian, Shamar Young
{"title":"改进红外临床决策:预测 TIPS 手术后腹水改善情况的可解释机器学习模型。","authors":"Okan İnce, Hakan Önder, Mehmet Gençtürk, Jafar Golzarian, Shamar Young","doi":"10.1016/j.jvir.2024.09.022","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To evaluate the potential of interpretable machine learning (ML) models to predict ascites improvement in patients undergoing transjugular intrahepatic portosystemic shunt (TIPS) placement for refractory ascites.</p><p><strong>Materials and methods: </strong>In this retrospective study, 218 patients with refractory ascites who underwent TIPS placement were analyzed. Data on 29 demographic, clinical, and procedural features were collected. Ascites improvement was defined as reduction in the need of paracentesis by 50% or more at the 1-month follow-up. Univariate statistical analysis was performed. Data were split into train and test sets. Feature selection was performed using a wrapper-based sequential feature selection algorithm. Two ML models were built using support vector machine (SVM) and CatBoost algorithms. Shapley additive explanations values were calculated to assess interpretability of ML models. Performance metrics were calculated using the test set.</p><p><strong>Results: </strong>Refractory ascites improved in 168 (77%) patients. Higher sodium (Na; 136 mEq/L vs 134 mEq/L; P = .001) and albumin (2.91 g/dL vs 2.68 g/dL; P = .03) levels, lower creatinine levels (1.01 mg/dL vs 1.17 mg/dL; P = .04), and lower Model for End-stage Liver Disease (MELD) (13 vs 15; P = .01) and MELD-Na (15 vs 17.5, P = .002) scores were associated with significant improvement, whereas main portal vein puncture was associated with a lower improvement rate (P = .02). SVM and CatBoost models had accuracy ratios of 83% and 87%, with area under the curve values of 0.83 and 0.87, respectively. No statistically significant difference was found between performances of the models in DeLong test (P = .3).</p><p><strong>Conclusions: </strong>ML models may have potential in patient selection for TIPS placement by predicting the improvement in refractory ascites.</p>","PeriodicalId":49962,"journal":{"name":"Journal of Vascular and Interventional Radiology","volume":" ","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving Clinical Decisions in IR: Interpretable Machine Learning Models for Predicting Ascites Improvement after Transjugular Intrahepatic Portosystemic Shunt Procedures.\",\"authors\":\"Okan İnce, Hakan Önder, Mehmet Gençtürk, Jafar Golzarian, Shamar Young\",\"doi\":\"10.1016/j.jvir.2024.09.022\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>To evaluate the potential of interpretable machine learning (ML) models to predict ascites improvement in patients undergoing transjugular intrahepatic portosystemic shunt (TIPS) placement for refractory ascites.</p><p><strong>Materials and methods: </strong>In this retrospective study, 218 patients with refractory ascites who underwent TIPS placement were analyzed. Data on 29 demographic, clinical, and procedural features were collected. Ascites improvement was defined as reduction in the need of paracentesis by 50% or more at the 1-month follow-up. Univariate statistical analysis was performed. Data were split into train and test sets. Feature selection was performed using a wrapper-based sequential feature selection algorithm. Two ML models were built using support vector machine (SVM) and CatBoost algorithms. Shapley additive explanations values were calculated to assess interpretability of ML models. Performance metrics were calculated using the test set.</p><p><strong>Results: </strong>Refractory ascites improved in 168 (77%) patients. Higher sodium (Na; 136 mEq/L vs 134 mEq/L; P = .001) and albumin (2.91 g/dL vs 2.68 g/dL; P = .03) levels, lower creatinine levels (1.01 mg/dL vs 1.17 mg/dL; P = .04), and lower Model for End-stage Liver Disease (MELD) (13 vs 15; P = .01) and MELD-Na (15 vs 17.5, P = .002) scores were associated with significant improvement, whereas main portal vein puncture was associated with a lower improvement rate (P = .02). SVM and CatBoost models had accuracy ratios of 83% and 87%, with area under the curve values of 0.83 and 0.87, respectively. No statistically significant difference was found between performances of the models in DeLong test (P = .3).</p><p><strong>Conclusions: </strong>ML models may have potential in patient selection for TIPS placement by predicting the improvement in refractory ascites.</p>\",\"PeriodicalId\":49962,\"journal\":{\"name\":\"Journal of Vascular and Interventional Radiology\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-10-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Vascular and Interventional Radiology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1016/j.jvir.2024.09.022\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PERIPHERAL VASCULAR DISEASE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Vascular and Interventional Radiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.jvir.2024.09.022","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
引用次数: 0
摘要
目的:评估可解释的机器学习(ML)模型预测因难治性腹水而接受经颈静脉肝内门体分流术(TIPS)的患者腹水改善情况的潜力:在这项回顾性研究中,对 218 名接受 TIPS 的难治性腹水患者进行了分析。研究收集了 29 项人口统计学、临床和手术特征。腹水改善的定义是随访一个月时腹腔穿刺次数减少 50%或以上。进行了单变量统计分析。数据分为训练集和测试集。使用基于包装器的序列特征选择(SFS)算法进行特征选择。使用支持向量机(SVM)和 CatBoost 算法建立了两个 ML 模型。通过计算 Shapley 加法解释值来评估 ML 模型的可解释性。使用测试集计算性能指标:168(77%)名患者的难治性腹水得到了改善。较高的钠(136mEq/L vs 134mEq/L,p=0.001)和白蛋白水平(2.91 g/dLvs2.68 g/dL,p=0.03)、较低的肌酐(1.01 mg/dL vs 1.17 mg/dL,p=0.04)、终末期肝病模型(MELD)(13 vs 15,p=0.01)和 MELD-Na (15 vs 17.5,p=0.002)评分与病情显著改善有关。而主门静脉穿刺与较低的改善率相关(P=0.02)。SVM 和 CatBoost 模型的准确率分别为 83% 和 87%,曲线下面积值分别为 0.83 和 0.87。在 DeLong 检验中,各模型之间的性能差异无统计学意义(P=0.3):根据这项研究,机器学习模型可以预测难治性腹水的改善情况,从而在选择患者进行 TIPS 置入时发挥潜在作用。
Improving Clinical Decisions in IR: Interpretable Machine Learning Models for Predicting Ascites Improvement after Transjugular Intrahepatic Portosystemic Shunt Procedures.
Purpose: To evaluate the potential of interpretable machine learning (ML) models to predict ascites improvement in patients undergoing transjugular intrahepatic portosystemic shunt (TIPS) placement for refractory ascites.
Materials and methods: In this retrospective study, 218 patients with refractory ascites who underwent TIPS placement were analyzed. Data on 29 demographic, clinical, and procedural features were collected. Ascites improvement was defined as reduction in the need of paracentesis by 50% or more at the 1-month follow-up. Univariate statistical analysis was performed. Data were split into train and test sets. Feature selection was performed using a wrapper-based sequential feature selection algorithm. Two ML models were built using support vector machine (SVM) and CatBoost algorithms. Shapley additive explanations values were calculated to assess interpretability of ML models. Performance metrics were calculated using the test set.
Results: Refractory ascites improved in 168 (77%) patients. Higher sodium (Na; 136 mEq/L vs 134 mEq/L; P = .001) and albumin (2.91 g/dL vs 2.68 g/dL; P = .03) levels, lower creatinine levels (1.01 mg/dL vs 1.17 mg/dL; P = .04), and lower Model for End-stage Liver Disease (MELD) (13 vs 15; P = .01) and MELD-Na (15 vs 17.5, P = .002) scores were associated with significant improvement, whereas main portal vein puncture was associated with a lower improvement rate (P = .02). SVM and CatBoost models had accuracy ratios of 83% and 87%, with area under the curve values of 0.83 and 0.87, respectively. No statistically significant difference was found between performances of the models in DeLong test (P = .3).
Conclusions: ML models may have potential in patient selection for TIPS placement by predicting the improvement in refractory ascites.
期刊介绍:
JVIR, published continuously since 1990, is an international, monthly peer-reviewed interventional radiology journal. As the official journal of the Society of Interventional Radiology, JVIR is the peer-reviewed journal of choice for interventional radiologists, radiologists, cardiologists, vascular surgeons, neurosurgeons, and other clinicians who seek current and reliable information on every aspect of vascular and interventional radiology. Each issue of JVIR covers critical and cutting-edge medical minimally invasive, clinical, basic research, radiological, pathological, and socioeconomic issues of importance to the field.