Juliana Pereira-Macedo , Ana Daniela Pias , Luís Duarte-Gamas , Piotr Myrcha , José P. Andrade , Nuno António , Ana Marreiros , João Rocha-Neves
{"title":"Predictive Factors Driving Positive Awake Test in Carotid Endarterectomy Using Machine Learning","authors":"Juliana Pereira-Macedo , Ana Daniela Pias , Luís Duarte-Gamas , Piotr Myrcha , José P. Andrade , Nuno António , Ana Marreiros , João Rocha-Neves","doi":"10.1016/j.avsg.2024.10.011","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Positive neurologic awake testing during the carotid cross-clamping may be present in around 8% of patients undergoing carotid endarterectomy (CEA). The present work aimed to assess the accuracy of an artificial intelligence (AI)-powered risk calculator in predicting intraoperative neurologic deficits (INDs).</div></div><div><h3>Methods</h3><div>Data was collected from carotid interventions performed between January 2012 and January 2023 under regional anesthesia. Patients with IND were selected along with consecutive controls without IND in a case-control study design. A predictive model for IND was developed using machine learning, specifically Extreme Gradient Boosting (XGBoost) model, and its performance was assessed and compared to an existing predictive model. Shapley Additive exPlanations (SHAP) analysis was employed for the model interpretation.</div></div><div><h3>Results</h3><div>Among 216 patients, 108 experienced IND during CEA. The AI-based predictive model achieved a robust area under the curve of 0.82, with an accuracy of 0.75, precision of 0.88, sensitivity of 0.59, and F1Score of 0.71. High body mass index (BMI) increased contralateral carotid stenosis, and a history of limb paresis or plegia were significant IND risk factors. Elevated preoperative platelet and hemoglobin levels were associated with reduced IND risk.</div></div><div><h3>Conclusions</h3><div>This AI model provides precise IND prediction in CEA, enabling tailored interventions for high-risk patients and ultimately improving surgical outcomes. BMI, contralateral stenosis, and selected blood parameters emerged as pivotal predictors, bringing significant advancements to decision-making in CEA procedures. Further validation in larger cohorts is essential for broader clinical implementation.</div></div>","PeriodicalId":8061,"journal":{"name":"Annals of vascular surgery","volume":"111 ","pages":"Pages 110-121"},"PeriodicalIF":1.4000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of vascular surgery","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0890509624006769","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Positive neurologic awake testing during the carotid cross-clamping may be present in around 8% of patients undergoing carotid endarterectomy (CEA). The present work aimed to assess the accuracy of an artificial intelligence (AI)-powered risk calculator in predicting intraoperative neurologic deficits (INDs).
Methods
Data was collected from carotid interventions performed between January 2012 and January 2023 under regional anesthesia. Patients with IND were selected along with consecutive controls without IND in a case-control study design. A predictive model for IND was developed using machine learning, specifically Extreme Gradient Boosting (XGBoost) model, and its performance was assessed and compared to an existing predictive model. Shapley Additive exPlanations (SHAP) analysis was employed for the model interpretation.
Results
Among 216 patients, 108 experienced IND during CEA. The AI-based predictive model achieved a robust area under the curve of 0.82, with an accuracy of 0.75, precision of 0.88, sensitivity of 0.59, and F1Score of 0.71. High body mass index (BMI) increased contralateral carotid stenosis, and a history of limb paresis or plegia were significant IND risk factors. Elevated preoperative platelet and hemoglobin levels were associated with reduced IND risk.
Conclusions
This AI model provides precise IND prediction in CEA, enabling tailored interventions for high-risk patients and ultimately improving surgical outcomes. BMI, contralateral stenosis, and selected blood parameters emerged as pivotal predictors, bringing significant advancements to decision-making in CEA procedures. Further validation in larger cohorts is essential for broader clinical implementation.
目的:接受颈动脉内膜剥脱术(CEA)的患者中,约有8%可能在颈动脉交叉钳夹术中出现神经系统清醒试验阳性。本研究旨在评估人工智能(AI)驱动的风险计算器在预测术中神经功能缺损(IND)方面的准确性:方法:从2012年1月至2023年1月期间在区域麻醉下进行的颈动脉介入手术中收集数据。采用病例对照研究设计,选择 IND 患者和未发生 IND 的连续对照组。利用机器学习(ML),特别是极端梯度提升(XGBoost)模型,开发了IND预测模型,并对其性能进行了评估,并与现有的预测模型进行了比较。对模型的解释采用了 Shapley Additive exPlanations(SHAP)分析法:在 216 例患者中,108 例在 CEA 期间出现 IND。基于人工智能的预测模型的稳健曲线下面积(AUC)为 0.82,准确度为 0.75,精确度为 0.88,灵敏度为 0.59,F1Score 为 0.71。高体重指数(BMI)增加了对侧颈动脉狭窄,肢体瘫痪或截瘫病史是IND的重要风险因素。术前血小板和血红蛋白水平升高与 IND 风险降低有关:该人工智能模型可对 CEA 的 IND 进行精确预测,从而为高风险患者提供量身定制的干预措施,最终改善手术效果。体重指数、对侧血管狭窄程度和选定的血液参数是关键的预测因素,为CEA手术的决策带来了重大进步。在更大范围的临床应用中,进一步的队列验证至关重要。
期刊介绍:
Annals of Vascular Surgery, published eight times a year, invites original manuscripts reporting clinical and experimental work in vascular surgery for peer review. Articles may be submitted for the following sections of the journal:
Clinical Research (reports of clinical series, new drug or medical device trials)
Basic Science Research (new investigations, experimental work)
Case Reports (reports on a limited series of patients)
General Reviews (scholarly review of the existing literature on a relevant topic)
Developments in Endovascular and Endoscopic Surgery
Selected Techniques (technical maneuvers)
Historical Notes (interesting vignettes from the early days of vascular surgery)
Editorials/Correspondence