Bharadhwaj Ravindhran, Jonathon Prosser, Arthur Lim, Bhupesh Mishra, Ross Lathan, Louise H Hitchman, George E Smith, Daniel Carradice, Ian C Chetter, Dhaval Thakker, Sean Pymer
{"title":"间歇性跛行的定制风险评估和预测。","authors":"Bharadhwaj Ravindhran, Jonathon Prosser, Arthur Lim, Bhupesh Mishra, Ross Lathan, Louise H Hitchman, George E Smith, Daniel Carradice, Ian C Chetter, Dhaval Thakker, Sean Pymer","doi":"10.1093/bjsopen/zrad166","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Guidelines recommend cardiovascular risk reduction and supervised exercise therapy as the first line of treatment in intermittent claudication, but implementation challenges and poor patient compliance lead to significant variation in management and therefore outcomes. The development of a precise risk stratification tool is proposed through a machine-learning algorithm that aims to provide personalized outcome predictions for different management strategies.</p><p><strong>Methods: </strong>Feature selection was performed using the least absolute shrinkage and selection operator method. The model was developed using a bootstrapped sample based on patients with intermittent claudication from a vascular centre to predict chronic limb-threatening ischaemia, two or more revascularization procedures, major adverse cardiovascular events, and major adverse limb events. Algorithm performance was evaluated using the area under the receiver operating characteristic curve. Calibration curves were generated to assess the consistency between predicted and actual outcomes. Decision curve analysis was employed to evaluate the clinical utility. Validation was performed using a similar dataset.</p><p><strong>Results: </strong>The bootstrapped sample of 10 000 patients was based on 255 patients. The model was validated using a similar sample of 254 patients. The area under the receiver operating characteristic curves for risk of progression to chronic limb-threatening ischaemia at 2 years (0.892), risk of progression to chronic limb-threatening ischaemia at 5 years (0.866), likelihood of major adverse cardiovascular events within 5 years (0.836), likelihood of major adverse limb events within 5 years (0.891), and likelihood of two or more revascularization procedures within 5 years (0.896) demonstrated excellent discrimination. Calibration curves demonstrated good consistency between predicted and actual outcomes and decision curve analysis confirmed clinical utility. Logistic regression yielded slightly lower area under the receiver operating characteristic curves for these outcomes compared with the least absolute shrinkage and selection operator algorithm (0.728, 0.717, 0.746, 0.756, and 0.733 respectively). External calibration curve and decision curve analysis confirmed the reliability and clinical utility of the model, surpassing traditional logistic regression.</p><p><strong>Conclusion: </strong>The machine-learning algorithm successfully predicts outcomes for patients with intermittent claudication across various initial treatment strategies, offering potential for improved risk stratification and patient outcomes.</p>","PeriodicalId":9028,"journal":{"name":"BJS Open","volume":null,"pages":null},"PeriodicalIF":3.5000,"publicationDate":"2024-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10898330/pdf/","citationCount":"0","resultStr":"{\"title\":\"Tailored risk assessment and forecasting in intermittent claudication.\",\"authors\":\"Bharadhwaj Ravindhran, Jonathon Prosser, Arthur Lim, Bhupesh Mishra, Ross Lathan, Louise H Hitchman, George E Smith, Daniel Carradice, Ian C Chetter, Dhaval Thakker, Sean Pymer\",\"doi\":\"10.1093/bjsopen/zrad166\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Guidelines recommend cardiovascular risk reduction and supervised exercise therapy as the first line of treatment in intermittent claudication, but implementation challenges and poor patient compliance lead to significant variation in management and therefore outcomes. The development of a precise risk stratification tool is proposed through a machine-learning algorithm that aims to provide personalized outcome predictions for different management strategies.</p><p><strong>Methods: </strong>Feature selection was performed using the least absolute shrinkage and selection operator method. The model was developed using a bootstrapped sample based on patients with intermittent claudication from a vascular centre to predict chronic limb-threatening ischaemia, two or more revascularization procedures, major adverse cardiovascular events, and major adverse limb events. Algorithm performance was evaluated using the area under the receiver operating characteristic curve. Calibration curves were generated to assess the consistency between predicted and actual outcomes. Decision curve analysis was employed to evaluate the clinical utility. Validation was performed using a similar dataset.</p><p><strong>Results: </strong>The bootstrapped sample of 10 000 patients was based on 255 patients. The model was validated using a similar sample of 254 patients. The area under the receiver operating characteristic curves for risk of progression to chronic limb-threatening ischaemia at 2 years (0.892), risk of progression to chronic limb-threatening ischaemia at 5 years (0.866), likelihood of major adverse cardiovascular events within 5 years (0.836), likelihood of major adverse limb events within 5 years (0.891), and likelihood of two or more revascularization procedures within 5 years (0.896) demonstrated excellent discrimination. Calibration curves demonstrated good consistency between predicted and actual outcomes and decision curve analysis confirmed clinical utility. Logistic regression yielded slightly lower area under the receiver operating characteristic curves for these outcomes compared with the least absolute shrinkage and selection operator algorithm (0.728, 0.717, 0.746, 0.756, and 0.733 respectively). External calibration curve and decision curve analysis confirmed the reliability and clinical utility of the model, surpassing traditional logistic regression.</p><p><strong>Conclusion: </strong>The machine-learning algorithm successfully predicts outcomes for patients with intermittent claudication across various initial treatment strategies, offering potential for improved risk stratification and patient outcomes.</p>\",\"PeriodicalId\":9028,\"journal\":{\"name\":\"BJS Open\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-01-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10898330/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BJS Open\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1093/bjsopen/zrad166\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"SURGERY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BJS Open","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/bjsopen/zrad166","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SURGERY","Score":null,"Total":0}
Tailored risk assessment and forecasting in intermittent claudication.
Background: Guidelines recommend cardiovascular risk reduction and supervised exercise therapy as the first line of treatment in intermittent claudication, but implementation challenges and poor patient compliance lead to significant variation in management and therefore outcomes. The development of a precise risk stratification tool is proposed through a machine-learning algorithm that aims to provide personalized outcome predictions for different management strategies.
Methods: Feature selection was performed using the least absolute shrinkage and selection operator method. The model was developed using a bootstrapped sample based on patients with intermittent claudication from a vascular centre to predict chronic limb-threatening ischaemia, two or more revascularization procedures, major adverse cardiovascular events, and major adverse limb events. Algorithm performance was evaluated using the area under the receiver operating characteristic curve. Calibration curves were generated to assess the consistency between predicted and actual outcomes. Decision curve analysis was employed to evaluate the clinical utility. Validation was performed using a similar dataset.
Results: The bootstrapped sample of 10 000 patients was based on 255 patients. The model was validated using a similar sample of 254 patients. The area under the receiver operating characteristic curves for risk of progression to chronic limb-threatening ischaemia at 2 years (0.892), risk of progression to chronic limb-threatening ischaemia at 5 years (0.866), likelihood of major adverse cardiovascular events within 5 years (0.836), likelihood of major adverse limb events within 5 years (0.891), and likelihood of two or more revascularization procedures within 5 years (0.896) demonstrated excellent discrimination. Calibration curves demonstrated good consistency between predicted and actual outcomes and decision curve analysis confirmed clinical utility. Logistic regression yielded slightly lower area under the receiver operating characteristic curves for these outcomes compared with the least absolute shrinkage and selection operator algorithm (0.728, 0.717, 0.746, 0.756, and 0.733 respectively). External calibration curve and decision curve analysis confirmed the reliability and clinical utility of the model, surpassing traditional logistic regression.
Conclusion: The machine-learning algorithm successfully predicts outcomes for patients with intermittent claudication across various initial treatment strategies, offering potential for improved risk stratification and patient outcomes.