Mary Sixian Lin, Hilary Hayssen, Minerva Mayorga-Carlin, Shalini Sahoo, Tariq Siddiqui, Georges Jreij, Brian R Englum, Phuong Nguyen, Yelena Yesha, John David Sorkin, Brajesh K Lal
{"title":"A composite risk assessment model for venous thromboembolism.","authors":"Mary Sixian Lin, Hilary Hayssen, Minerva Mayorga-Carlin, Shalini Sahoo, Tariq Siddiqui, Georges Jreij, Brian R Englum, Phuong Nguyen, Yelena Yesha, John David Sorkin, Brajesh K Lal","doi":"10.1016/j.jvsv.2024.101968","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Venous thromboembolism (VTE) is a preventable cause of hospitalization-related morbidity and mortality. VTE prevention requires accurate risk stratification. Federal agencies mandated VTE risk assessment for all hospital admissions. We have shown that the widely used Caprini (30 risk factors) and Padua (11 risk factors) VTE risk-assessment models (RAMs) have limited predictive ability for VTE when used for all general hospital admissions. Here, we test whether combining the risk factors from all 23 available VTE RAMs improves VTE risk prediction.</p><p><strong>Methods: </strong>We analyzed data from the first hospitalizations of 1,282,014 surgical and non-surgical patients admitted to 1298 Veterans Affairs facilities nationwide between January 2016 and December 2021. We used logistic regression to predict VTE within 90 days of admission using risk factors from all 23 available VTE RAMs. Area under the receiver operating characteristic curves (AUC), sensitivity, specificity, and positive (PPV) and negative predictive values (NPV) were used to quantify the predictive power of our models. The metrics were computed at two diagnostic thresholds that maximized (1) the value of sensitivity + specificity-1; and (2) PPV and were compared using McNemar's test. The Delong-Delong test was used to compare AUCs.</p><p><strong>Results: </strong>After excluding those with missing data, 1,185,633 patients (mean age, 66 years; 93% male; and 72% White) were analyzed, of whom 33,253 (2.8%) had a VTE (deep venous thrombosis [DVT], n = 19,218, 1.6%; pulmonary embolism [PE], n = 10,190, 0.9%; PE + DVT, n = 3845, 0.3%). Our composite RAM included 102 risk factors and improved prediction of VTE compared with the Caprini RAM risk factors (AUC composite model: 0.74; AUC Caprini risk-factor model: 0.63; P < .0001). When the sum of sensitivity and specificity-1 was maximized, the composite model demonstrated small improvements in sensitivity, specificity and PPV; NPV was high in both models. When PPV was maximized, the PPV of the composite model was improved but remained low. The nature of the relationship between NPV and PPV precluded any further gain in PPV by sacrificing NPV and sensitivity.</p><p><strong>Conclusions: </strong>Using a composite of 102 risk factors from all available VTE RAMs, we improved VTE prediction in a large, national cohort of >1 million general hospital admissions. However, neither model has a sensitivity or PPV that permits it to be a reliable predictor of VTE. We demonstrate the limits of currently available VTE risk prediction tools; no available RAM is ready for widespread use in the general hospital population.</p>","PeriodicalId":17537,"journal":{"name":"Journal of vascular surgery. Venous and lymphatic disorders","volume":" ","pages":"101968"},"PeriodicalIF":2.8000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of vascular surgery. Venous and lymphatic disorders","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jvsv.2024.101968","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Venous thromboembolism (VTE) is a preventable cause of hospitalization-related morbidity and mortality. VTE prevention requires accurate risk stratification. Federal agencies mandated VTE risk assessment for all hospital admissions. We have shown that the widely used Caprini (30 risk factors) and Padua (11 risk factors) VTE risk-assessment models (RAMs) have limited predictive ability for VTE when used for all general hospital admissions. Here, we test whether combining the risk factors from all 23 available VTE RAMs improves VTE risk prediction.
Methods: We analyzed data from the first hospitalizations of 1,282,014 surgical and non-surgical patients admitted to 1298 Veterans Affairs facilities nationwide between January 2016 and December 2021. We used logistic regression to predict VTE within 90 days of admission using risk factors from all 23 available VTE RAMs. Area under the receiver operating characteristic curves (AUC), sensitivity, specificity, and positive (PPV) and negative predictive values (NPV) were used to quantify the predictive power of our models. The metrics were computed at two diagnostic thresholds that maximized (1) the value of sensitivity + specificity-1; and (2) PPV and were compared using McNemar's test. The Delong-Delong test was used to compare AUCs.
Results: After excluding those with missing data, 1,185,633 patients (mean age, 66 years; 93% male; and 72% White) were analyzed, of whom 33,253 (2.8%) had a VTE (deep venous thrombosis [DVT], n = 19,218, 1.6%; pulmonary embolism [PE], n = 10,190, 0.9%; PE + DVT, n = 3845, 0.3%). Our composite RAM included 102 risk factors and improved prediction of VTE compared with the Caprini RAM risk factors (AUC composite model: 0.74; AUC Caprini risk-factor model: 0.63; P < .0001). When the sum of sensitivity and specificity-1 was maximized, the composite model demonstrated small improvements in sensitivity, specificity and PPV; NPV was high in both models. When PPV was maximized, the PPV of the composite model was improved but remained low. The nature of the relationship between NPV and PPV precluded any further gain in PPV by sacrificing NPV and sensitivity.
Conclusions: Using a composite of 102 risk factors from all available VTE RAMs, we improved VTE prediction in a large, national cohort of >1 million general hospital admissions. However, neither model has a sensitivity or PPV that permits it to be a reliable predictor of VTE. We demonstrate the limits of currently available VTE risk prediction tools; no available RAM is ready for widespread use in the general hospital population.
期刊介绍:
Journal of Vascular Surgery: Venous and Lymphatic Disorders is one of a series of specialist journals launched by the Journal of Vascular Surgery. It aims to be the premier international Journal of medical, endovascular and surgical management of venous and lymphatic disorders. It publishes high quality clinical, research, case reports, techniques, and practice manuscripts related to all aspects of venous and lymphatic disorders, including malformations and wound care, with an emphasis on the practicing clinician. The journal seeks to provide novel and timely information to vascular surgeons, interventionalists, phlebologists, wound care specialists, and allied health professionals who treat patients presenting with vascular and lymphatic disorders. As the official publication of The Society for Vascular Surgery and the American Venous Forum, the Journal will publish, after peer review, selected papers presented at the annual meeting of these organizations and affiliated vascular societies, as well as original articles from members and non-members.