Concomitant Procedures, Black Race, Male Sex, and General Anesthesia Show Fair Predictive Value for Prolonged Rotator Cuff Repair Operative Time: Analysis of the National Quality Improvement Program Database Using Machine Learning
Teja Yeramosu M.D. , Laura M. Krivicich M.D. , Richard N. Puzzitiello M.D. , Guy Guenthner M.D. , Matthew J. Salzler M.D.
{"title":"Concomitant Procedures, Black Race, Male Sex, and General Anesthesia Show Fair Predictive Value for Prolonged Rotator Cuff Repair Operative Time: Analysis of the National Quality Improvement Program Database Using Machine Learning","authors":"Teja Yeramosu M.D. , Laura M. Krivicich M.D. , Richard N. Puzzitiello M.D. , Guy Guenthner M.D. , Matthew J. Salzler M.D.","doi":"10.1016/j.arthro.2024.07.019","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>To develop machine learning models using the American College of Surgeons National Quality Improvement Program (ACS-NSQIP) database to predict prolonged operative time (POT) for rotator cuff repair (RCR), as well as use the trained machine learning models, cross-referenced with traditional multivariate logistic regression (MLR), to determine the key perioperative variables that may predict POT for RCR.</div></div><div><h3>Methods</h3><div>Data were obtained from a large national database (ACS-NSQIP) from 2021. Patients with unilateral RCR procedures were included. Demographic, preoperative, and operative variables were analyzed. An MLR model and various other machine learning techniques, including random forest (RF) and artificial neural network, were compared using area under the curve, calibration, Brier score, and decision curve analysis. Feature importance was identified from the overall best-performing model.</div></div><div><h3>Results</h3><div>A total of 6,690 patients met inclusion criteria. The RF machine learning model had the highest area under the curve upon internal validation (0.706) and the lowest Brier score (0.15), outperforming the other models. The RF model also demonstrated strong performance upon assessment of the calibration curves (slope = 0.86, intercept = 0.08) and decision curve analysis. The model identified concomitant procedure, specifically labral repair and biceps tenodesis, as the most important variable for determining POT, followed by age <30 years, Black or African American race, male sex, and general anesthesia.</div></div><div><h3>Conclusions</h3><div>Despite the advanced machine learning models used in this study, the ACS-NSQIP data set was only able to fairly predict POT following RCR. The RF model identified concomitant procedures, specifically labral repair and biceps tenodesis, as the most important variables for determining POT. Additionally, demographic factors such as age <30 years, Black race, and general anesthesia were significant predictors. While male sex was identified as important in the RF model, the MLR model indicated that its predictive value is primarily in conjunction with specific procedures like biceps tenodesis and subacromial decompression.</div></div><div><h3>Level of Evidence</h3><div>Level IV, retrospective comparative prognostic trial.</div></div>","PeriodicalId":55459,"journal":{"name":"Arthroscopy-The Journal of Arthroscopic and Related Surgery","volume":"41 5","pages":"Pages 1279-1290"},"PeriodicalIF":5.4000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Arthroscopy-The Journal of Arthroscopic and Related Surgery","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0749806324005164","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/26 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
To develop machine learning models using the American College of Surgeons National Quality Improvement Program (ACS-NSQIP) database to predict prolonged operative time (POT) for rotator cuff repair (RCR), as well as use the trained machine learning models, cross-referenced with traditional multivariate logistic regression (MLR), to determine the key perioperative variables that may predict POT for RCR.
Methods
Data were obtained from a large national database (ACS-NSQIP) from 2021. Patients with unilateral RCR procedures were included. Demographic, preoperative, and operative variables were analyzed. An MLR model and various other machine learning techniques, including random forest (RF) and artificial neural network, were compared using area under the curve, calibration, Brier score, and decision curve analysis. Feature importance was identified from the overall best-performing model.
Results
A total of 6,690 patients met inclusion criteria. The RF machine learning model had the highest area under the curve upon internal validation (0.706) and the lowest Brier score (0.15), outperforming the other models. The RF model also demonstrated strong performance upon assessment of the calibration curves (slope = 0.86, intercept = 0.08) and decision curve analysis. The model identified concomitant procedure, specifically labral repair and biceps tenodesis, as the most important variable for determining POT, followed by age <30 years, Black or African American race, male sex, and general anesthesia.
Conclusions
Despite the advanced machine learning models used in this study, the ACS-NSQIP data set was only able to fairly predict POT following RCR. The RF model identified concomitant procedures, specifically labral repair and biceps tenodesis, as the most important variables for determining POT. Additionally, demographic factors such as age <30 years, Black race, and general anesthesia were significant predictors. While male sex was identified as important in the RF model, the MLR model indicated that its predictive value is primarily in conjunction with specific procedures like biceps tenodesis and subacromial decompression.
Level of Evidence
Level IV, retrospective comparative prognostic trial.
期刊介绍:
Nowhere is minimally invasive surgery explained better than in Arthroscopy, the leading peer-reviewed journal in the field. Every issue enables you to put into perspective the usefulness of the various emerging arthroscopic techniques. The advantages and disadvantages of these methods -- along with their applications in various situations -- are discussed in relation to their efficiency, efficacy and cost benefit. As a special incentive, paid subscribers also receive access to the journal expanded website.