Kinjal Vasavada, Vrinda Vasavada, Jay Moran, Sai Devana, Changhee Lee, Sharon L Hame, Laith M Jazrawi, Orrin H Sherman, Laura J Huston, Amanda K Haas, Christina R Allen, Daniel E Cooper, Thomas M DeBerardino, Kurt P Spindler, Michael J Stuart, Annunziato Ned Amendola, Christopher C Annunziata, Robert A Arciero, Bernard R Bach, Champ L Baker, Arthur R Bartolozzi, Keith M Baumgarten, Jeffrey H Berg, Geoffrey A Bernas, Stephen F Brockmeier, Robert H Brophy, Charles A Bush-Joseph, J Brad Butler V, James L Carey, James E Carpenter, Brian J Cole, Jonathan M Cooper, Charles L Cox, R Alexander Creighton, Tal S David, Warren R Dunn, David C Flanigan, Robert W Frederick, Theodore J Ganley, Charles J Gatt, Steven R Gecha, James Robert Giffin, Jo A Hannafin, Norman Lindsay Harris, Keith S Hechtman, Elliott B Hershman, Rudolf G Hoellrich, David C Johnson, Timothy S Johnson, Morgan H Jones, Christopher C Kaeding, Ganesh V Kamath, Thomas E Klootwyk, Bruce A Levy, C Benjamin Ma, G Peter Maiers, Robert G Marx, Matthew J Matava, Gregory M Mathien, David R McAllister, Eric C McCarty, Robert G McCormack, Bruce S Miller, Carl W Nissen, Daniel F O'Neill, Brett D Owens, Richard D Parker, Mark L Purnell, Arun J Ramappa, Michael A Rauh, Arthur C Rettig, Jon K Sekiya, Kevin G Shea, James R Slauterbeck, Matthew V Smith, Jeffrey T Spang, Steven J Svoboda, Timothy N Taft, Joachim J Tenuta, Edwin M Tingstad, Armando F Vidal, Darius G Viskontas, Richard A White, James S Williams, Michelle L Wolcott, Brian R Wolf, Rick W Wright, James J York
{"title":"预测MARS队列中前交叉韧带重建失败的新型机器学习模型","authors":"Kinjal Vasavada, Vrinda Vasavada, Jay Moran, Sai Devana, Changhee Lee, Sharon L Hame, Laith M Jazrawi, Orrin H Sherman, Laura J Huston, Amanda K Haas, Christina R Allen, Daniel E Cooper, Thomas M DeBerardino, Kurt P Spindler, Michael J Stuart, Annunziato Ned Amendola, Christopher C Annunziata, Robert A Arciero, Bernard R Bach, Champ L Baker, Arthur R Bartolozzi, Keith M Baumgarten, Jeffrey H Berg, Geoffrey A Bernas, Stephen F Brockmeier, Robert H Brophy, Charles A Bush-Joseph, J Brad Butler V, James L Carey, James E Carpenter, Brian J Cole, Jonathan M Cooper, Charles L Cox, R Alexander Creighton, Tal S David, Warren R Dunn, David C Flanigan, Robert W Frederick, Theodore J Ganley, Charles J Gatt, Steven R Gecha, James Robert Giffin, Jo A Hannafin, Norman Lindsay Harris, Keith S Hechtman, Elliott B Hershman, Rudolf G Hoellrich, David C Johnson, Timothy S Johnson, Morgan H Jones, Christopher C Kaeding, Ganesh V Kamath, Thomas E Klootwyk, Bruce A Levy, C Benjamin Ma, G Peter Maiers, Robert G Marx, Matthew J Matava, Gregory M Mathien, David R McAllister, Eric C McCarty, Robert G McCormack, Bruce S Miller, Carl W Nissen, Daniel F O'Neill, Brett D Owens, Richard D Parker, Mark L Purnell, Arun J Ramappa, Michael A Rauh, Arthur C Rettig, Jon K Sekiya, Kevin G Shea, James R Slauterbeck, Matthew V Smith, Jeffrey T Spang, Steven J Svoboda, Timothy N Taft, Joachim J Tenuta, Edwin M Tingstad, Armando F Vidal, Darius G Viskontas, Richard A White, James S Williams, Michelle L Wolcott, Brian R Wolf, Rick W Wright, James J York","doi":"10.1177/23259671241291920","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>As machine learning becomes increasingly utilized in orthopaedic clinical research, the application of machine learning methodology to cohort data from the Multicenter ACL Revision Study (MARS) presents a valuable opportunity to translate data into patient-specific insights.</p><p><strong>Purpose: </strong>To apply novel machine learning methodology to MARS cohort data to determine a predictive model of revision anterior cruciate ligament reconstruction (rACLR) graft failure and features most predictive of failure.</p><p><strong>Study design: </strong>Cohort study; Level of evidence, 3.</p><p><strong>Methods: </strong>The authors prospectively recruited patients undergoing rACLR from the MARS cohort and obtained preoperative radiographs, surgeon-reported intraoperative findings, and 2- and 6-year follow-up data on patient-reported outcomes, additional surgeries, and graft failure. Machine learning models including logistic regression (LR), XGBoost, gradient boosting (GB), random forest (RF), and a validated ensemble algorithm (AutoPrognosis) were built to predict graft failure by 6 years postoperatively. Validated performance metrics and feature importance measures were used to evaluate model performance.</p><p><strong>Results: </strong>The cohort included 960 patients who completed 6-year follow-up, with 5.7% (n = 55) experiencing graft failure. AutoPrognosis demonstrated the highest discriminative power (model area under the receiver operating characteristic curve: AutoPrognosis, 0.703; RF, 0.618; GB, 0.660; XGBoost, 0.680; LR, 0.592), with well-calibrated scores (model Brier score: AutoPrognosis, 0.053; RF, 0.054; GB, 0.057; XGBoost, 0.058; LR, 0.111). The most important features for AutoPrognosis model performance were prior compromised femoral and tibial tunnels (placement and size) and allograft graft type used in current rACLR.</p><p><strong>Conclusion: </strong>The present study demonstrated the ability of the novel AutoPrognosis machine learning model to best predict the risk of graft failure in patients undergoing rACLR at 6 years postoperatively with moderate predictive ability. Femoral and tibial tunnel size and position in prior ACLR and allograft use in current rACLR were all risk factors for rACLR failure in the context of the AutoPrognosis model. This study describes a unique model that can be externally validated with larger data sets and contribute toward the creation of a robust rACLR bedside risk calculator in future studies.</p><p><strong>Registration: </strong>NCT00625885 (ClinicalTrials.gov identifier).</p>","PeriodicalId":19646,"journal":{"name":"Orthopaedic Journal of Sports Medicine","volume":"12 11","pages":"23259671241291920"},"PeriodicalIF":2.4000,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11565622/pdf/","citationCount":"0","resultStr":"{\"title\":\"A Novel Machine Learning Model to Predict Revision ACL Reconstruction Failure in the MARS Cohort.\",\"authors\":\"Kinjal Vasavada, Vrinda Vasavada, Jay Moran, Sai Devana, Changhee Lee, Sharon L Hame, Laith M Jazrawi, Orrin H Sherman, Laura J Huston, Amanda K Haas, Christina R Allen, Daniel E Cooper, Thomas M DeBerardino, Kurt P Spindler, Michael J Stuart, Annunziato Ned Amendola, Christopher C Annunziata, Robert A Arciero, Bernard R Bach, Champ L Baker, Arthur R Bartolozzi, Keith M Baumgarten, Jeffrey H Berg, Geoffrey A Bernas, Stephen F Brockmeier, Robert H Brophy, Charles A Bush-Joseph, J Brad Butler V, James L Carey, James E Carpenter, Brian J Cole, Jonathan M Cooper, Charles L Cox, R Alexander Creighton, Tal S David, Warren R Dunn, David C Flanigan, Robert W Frederick, Theodore J Ganley, Charles J Gatt, Steven R Gecha, James Robert Giffin, Jo A Hannafin, Norman Lindsay Harris, Keith S Hechtman, Elliott B Hershman, Rudolf G Hoellrich, David C Johnson, Timothy S Johnson, Morgan H Jones, Christopher C Kaeding, Ganesh V Kamath, Thomas E Klootwyk, Bruce A Levy, C Benjamin Ma, G Peter Maiers, Robert G Marx, Matthew J Matava, Gregory M Mathien, David R McAllister, Eric C McCarty, Robert G McCormack, Bruce S Miller, Carl W Nissen, Daniel F O'Neill, Brett D Owens, Richard D Parker, Mark L Purnell, Arun J Ramappa, Michael A Rauh, Arthur C Rettig, Jon K Sekiya, Kevin G Shea, James R Slauterbeck, Matthew V Smith, Jeffrey T Spang, Steven J Svoboda, Timothy N Taft, Joachim J Tenuta, Edwin M Tingstad, Armando F Vidal, Darius G Viskontas, Richard A White, James S Williams, Michelle L Wolcott, Brian R Wolf, Rick W Wright, James J York\",\"doi\":\"10.1177/23259671241291920\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>As machine learning becomes increasingly utilized in orthopaedic clinical research, the application of machine learning methodology to cohort data from the Multicenter ACL Revision Study (MARS) presents a valuable opportunity to translate data into patient-specific insights.</p><p><strong>Purpose: </strong>To apply novel machine learning methodology to MARS cohort data to determine a predictive model of revision anterior cruciate ligament reconstruction (rACLR) graft failure and features most predictive of failure.</p><p><strong>Study design: </strong>Cohort study; Level of evidence, 3.</p><p><strong>Methods: </strong>The authors prospectively recruited patients undergoing rACLR from the MARS cohort and obtained preoperative radiographs, surgeon-reported intraoperative findings, and 2- and 6-year follow-up data on patient-reported outcomes, additional surgeries, and graft failure. Machine learning models including logistic regression (LR), XGBoost, gradient boosting (GB), random forest (RF), and a validated ensemble algorithm (AutoPrognosis) were built to predict graft failure by 6 years postoperatively. Validated performance metrics and feature importance measures were used to evaluate model performance.</p><p><strong>Results: </strong>The cohort included 960 patients who completed 6-year follow-up, with 5.7% (n = 55) experiencing graft failure. AutoPrognosis demonstrated the highest discriminative power (model area under the receiver operating characteristic curve: AutoPrognosis, 0.703; RF, 0.618; GB, 0.660; XGBoost, 0.680; LR, 0.592), with well-calibrated scores (model Brier score: AutoPrognosis, 0.053; RF, 0.054; GB, 0.057; XGBoost, 0.058; LR, 0.111). The most important features for AutoPrognosis model performance were prior compromised femoral and tibial tunnels (placement and size) and allograft graft type used in current rACLR.</p><p><strong>Conclusion: </strong>The present study demonstrated the ability of the novel AutoPrognosis machine learning model to best predict the risk of graft failure in patients undergoing rACLR at 6 years postoperatively with moderate predictive ability. Femoral and tibial tunnel size and position in prior ACLR and allograft use in current rACLR were all risk factors for rACLR failure in the context of the AutoPrognosis model. This study describes a unique model that can be externally validated with larger data sets and contribute toward the creation of a robust rACLR bedside risk calculator in future studies.</p><p><strong>Registration: </strong>NCT00625885 (ClinicalTrials.gov identifier).</p>\",\"PeriodicalId\":19646,\"journal\":{\"name\":\"Orthopaedic Journal of Sports Medicine\",\"volume\":\"12 11\",\"pages\":\"23259671241291920\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2024-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11565622/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Orthopaedic Journal of Sports Medicine\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1177/23259671241291920\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/11/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"ORTHOPEDICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Orthopaedic Journal of Sports Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1177/23259671241291920","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
A Novel Machine Learning Model to Predict Revision ACL Reconstruction Failure in the MARS Cohort.
Background: As machine learning becomes increasingly utilized in orthopaedic clinical research, the application of machine learning methodology to cohort data from the Multicenter ACL Revision Study (MARS) presents a valuable opportunity to translate data into patient-specific insights.
Purpose: To apply novel machine learning methodology to MARS cohort data to determine a predictive model of revision anterior cruciate ligament reconstruction (rACLR) graft failure and features most predictive of failure.
Study design: Cohort study; Level of evidence, 3.
Methods: The authors prospectively recruited patients undergoing rACLR from the MARS cohort and obtained preoperative radiographs, surgeon-reported intraoperative findings, and 2- and 6-year follow-up data on patient-reported outcomes, additional surgeries, and graft failure. Machine learning models including logistic regression (LR), XGBoost, gradient boosting (GB), random forest (RF), and a validated ensemble algorithm (AutoPrognosis) were built to predict graft failure by 6 years postoperatively. Validated performance metrics and feature importance measures were used to evaluate model performance.
Results: The cohort included 960 patients who completed 6-year follow-up, with 5.7% (n = 55) experiencing graft failure. AutoPrognosis demonstrated the highest discriminative power (model area under the receiver operating characteristic curve: AutoPrognosis, 0.703; RF, 0.618; GB, 0.660; XGBoost, 0.680; LR, 0.592), with well-calibrated scores (model Brier score: AutoPrognosis, 0.053; RF, 0.054; GB, 0.057; XGBoost, 0.058; LR, 0.111). The most important features for AutoPrognosis model performance were prior compromised femoral and tibial tunnels (placement and size) and allograft graft type used in current rACLR.
Conclusion: The present study demonstrated the ability of the novel AutoPrognosis machine learning model to best predict the risk of graft failure in patients undergoing rACLR at 6 years postoperatively with moderate predictive ability. Femoral and tibial tunnel size and position in prior ACLR and allograft use in current rACLR were all risk factors for rACLR failure in the context of the AutoPrognosis model. This study describes a unique model that can be externally validated with larger data sets and contribute toward the creation of a robust rACLR bedside risk calculator in future studies.
期刊介绍:
The Orthopaedic Journal of Sports Medicine (OJSM), developed by the American Orthopaedic Society for Sports Medicine (AOSSM), is a global, peer-reviewed, open access journal that combines the interests of researchers and clinical practitioners across orthopaedic sports medicine, arthroscopy, and knee arthroplasty.
Topics include original research in the areas of:
-Orthopaedic Sports Medicine, including surgical and nonsurgical treatment of orthopaedic sports injuries
-Arthroscopic Surgery (Shoulder/Elbow/Wrist/Hip/Knee/Ankle/Foot)
-Relevant translational research
-Sports traumatology/epidemiology
-Knee and shoulder arthroplasty
The OJSM also publishes relevant systematic reviews and meta-analyses.
This journal is a member of the Committee on Publication Ethics (COPE).