Machine learning model outperforms the ACS Risk Calculator in predicting non-home discharge following primary total knee arthroplasty

IF 5 2区 医学 Q1 ORTHOPEDICS Knee Surgery, Sports Traumatology, Arthroscopy Pub Date : 2024-09-30 DOI:10.1002/ksa.12492
Blake M. Bacevich, Tony Lin-Wei Chen, Anirudh Buddhiraju, Michelle R. Shimizu, Henry H. Seo, Young-Min Kwon
{"title":"Machine learning model outperforms the ACS Risk Calculator in predicting non-home discharge following primary total knee arthroplasty","authors":"Blake M. Bacevich,&nbsp;Tony Lin-Wei Chen,&nbsp;Anirudh Buddhiraju,&nbsp;Michelle R. Shimizu,&nbsp;Henry H. Seo,&nbsp;Young-Min Kwon","doi":"10.1002/ksa.12492","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Purpose</h3>\n \n <p>Despite the increase in outpatient total knee arthroplasty (TKA) procedures, many patients are still discharged to non-home locations following index surgery. The ability to accurately predict non-home discharge (NHD) following TKAs has the potential to promote a reduction in associated adverse events and excess healthcare costs. This study aimed to evaluate whether a machine learning (ML) model could outperform the American College of Surgeons (ACS) Risk Calculator in predicting NHD following TKA, using the same set of clinical variables. We hypothesised that the ML model would outperform the ACS Risk Calculator.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>Data from 365,240 patients who underwent a primary TKA between 2013 and 2020 were extracted from the ACS-National Surgical Quality Improvement Program database and used to develop an artificial neural network (ANN) to predict discharge disposition following primary TKA. The ANN and ACS calculator were assessed and compared using discrimination, calibration and decision curve analysis.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Age (&gt;68 years), BMI (&gt;35.5 kg/m<sup>2</sup>) and ASA Class (≥2) were found to be the most important variables in predicting NHD following TKA. When compared to the ACS calculator, the ANN model demonstrated a significantly superior ability to distinguish the area under the receiver operating characteristic curve (AUC) among NHD patients and provided probability predictions well aligned with the true outcomes (AUC<sub>ANN</sub> = 0.69, AUC<sub>ACS</sub> = 0.50, <i>p</i> = 0.002, slope<sub>ANN</sub> = 0.85, slope<sub>ACS</sub> = 4.46, intercept<sub>ANN</sub> = 0.04, and intercept<sub>ACS</sub> = 0.06).</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>Our findings support the hypothesis that machine learning models outperform the ACS Risk Calculator in predicting non-home discharge after TKA, even when constrained to the same clinical variables. Our findings underscore the potential benefits of integrating machine learning models into clinical practice for improving preoperative patient risk identification, optimisation, counselling and clinical decision-making.</p>\n </section>\n \n <section>\n \n <h3> Level of Evidence</h3>\n \n <p>Level III.</p>\n </section>\n </div>","PeriodicalId":17880,"journal":{"name":"Knee Surgery, Sports Traumatology, Arthroscopy","volume":"33 3","pages":"977-986"},"PeriodicalIF":5.0000,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knee Surgery, Sports Traumatology, Arthroscopy","FirstCategoryId":"3","ListUrlMain":"https://esskajournals.onlinelibrary.wiley.com/doi/10.1002/ksa.12492","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose

Despite the increase in outpatient total knee arthroplasty (TKA) procedures, many patients are still discharged to non-home locations following index surgery. The ability to accurately predict non-home discharge (NHD) following TKAs has the potential to promote a reduction in associated adverse events and excess healthcare costs. This study aimed to evaluate whether a machine learning (ML) model could outperform the American College of Surgeons (ACS) Risk Calculator in predicting NHD following TKA, using the same set of clinical variables. We hypothesised that the ML model would outperform the ACS Risk Calculator.

Methods

Data from 365,240 patients who underwent a primary TKA between 2013 and 2020 were extracted from the ACS-National Surgical Quality Improvement Program database and used to develop an artificial neural network (ANN) to predict discharge disposition following primary TKA. The ANN and ACS calculator were assessed and compared using discrimination, calibration and decision curve analysis.

Results

Age (>68 years), BMI (>35.5 kg/m2) and ASA Class (≥2) were found to be the most important variables in predicting NHD following TKA. When compared to the ACS calculator, the ANN model demonstrated a significantly superior ability to distinguish the area under the receiver operating characteristic curve (AUC) among NHD patients and provided probability predictions well aligned with the true outcomes (AUCANN = 0.69, AUCACS = 0.50, p = 0.002, slopeANN = 0.85, slopeACS = 4.46, interceptANN = 0.04, and interceptACS = 0.06).

Conclusion

Our findings support the hypothesis that machine learning models outperform the ACS Risk Calculator in predicting non-home discharge after TKA, even when constrained to the same clinical variables. Our findings underscore the potential benefits of integrating machine learning models into clinical practice for improving preoperative patient risk identification, optimisation, counselling and clinical decision-making.

Level of Evidence

Level III.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
在预测初级全膝关节置换术后非居家出院方面,机器学习模型优于 ACS 风险计算器。
目的:尽管门诊全膝关节置换术(TKA)手术有所增加,但仍有许多患者在指数手术后出院到非居家地点。准确预测全膝关节置换术后非居家出院(NHD)的能力有可能促进相关不良事件和超额医疗费用的减少。本研究旨在评估机器学习(ML)模型在使用同一组临床变量预测 TKA 术后非居家出院方面是否优于美国外科学院(ACS)风险计算器。我们假设 ML 模型的预测结果将优于 ACS 风险计算器:从 ACS--国家外科质量改进计划数据库中提取了 2013 年至 2020 年间接受初级 TKA 的 365,240 名患者的数据,并利用这些数据开发了一个人工神经网络 (ANN),用于预测初级 TKA 术后的出院处置。通过判别、校准和决策曲线分析,对人工神经网络和 ACS 计算器进行了评估和比较:结果发现,年龄(>68 岁)、体重指数(>35.5 kg/m2)和 ASA 分级(≥2 级)是预测 TKA 术后 NHD 的最重要变量。与ACS计算器相比,ANN模型在区分NHD患者的接收器工作特征曲线下面积(AUC)方面表现出明显的优势,并提供了与真实结果非常一致的概率预测(AUCANN = 0.69,AUCACS = 0.50,p = 0.002,slopeANN = 0.85,slopeACS = 4.46,interceptANN = 0.04,interceptACS = 0.06):我们的研究结果支持这样的假设,即机器学习模型在预测 TKA 术后非居家出院方面优于 ACS 风险计算器,即使受限于相同的临床变量。我们的研究结果强调了将机器学习模型融入临床实践的潜在益处,以改善术前患者风险识别、优化、咨询和临床决策:证据等级:III。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
8.10
自引率
18.40%
发文量
418
审稿时长
2 months
期刊介绍: Few other areas of orthopedic surgery and traumatology have undergone such a dramatic evolution in the last 10 years as knee surgery, arthroscopy and sports traumatology. Ranked among the top 33% of journals in both Orthopedics and Sports Sciences, the goal of this European journal is to publish papers about innovative knee surgery, sports trauma surgery and arthroscopy. Each issue features a series of peer-reviewed articles that deal with diagnosis and management and with basic research. Each issue also contains at least one review article about an important clinical problem. Case presentations or short notes about technical innovations are also accepted for publication. The articles cover all aspects of knee surgery and all types of sports trauma; in addition, epidemiology, diagnosis, treatment and prevention, and all types of arthroscopy (not only the knee but also the shoulder, elbow, wrist, hip, ankle, etc.) are addressed. Articles on new diagnostic techniques such as MRI and ultrasound and high-quality articles about the biomechanics of joints, muscles and tendons are included. Although this is largely a clinical journal, it is also open to basic research with clinical relevance. Because the journal is supported by a distinguished European Editorial Board, assisted by an international Advisory Board, you can be assured that the journal maintains the highest standards. Official Clinical Journal of the European Society of Sports Traumatology, Knee Surgery and Arthroscopy (ESSKA).
期刊最新文献
Issue Information From milestone to momentum: Thank you for powering KSSTA's present and future Mid- to long-term outcomes of capsular management in hip arthroscopy for FAIS: A multilevel meta-analysis Issue Information ChatGPT models provide higher-quality but lower-readability responses than Google Gemini regarding anterior shoulder instability, with no added benefit of the orthopaedic expert plugin
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1