Methodology and development of a machine learning probability calculator: Data heterogeneity limits ability to predict recurrence after arthroscopic Bankart repair.

IF 4.3 3区材料科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC ACS Applied Electronic Materials Pub Date : 2024-09-26 DOI:10.1002/ksa.12443

Sanne H van Spanning, Lukas P E Verweij, Laurent A M Hendrickx, Laurens J H Allaart, George S Athwal, Thibault Lafosse, Laurent Lafosse, Job N Doornberg, Jacobien H F Oosterhoff, Michel P J van den Bekerom, Geert Alexander Buijze

{"title":"Methodology and development of a machine learning probability calculator: Data heterogeneity limits ability to predict recurrence after arthroscopic Bankart repair.","authors":"Sanne H van Spanning, Lukas P E Verweij, Laurent A M Hendrickx, Laurens J H Allaart, George S Athwal, Thibault Lafosse, Laurent Lafosse, Job N Doornberg, Jacobien H F Oosterhoff, Michel P J van den Bekerom, Geert Alexander Buijze","doi":"10.1002/ksa.12443","DOIUrl":null,"url":null,"abstract":"Purpose: The aim of this study was to develop and train a machine learning (ML) algorithm to create a clinical decision support tool (i.e., ML-driven probability calculator) to be used in clinical practice to estimate recurrence rates following an arthroscopic Bankart repair (ABR).Methods: Data from 14 previously published studies were collected. Inclusion criteria were (1) patients treated with ABR without remplissage for traumatic anterior shoulder instability and (2) a minimum of 2 years follow-up. Risk factors associated with recurrence were identified using bivariate logistic regression analysis. Subsequently, four ML algorithms were developed and internally validated. The predictive performance was assessed using discrimination, calibration and the Brier score.Results: In total, 5591 patients underwent ABR with a recurrence rate of 15.4% (n = 862). Age <35 years, participation in contact and collision sports, bony Bankart lesions and full-thickness rotator cuff tears increased the risk of recurrence (all p < 0.05). A single shoulder dislocation (compared to multiple dislocations) lowered the risk of recurrence (p < 0.05). Due to the unavailability of certain variables in some patients, a portion of the patient data had to be excluded before pooling the data set to create the algorithm. A total of 797 patients were included providing information on risk factors associated with recurrence. The discrimination (area under the receiver operating curve) ranged between 0.54 and 0.57 for prediction of recurrence.Conclusion: ML was not able to predict the recurrence following ABR with the current available predictors. Despite a global coordinated effort, the heterogeneity of clinical data limited the predictive capabilities of the algorithm, emphasizing the need for standardized data collection methods in future studies.Level of evidence: Level IV, retrospective cohort study.","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1002/ksa.12443","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose: The aim of this study was to develop and train a machine learning (ML) algorithm to create a clinical decision support tool (i.e., ML-driven probability calculator) to be used in clinical practice to estimate recurrence rates following an arthroscopic Bankart repair (ABR).

Methods: Data from 14 previously published studies were collected. Inclusion criteria were (1) patients treated with ABR without remplissage for traumatic anterior shoulder instability and (2) a minimum of 2 years follow-up. Risk factors associated with recurrence were identified using bivariate logistic regression analysis. Subsequently, four ML algorithms were developed and internally validated. The predictive performance was assessed using discrimination, calibration and the Brier score.

Results: In total, 5591 patients underwent ABR with a recurrence rate of 15.4% (n = 862). Age <35 years, participation in contact and collision sports, bony Bankart lesions and full-thickness rotator cuff tears increased the risk of recurrence (all p < 0.05). A single shoulder dislocation (compared to multiple dislocations) lowered the risk of recurrence (p < 0.05). Due to the unavailability of certain variables in some patients, a portion of the patient data had to be excluded before pooling the data set to create the algorithm. A total of 797 patients were included providing information on risk factors associated with recurrence. The discrimination (area under the receiver operating curve) ranged between 0.54 and 0.57 for prediction of recurrence.

Conclusion: ML was not able to predict the recurrence following ABR with the current available predictors. Despite a global coordinated effort, the heterogeneity of clinical data limited the predictive capabilities of the algorithm, emphasizing the need for standardized data collection methods in future studies.

Level of evidence: Level IV, retrospective cohort study.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

机器学习概率计算器的方法与开发：数据异质性限制了预测关节镜下 Bankart 修复术后复发的能力。

目的：本研究旨在开发和训练一种机器学习（ML）算法，以创建一种临床决策支持工具（即ML驱动的概率计算器），用于临床实践，估计关节镜下Bankart修复术（ABR）后的复发率：方法：收集了 14 项以前发表的研究数据。纳入标准为：(1) 因外伤性肩关节前方不稳而接受 ABR 治疗但未行再植术的患者；(2) 至少随访 2 年。通过双变量逻辑回归分析确定了与复发相关的风险因素。随后，开发了四种 ML 算法并进行了内部验证。结果：共有 5591 名患者接受了 ABR，复发率为 15.4%（n = 862）。年龄结论：使用现有的预测指标，ML 无法预测 ABR 后的复发率。尽管在全球范围内进行了协调努力，但临床数据的异质性限制了该算法的预测能力，这强调了在未来研究中采用标准化数据收集方法的必要性：证据级别：IV级，回顾性队列研究。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊