The Continuous Fragility Index of Statistically Significant Findings in Studies Based on High Levels of Evidence Comparing Interventions for Femoroacetabular Impingement Syndrome
Juan Bernardo Villarreal-Espinosa, Zeeshan A. Khan, Kyleen Jan, Rodrigo Saad Berreta, Michael J. Murray, Felicitas Allende, Shane J. Nho, Jorge Chahla
{"title":"The Continuous Fragility Index of Statistically Significant Findings in Studies Based on High Levels of Evidence Comparing Interventions for Femoroacetabular Impingement Syndrome","authors":"Juan Bernardo Villarreal-Espinosa, Zeeshan A. Khan, Kyleen Jan, Rodrigo Saad Berreta, Michael J. Murray, Felicitas Allende, Shane J. Nho, Jorge Chahla","doi":"10.1177/03635465241283967","DOIUrl":null,"url":null,"abstract":"Background:Critical analysis of studies with high level of evidence has relied on the significance set by the reported P values. However, this strategy steers readers toward categorical interpretation of the data; therefore, a more comprehensive approach of data analysis is warranted. The continuous fragility index (CFI) allows for frailty interpretation of any given study's continuous outcome results.Purpose:To calculate the CFI of high-level quality studies reporting significant continuous outcomes on comparison of treatment modalities for management of femoroacetabular impingement syndrome.Study Design:Meta-analysis; Level of evidence, 2.Methods:Three databases (PubMed, Embase, Cochrane) were queried from inception to February 2024 utilizing Boolean operators to combine variations of the following search terms: “femoroacetabular impingement, randomized controlled trials or prospective cohort.” Studies were included if level of evidence 1 or 2, and a statistically significant outcome was reported for any continuous outcome. CFI calculation was performed for all significant outcomes to obtain a study-specific mean CFI and also for the primary outcome of each study. Mean CFI was also calculated for outcomes reported to be significant in >3 studies. Additionally, multivariable linear regression was utilized for assessment of variables associated with achievement of a higher CFI.Results:Thirteen studies totaling 1316 patients were included for analysis: 11 level of evidence 1 and 2 level of evidence 2 studies. A total of 48 outcomes reaching significance were extracted, with 8 representing primary outcomes. Study-specific mean (SD) CFI was 8 (9.3), whereas primary outcome mean CFI was 12.5 (12). In 4 of the 13 studies, the number of hips lost to follow-up was greater than the study CFI. Outcome-specific mean CFI was obtained for 5 outcomes reported in >3 studies. Multivariable linear regression revealed that larger sample size and greater journal impact factor had a significant positive association with a higher overall CFI value ( P < .05).Conclusion:The mean (SD) number of patient outcome events needed to reverse the significance of a continuous outcome (ie, CFI) was 8.0 (9.3). Nearly one-third of studies had a CFI less than the reported loss to follow-up, reflecting the need for better patient compliance to attain less fragile statistical results. Larger sample size and greater journal impact factor were both predictive of a higher CFI.","PeriodicalId":517411,"journal":{"name":"The American Journal of Sports Medicine","volume":"16 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The American Journal of Sports Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/03635465241283967","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background:Critical analysis of studies with high level of evidence has relied on the significance set by the reported P values. However, this strategy steers readers toward categorical interpretation of the data; therefore, a more comprehensive approach of data analysis is warranted. The continuous fragility index (CFI) allows for frailty interpretation of any given study's continuous outcome results.Purpose:To calculate the CFI of high-level quality studies reporting significant continuous outcomes on comparison of treatment modalities for management of femoroacetabular impingement syndrome.Study Design:Meta-analysis; Level of evidence, 2.Methods:Three databases (PubMed, Embase, Cochrane) were queried from inception to February 2024 utilizing Boolean operators to combine variations of the following search terms: “femoroacetabular impingement, randomized controlled trials or prospective cohort.” Studies were included if level of evidence 1 or 2, and a statistically significant outcome was reported for any continuous outcome. CFI calculation was performed for all significant outcomes to obtain a study-specific mean CFI and also for the primary outcome of each study. Mean CFI was also calculated for outcomes reported to be significant in >3 studies. Additionally, multivariable linear regression was utilized for assessment of variables associated with achievement of a higher CFI.Results:Thirteen studies totaling 1316 patients were included for analysis: 11 level of evidence 1 and 2 level of evidence 2 studies. A total of 48 outcomes reaching significance were extracted, with 8 representing primary outcomes. Study-specific mean (SD) CFI was 8 (9.3), whereas primary outcome mean CFI was 12.5 (12). In 4 of the 13 studies, the number of hips lost to follow-up was greater than the study CFI. Outcome-specific mean CFI was obtained for 5 outcomes reported in >3 studies. Multivariable linear regression revealed that larger sample size and greater journal impact factor had a significant positive association with a higher overall CFI value ( P < .05).Conclusion:The mean (SD) number of patient outcome events needed to reverse the significance of a continuous outcome (ie, CFI) was 8.0 (9.3). Nearly one-third of studies had a CFI less than the reported loss to follow-up, reflecting the need for better patient compliance to attain less fragile statistical results. Larger sample size and greater journal impact factor were both predictive of a higher CFI.