{"title":"The Fragility of Phase III Trials in Oncology","authors":"","doi":"10.1016/j.ijrobp.2024.07.063","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose/Objective(s)</h3><div>The standard of care for oncologic treatment is often established and refined through randomized phase III clinical trials. While the success of a trial is generally established through meeting statistical significance, there are few metrics to measure the robustness of a trial’s outcomes. Using the survival-inferred fragility index (SIFI), we performed an assessment of the fragility of oncology clinical trials.</div></div><div><h3>Materials/Methods</h3><div>We established a database of 332 phase III oncology trials from 2002-2020 for which Kaplan-Meier curves were digitally reconstructed to accurately reproduce survival time and censoring at the individual level. SIFI values were established by counting the number of patients that needed to be iteratively flipped between treatment arms to cause a positive trial to lose statistical significance or for a negative trial to gain statistical significance. This number was then normalized as a percentage of the total trial enrollment. We calculated SIFI using flipping of best (longest) survivor from the intervention arm (SIFI_B), worst (shortest) survivor from the control arm (SIFI_W), and median survivor in the control arm (SIFI_M). Trials were classified based on whether they were testing immune-checkpoint inhibitors (ICIs), targeted therapies, or others. The Mann-Whitney U test was used to perform pairwise comparisons and the Kruskal-Wallis test was used for comparisons of more than 2 groups. Statistical analyses were performed in R.</div></div><div><h3>Results</h3><div>Of the 332 trials assessed, 196 were positive and 136 were negative. There were 190 targeted therapy trials, 52 ICI trials, and 90 trials assessing other agents. The most common primary endpoint was progression-free survival (PFS) (154 trials), followed by overall survival (OS) (136 trials). For all trials, the median SIFI_B was 1.37%, SIFI_W was 1.71%, and SIFI_M was 2.74%. A practice changing ICI trial was the PACIFIC trial, which had SIFI_B of 1.96%, SIFI_W of 1.40%, and SIFI_M of 1.82%. Targeted therapy trials were significantly more robust than ICI trials with SIFI_W of 1.93% vs 1.28% (<em>P</em> = 0.037) and SIFI_M of 3.14% vs 1.98% (<em>P</em> = 0.012). Trials assessing OS as the primary endpoint were significantly more fragile than trials with PFS as the overall endpoint (SIFI_B 0.90% vs. 1.78%, <em>P</em> < 0.001; SIFI_W 1.33% vs. 2.96%, <em>P</em> < 0.001; SIFI_M 2.13% vs. 4.58%, <em>P</em> < 0.001). Lastly, trials with negative outcomes were significantly more fragile than trials with positive outcomes (SIFI_B 1.08% vs. 1.68%, <em>P</em> < 0.001; SIFI_W 1.36% vs. 2.32%, <em>P</em> < 0.001; SIFI_M 2.21% vs. 3.70%, <em>P</em> < 0.001).</div></div><div><h3>Conclusion</h3><div>We found that targeted therapy trials, trials with PFS as the primary endpoint, and positive trials tend to be the most robust. Further work will need to validate the use of SIFI in designing more robust clinical trials.</div></div>","PeriodicalId":14215,"journal":{"name":"International Journal of Radiation Oncology Biology Physics","volume":null,"pages":null},"PeriodicalIF":6.4000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Radiation Oncology Biology Physics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0360301624008253","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose/Objective(s)
The standard of care for oncologic treatment is often established and refined through randomized phase III clinical trials. While the success of a trial is generally established through meeting statistical significance, there are few metrics to measure the robustness of a trial’s outcomes. Using the survival-inferred fragility index (SIFI), we performed an assessment of the fragility of oncology clinical trials.
Materials/Methods
We established a database of 332 phase III oncology trials from 2002-2020 for which Kaplan-Meier curves were digitally reconstructed to accurately reproduce survival time and censoring at the individual level. SIFI values were established by counting the number of patients that needed to be iteratively flipped between treatment arms to cause a positive trial to lose statistical significance or for a negative trial to gain statistical significance. This number was then normalized as a percentage of the total trial enrollment. We calculated SIFI using flipping of best (longest) survivor from the intervention arm (SIFI_B), worst (shortest) survivor from the control arm (SIFI_W), and median survivor in the control arm (SIFI_M). Trials were classified based on whether they were testing immune-checkpoint inhibitors (ICIs), targeted therapies, or others. The Mann-Whitney U test was used to perform pairwise comparisons and the Kruskal-Wallis test was used for comparisons of more than 2 groups. Statistical analyses were performed in R.
Results
Of the 332 trials assessed, 196 were positive and 136 were negative. There were 190 targeted therapy trials, 52 ICI trials, and 90 trials assessing other agents. The most common primary endpoint was progression-free survival (PFS) (154 trials), followed by overall survival (OS) (136 trials). For all trials, the median SIFI_B was 1.37%, SIFI_W was 1.71%, and SIFI_M was 2.74%. A practice changing ICI trial was the PACIFIC trial, which had SIFI_B of 1.96%, SIFI_W of 1.40%, and SIFI_M of 1.82%. Targeted therapy trials were significantly more robust than ICI trials with SIFI_W of 1.93% vs 1.28% (P = 0.037) and SIFI_M of 3.14% vs 1.98% (P = 0.012). Trials assessing OS as the primary endpoint were significantly more fragile than trials with PFS as the overall endpoint (SIFI_B 0.90% vs. 1.78%, P < 0.001; SIFI_W 1.33% vs. 2.96%, P < 0.001; SIFI_M 2.13% vs. 4.58%, P < 0.001). Lastly, trials with negative outcomes were significantly more fragile than trials with positive outcomes (SIFI_B 1.08% vs. 1.68%, P < 0.001; SIFI_W 1.36% vs. 2.32%, P < 0.001; SIFI_M 2.21% vs. 3.70%, P < 0.001).
Conclusion
We found that targeted therapy trials, trials with PFS as the primary endpoint, and positive trials tend to be the most robust. Further work will need to validate the use of SIFI in designing more robust clinical trials.
期刊介绍:
International Journal of Radiation Oncology • Biology • Physics (IJROBP), known in the field as the Red Journal, publishes original laboratory and clinical investigations related to radiation oncology, radiation biology, medical physics, and both education and health policy as it relates to the field.
This journal has a particular interest in original contributions of the following types: prospective clinical trials, outcomes research, and large database interrogation. In addition, it seeks reports of high-impact innovations in single or combined modality treatment, tumor sensitization, normal tissue protection (including both precision avoidance and pharmacologic means), brachytherapy, particle irradiation, and cancer imaging. Technical advances related to dosimetry and conformal radiation treatment planning are of interest, as are basic science studies investigating tumor physiology and the molecular biology underlying cancer and normal tissue radiation response.