A bootstrapping method to optimize go/no-go decisions from single-arm, signal-finding studies in oncology

Abstract

Phase Ib trials are common in oncology development but often are not powered for statistical significance. Go/no-go decisions are largely driven by observed trends in response data. We applied a bootstrapping method to systematically compare tumor dynamic end points to historical control data to identify drugs with clinically meaningful efficacy. A proprietary mathematical model calibrated to phase Ib anti–PD-1 therapy trial data (KEYNOTE-001) was used to simulate thousands of phase Ib trials (n = 30) with a combination of anti–PD-1 therapy and four novel agents with varying efficacy. A redacted bootstrapping method compared these results to a simulated phase III control arm (N = 511) while adjusting for differences in trial duration and cohort size to determine the probability that the novel agent provides clinically meaningful efficacy. Receiver operating characteristic (ROC) analysis showed strong ability to separate drugs with modest (area under ROC [AUROC] = 83%), moderate (AUROC = 96%), and considerable efficacy (AUROC = 99%) from placebo in early-phase trials (n = 30). The method was shown to effectively move drugs with a range of efficacy through an in silico pipeline with an overall success rate of 93% and false-positive rate of 7.5% from phase I to phase III. This model allows for effective comparisons of tumor dynamics from early clinical trials with more mature historical control data and provides a framework to predict drug efficacy in early-phase trials. We suggest this method should be employed to improve decision making in early oncology trials.