Pub Date : 2024-11-16DOI: 10.1080/10543406.2024.2424845
Hao Sun, Hsin-Yu Lin, Jieqi Tu, Revathi Ananthakrishnan, Eunhee Kim
Traditional phase I dose finding cancer clinical trial designs aim to determine the maximum tolerated dose (MTD) of the investigational cytotoxic agent based on a single toxicity outcome, assuming a monotone dose-response relationship. However, this assumption might not always hold for newly emerging therapies such as immuno-oncology therapies and molecularly targeted therapies, making conventional dose finding trial designs based on toxicity no longer appropriate. To tackle this issue, numerous early-phase dose finding clinical trial designs have been developed to identify the optimal biological dose (OBD), which takes both toxicity and efficacy outcomes into account. In this article, we review the current model-assisted dose finding designs, BOIN-ET, BOIN12, UBI, TEPI-2, PRINTE, STEIN, and uTPI to identify the OBD and compare their operating characteristics. Extensive simulation studies and a case study using a CAR T-cell therapy phase I trial have been conducted to compare the performance of the aforementioned designs under different possible dose-response relationship scenarios. The simulation results demonstrate that the performance of different designs varies depending on the particular dose-response relationship and the specific metric considered. Based on our simulation results and practical considerations, STEIN, PRINTE, and BOIN12 outperform the other designs from different perspectives.
传统的癌症 I 期剂量发现临床试验设计旨在根据单一的毒性结果来确定研究性细胞毒性药物的最大耐受剂量 (MTD),并假设存在单调的剂量-反应关系。然而,对于新出现的疗法,如免疫肿瘤疗法和分子靶向疗法,这一假设可能并不总是成立,因此基于毒性的传统剂量发现试验设计不再适用。为解决这一问题,人们开发了许多早期剂量寻找临床试验设计,以确定最佳生物剂量(OBD),并同时考虑毒性和疗效结果。在本文中,我们回顾了目前的模型辅助剂量寻找设计:BOIN-ET、BOIN12、UBI、TEPI-2、PRINTE、STEIN 和 uTPI,以确定 OBD 并比较它们的运行特征。我们进行了广泛的模拟研究,并利用 CAR T 细胞疗法 I 期试验进行了案例研究,以比较上述设计在不同可能的剂量-反应关系情况下的性能。模拟结果表明,不同设计的性能取决于特定的剂量-反应关系和考虑的具体指标。根据我们的模拟结果和实际考虑,STEIN、PRINTE 和 BOIN12 从不同角度来看都优于其他设计。
{"title":"Statistical operating characteristics of current early phase dose finding designs with toxicity and efficacy in oncology.","authors":"Hao Sun, Hsin-Yu Lin, Jieqi Tu, Revathi Ananthakrishnan, Eunhee Kim","doi":"10.1080/10543406.2024.2424845","DOIUrl":"https://doi.org/10.1080/10543406.2024.2424845","url":null,"abstract":"<p><p>Traditional phase I dose finding cancer clinical trial designs aim to determine the maximum tolerated dose (MTD) of the investigational cytotoxic agent based on a single toxicity outcome, assuming a monotone dose-response relationship. However, this assumption might not always hold for newly emerging therapies such as immuno-oncology therapies and molecularly targeted therapies, making conventional dose finding trial designs based on toxicity no longer appropriate. To tackle this issue, numerous early-phase dose finding clinical trial designs have been developed to identify the optimal biological dose (OBD), which takes both toxicity and efficacy outcomes into account. In this article, we review the current model-assisted dose finding designs, BOIN-ET, BOIN12, UBI, TEPI-2, PRINTE, STEIN, and uTPI to identify the OBD and compare their operating characteristics. Extensive simulation studies and a case study using a CAR T-cell therapy phase I trial have been conducted to compare the performance of the aforementioned designs under different possible dose-response relationship scenarios. The simulation results demonstrate that the performance of different designs varies depending on the particular dose-response relationship and the specific metric considered. Based on our simulation results and practical considerations, STEIN, PRINTE, and BOIN12 outperform the other designs from different perspectives.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-21"},"PeriodicalIF":1.2,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142645142","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-16DOI: 10.1080/10543406.2024.2420640
John A Spanias, Robbie Buderi, Pierre-Louis Bourlon, Christopher Tso, Caleb Strait, David Saunders, Kayleen Ports, Weixi Chen, Rahul Jain, Bhargav Koduru, Danielle Gerome, Eric Yang, Silvy Saltzmann, Aniketh Talwai, Tanmay Jain, Jacob Aptekar
Randomized controlled trials (RCTs) are the gold standard for clinical research but may not accurately reflect the impact of medicines in real-world settings. Supplementing RCTs with insights from real-world data (RWD) can address known limitations by including more diverse patient populations, additional types of sites-of-care, and practices more representative of the care most people receive. One current challenge in using RWD is the lack of an algorithmic approach to identifying outcomes. To address this, machine learning models for identifying a frequently used outcome, Major Adverse Cardiovascular Events (MACE), were developed in Clinical Trial Data (CTD). Anonymized CTD sourced from the Medidata Enterprise Data Store were used to develop model features on the condition that they would be useful for labelling MACE events and that they could also be found in RWD. These features were used to train three random forest models to identify each component of 3-point MACE in a patient's clinical trial journey. Performance metrics for the models are presented (recall = 0.72 [0.07], precision = 0.68 [0.12] - mean, [SD]) along with the top contributing features. We show that the models can be tuned specifically to replicate the adjudication panels' results and present a cost-benefit analysis for deploying such models in clinical trial settings. We demonstrate the viability of using advanced algorithms for identifying clinical outcomes in prospective clinical trials. Deployment of such models could reduce the resources required to conduct RCTs. Extending such models to RWD would facilitate approval of pragmatic clinical trials for regulatory submissions.
{"title":"Machine learning approach for detection of MACE events within clinical trial data.","authors":"John A Spanias, Robbie Buderi, Pierre-Louis Bourlon, Christopher Tso, Caleb Strait, David Saunders, Kayleen Ports, Weixi Chen, Rahul Jain, Bhargav Koduru, Danielle Gerome, Eric Yang, Silvy Saltzmann, Aniketh Talwai, Tanmay Jain, Jacob Aptekar","doi":"10.1080/10543406.2024.2420640","DOIUrl":"https://doi.org/10.1080/10543406.2024.2420640","url":null,"abstract":"<p><p>Randomized controlled trials (RCTs) are the gold standard for clinical research but may not accurately reflect the impact of medicines in real-world settings. Supplementing RCTs with insights from real-world data (RWD) can address known limitations by including more diverse patient populations, additional types of sites-of-care, and practices more representative of the care most people receive. One current challenge in using RWD is the lack of an algorithmic approach to identifying outcomes. To address this, machine learning models for identifying a frequently used outcome, Major Adverse Cardiovascular Events (MACE), were developed in Clinical Trial Data (CTD). Anonymized CTD sourced from the Medidata Enterprise Data Store were used to develop model features on the condition that they would be useful for labelling MACE events and that they could also be found in RWD. These features were used to train three random forest models to identify each component of 3-point MACE in a patient's clinical trial journey. Performance metrics for the models are presented (recall = 0.72 [0.07], precision = 0.68 [0.12] - mean, [SD]) along with the top contributing features. We show that the models can be tuned specifically to replicate the adjudication panels' results and present a cost-benefit analysis for deploying such models in clinical trial settings. We demonstrate the viability of using advanced algorithms for identifying clinical outcomes in prospective clinical trials. Deployment of such models could reduce the resources required to conduct RCTs. Extending such models to RWD would facilitate approval of pragmatic clinical trials for regulatory submissions.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-16"},"PeriodicalIF":1.2,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142645141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-14DOI: 10.1080/10543406.2024.2424838
K Silpa, E P Sreedevi, P G Sankaran
In this paper, we propose a novel method for the analysis of cure rate data with competing risks using defective distributions. We develop two defective regression models for the analysis of competing risk data subjected to random right censoring. The proposed models enable us to estimate the cure fraction directly from the model. Simultaneously, we also estimate the regression parameters corresponding to each cause of failure using the method of maximum likelihood. We conduct a simulation study to evaluate the finite sample performance of the proposed estimators. The practical usefulness of the procedures is illustrated using two real-life data sets.
{"title":"Defective regression models for cure rate data with competing risks.","authors":"K Silpa, E P Sreedevi, P G Sankaran","doi":"10.1080/10543406.2024.2424838","DOIUrl":"10.1080/10543406.2024.2424838","url":null,"abstract":"<p><p>In this paper, we propose a novel method for the analysis of cure rate data with competing risks using defective distributions. We develop two defective regression models for the analysis of competing risk data subjected to random right censoring. The proposed models enable us to estimate the cure fraction directly from the model. Simultaneously, we also estimate the regression parameters corresponding to each cause of failure using the method of maximum likelihood. We conduct a simulation study to evaluate the finite sample performance of the proposed estimators. The practical usefulness of the procedures is illustrated using two real-life data sets.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-17"},"PeriodicalIF":1.2,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142632960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-06DOI: 10.1080/10543406.2024.2421424
Weiliang Qiu, Cheng Wenren, Els Pattyn, Tamara Slavnic, Luc Esserméant
Dose-response relationships are important in assessing the efficacy and potency of compounds, which can usually be characterized by a 4-parameter logistic (4-PL) model estimating EC50, slope factor, lower asymptote, and upper asymptote. EC50, the concentration of a compound that induces a response halfway between the baseline and maximum, is a key quantity to evaluate compound potency. For multi-donor dose-response data, it is often of interest to estimate the overall EC50 (i.e. the average EC50 of the population of donors) and its 95% confidence interval (CI). A few multi-donor EC50 estimation methods have been proposed in the literature. Jiang and Kopp-Schneider (2014) systematically compared the meta-analysis approach and the nonlinear mixed-effects approach and concluded that the meta-analysis approach is simple and robust to summarize EC50 estimates from multiple experiments, especially suited in the case of a small number of experiments, while the nonlinear mixed-effects approach has the issue of convergence failures probably due to overparameterization. In this article, we propose a modification of the nonlinear mixed-effects approach by using the stochastic approximation expectation-maximization (SAEM) algorithm to estimate model parameters and using multiple starting points to search for globally optimal values, which can substantially alleviate the issue of convergence failures even for small number of donors (e.g. n = 3), and achieve a smaller absolute median bias and better coverage probability of 95% confidence interval than the meta-analysis approach when the number of donors is not too small (e.g. n ≥ 7).
{"title":"An investigation to improve a nonlinear mixed-effects approach for EC50 estimation based on multi-donor dose-response data.","authors":"Weiliang Qiu, Cheng Wenren, Els Pattyn, Tamara Slavnic, Luc Esserméant","doi":"10.1080/10543406.2024.2421424","DOIUrl":"https://doi.org/10.1080/10543406.2024.2421424","url":null,"abstract":"<p><p>Dose-response relationships are important in assessing the efficacy and potency of compounds, which can usually be characterized by a 4-parameter logistic (4-PL) model estimating EC50, slope factor, lower asymptote, and upper asymptote. EC50, the concentration of a compound that induces a response halfway between the baseline and maximum, is a key quantity to evaluate compound potency. For multi-donor dose-response data, it is often of interest to estimate the overall EC50 (i.e. the average EC50 of the population of donors) and its 95% confidence interval (CI). A few multi-donor EC50 estimation methods have been proposed in the literature. Jiang and Kopp-Schneider (2014) systematically compared the meta-analysis approach and the nonlinear mixed-effects approach and concluded that the meta-analysis approach is simple and robust to summarize EC50 estimates from multiple experiments, especially suited in the case of a small number of experiments, while the nonlinear mixed-effects approach has the issue of convergence failures probably due to overparameterization. In this article, we propose a modification of the nonlinear mixed-effects approach by using the stochastic approximation expectation-maximization (SAEM) algorithm to estimate model parameters and using multiple starting points to search for globally optimal values, which can substantially alleviate the issue of convergence failures even for small number of donors (e.g. <i>n</i> = 3), and achieve a smaller absolute median bias and better coverage probability of 95% confidence interval than the meta-analysis approach when the number of donors is not too small (e.g. <i>n</i> ≥ 7).</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-16"},"PeriodicalIF":1.2,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142583752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-04DOI: 10.1080/10543406.2024.2420657
Canhui Li, Jiangzhou Wang, Pengfei Wang
Taking into account the local dependence structure in large-scale multiple testing is expected to improve both the efficiency of the testing procedure and the interpretability of scientific findings. The hidden Markov model (HMM), as an effective model to describe the sequential dependence, has been successfully applied to large-scale multiple testing with local correlations. However, in many applications, the first-order Markov chain is not flexible enough to capture the complexity of local correlations. To address this issue, this paper proposes a novel multiple testing procedure that uses a higher-order Markov chain to better characterize local correlations among tests. The proposed procedure is validated by theoretical results and simulation studies, which show that it outperforms its competitors in terms of power. Finally, a real data analysis is presented to demonstrate the favorable performance of the proposed procedure.
{"title":"Large-scale dependent multiple testing via higher-order hidden Markov models.","authors":"Canhui Li, Jiangzhou Wang, Pengfei Wang","doi":"10.1080/10543406.2024.2420657","DOIUrl":"https://doi.org/10.1080/10543406.2024.2420657","url":null,"abstract":"<p><p>Taking into account the local dependence structure in large-scale multiple testing is expected to improve both the efficiency of the testing procedure and the interpretability of scientific findings. The hidden Markov model (HMM), as an effective model to describe the sequential dependence, has been successfully applied to large-scale multiple testing with local correlations. However, in many applications, the first-order Markov chain is not flexible enough to capture the complexity of local correlations. To address this issue, this paper proposes a novel multiple testing procedure that uses a higher-order Markov chain to better characterize local correlations among tests. The proposed procedure is validated by theoretical results and simulation studies, which show that it outperforms its competitors in terms of power. Finally, a real data analysis is presented to demonstrate the favorable performance of the proposed procedure.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-13"},"PeriodicalIF":1.2,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142570393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-30DOI: 10.1080/10543406.2024.2420659
Jing Kersey, Hani Samawi, Marwan Alsharman, Mario Keko, Haresh Rochani, Lili Yu, Jingjing Yin, Kelly Sullivan, Salaheddin Mustafa
In the realm of medical diagnostic testing, diagnostic tests can assume either binary forms, distinguishing between diseased and non-diseased states, or ordinal forms, categorizing states from non-diseased to various stages (1 to K). Another significant classification scheme for multi-class scenarios is tree or umbrella ordering, which entails several unordered sub-classes (subtypes) within a biomarker. Within tree or umbrella ordering, the classifier assesses whether the marker measurement for one class surpasses or falls below those for the other classes. Although Receiver Operating Characteristic (ROC) curves and summary measures have been adapted to accommodate tree and umbrella ordering, these approaches often yield cut-off points that generate highly sensitive tests for certain disease subtypes while compromising specificity for others. This may not be ideal for all diseases. Hence, in this investigation, we explore diverse measures of diagnostic test accuracy and optimal cut-off point selection procedures under tree or umbrella ordering to foster more specific tests. We present numerical examples and simulation studies and demonstrate the approach using real data on lung cancer.
{"title":"Different view of the diagnostics test accuracy measures and optimal cut-off point selection procedure under tree or umbrella ordering.","authors":"Jing Kersey, Hani Samawi, Marwan Alsharman, Mario Keko, Haresh Rochani, Lili Yu, Jingjing Yin, Kelly Sullivan, Salaheddin Mustafa","doi":"10.1080/10543406.2024.2420659","DOIUrl":"https://doi.org/10.1080/10543406.2024.2420659","url":null,"abstract":"<p><p>In the realm of medical diagnostic testing, diagnostic tests can assume either binary forms, distinguishing between diseased and non-diseased states, or ordinal forms, categorizing states from non-diseased to various stages (1 to K). Another significant classification scheme for multi-class scenarios is tree or umbrella ordering, which entails several unordered sub-classes (subtypes) within a biomarker. Within tree or umbrella ordering, the classifier assesses whether the marker measurement for one class surpasses or falls below those for the other classes. Although Receiver Operating Characteristic (ROC) curves and summary measures have been adapted to accommodate tree and umbrella ordering, these approaches often yield cut-off points that generate highly sensitive tests for certain disease subtypes while compromising specificity for others. This may not be ideal for all diseases. Hence, in this investigation, we explore diverse measures of diagnostic test accuracy and optimal cut-off point selection procedures under tree or umbrella ordering to foster more specific tests. We present numerical examples and simulation studies and demonstrate the approach using real data on lung cancer.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-31"},"PeriodicalIF":1.2,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142549002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The mixed model for repeated measures (MMRM) analysis is sometimes used as a primary statistical analysis for a longitudinal randomized clinical trial. When the MMRM analysis is implemented in ordinary statistical software, the standard error of the treatment effect is estimated by assuming orthogonality between the fixed effects and covariance parameters, based on the characteristics of the normal distribution. However, orthogonality does not hold unless the normality assumption of the error distribution holds, and/or the missing data are derived from the missing completely at random structure. Therefore, assuming orthogonality in the MMRM analysis is not preferable. However, without the assumption of orthogonality, the small-sample bias in the standard error of the treatment effect is significant. Nonetheless, there is no method to improve small-sample performance. Furthermore, there is no software that can easily implement inferences on treatment effects without assuming orthogonality. Hence, we propose two small-sample adjustment methods inflating standard errors that are reasonable in ideal situations and achieve empirical conservatism even in general situations. We also provide an R package to implement these inference processes. The simulation results show that one of the proposed small-sample adjustment methods performs particularly well in terms of underestimation bias of standard errors; consequently, the proposed method is recommended. When using the MMRM analysis, our proposed method is recommended if the sample size is not large and between-group heteroscedasticity is expected.
重复测量混合模型(MMRM)分析有时被用作纵向随机临床试验的主要统计分析。在普通统计软件中实施 MMRM 分析时,会根据正态分布的特点,假设固定效应和协方差参数之间存在正交关系,从而估算治疗效果的标准误差。然而,除非误差分布的正态性假设成立,和/或缺失数据来自完全随机缺失结构,否则正交性不成立。因此,在 MMRM 分析中假设正交性并不可取。然而,如果不假设正交性,治疗效果标准误差的小样本偏差就会很大。然而,目前还没有改善小样本性能的方法。此外,也没有软件可以在不假设正交性的情况下轻松实现治疗效果的推断。因此,我们提出了两种夸大标准误差的小样本调整方法,这两种方法在理想情况下是合理的,即使在一般情况下也能实现经验保守性。我们还提供了一个 R 软件包来实现这些推理过程。模拟结果表明,其中一种建议的小样本调整方法在标准误差的低估偏差方面表现尤为突出;因此,建议使用该方法。在使用 MMRM 分析时,如果样本量不大且预计存在组间异方差,则推荐使用我们提出的方法。
{"title":"Small sample adjustment for inference without assuming orthogonality in a mixed model for repeated measures analysis.","authors":"Kazushi Maruo, Ryota Ishii, Yusuke Yamaguchi, Tomohiro Ohigashi, Masahiko Gosho","doi":"10.1080/10543406.2024.2420632","DOIUrl":"https://doi.org/10.1080/10543406.2024.2420632","url":null,"abstract":"<p><p>The mixed model for repeated measures (MMRM) analysis is sometimes used as a primary statistical analysis for a longitudinal randomized clinical trial. When the MMRM analysis is implemented in ordinary statistical software, the standard error of the treatment effect is estimated by assuming orthogonality between the fixed effects and covariance parameters, based on the characteristics of the normal distribution. However, orthogonality does not hold unless the normality assumption of the error distribution holds, and/or the missing data are derived from the missing completely at random structure. Therefore, assuming orthogonality in the MMRM analysis is not preferable. However, without the assumption of orthogonality, the small-sample bias in the standard error of the treatment effect is significant. Nonetheless, there is no method to improve small-sample performance. Furthermore, there is no software that can easily implement inferences on treatment effects without assuming orthogonality. Hence, we propose two small-sample adjustment methods inflating standard errors that are reasonable in ideal situations and achieve empirical conservatism even in general situations. We also provide an R package to implement these inference processes. The simulation results show that one of the proposed small-sample adjustment methods performs particularly well in terms of underestimation bias of standard errors; consequently, the proposed method is recommended. When using the MMRM analysis, our proposed method is recommended if the sample size is not large and between-group heteroscedasticity is expected.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-15"},"PeriodicalIF":1.2,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142549003","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-27DOI: 10.1080/10543406.2024.2420644
Tianyu Sun, Eileen Liao, Nan Shao, Junxiang Luo
Conducting randomized controlled trials for medications targeting rare diseases presents significant challenges, due to the scarcity of participants and ethical considerations. Under such circumstances, leveraging real-world data (RWD) to generate supporting evidence may be accepted by the regulatory agency. Constructing an external control arm (ECA) from RWD for a single-arm trial has been conducted occasionally. A complication in this design is that patients from RWD may be eligible at multiple time points. Most studies approach this by selecting one time point as the index date for ECA patients. Here, we propose a novel design for externally controlled trials that permits the inclusion of ECA patients at various entry points. Accompanying this design, we make recommendations for statistical methods to account for measured confounders, limited sample size, within-subject correlation, and potential overdispersion inherent in count data. Furthermore, we present an idea for the blinding process for this type of study. We have conducted a series of simulations to assess the performance of the design and statistical methods in terms of bias, type I error, and efficiency, as compared to the approach of selecting only one entry per ECA patient. The study and parameter setup were based on a hypothetical case inspired by a rare disease study. The results indicate that allowing multiple entries for ECA patients can lead to enhanced performance in many aspects. It provides a controlled type I error, robustness against certain model misspecifications, and a moderate power improvement compared with selecting a single entry per ECA patient.
{"title":"Leveraging real-world data to conduct externally controlled trial for rare diseases with count-type endpoints: utilizing multiple entries - a simulation study.","authors":"Tianyu Sun, Eileen Liao, Nan Shao, Junxiang Luo","doi":"10.1080/10543406.2024.2420644","DOIUrl":"https://doi.org/10.1080/10543406.2024.2420644","url":null,"abstract":"<p><p>Conducting randomized controlled trials for medications targeting rare diseases presents significant challenges, due to the scarcity of participants and ethical considerations. Under such circumstances, leveraging real-world data (RWD) to generate supporting evidence may be accepted by the regulatory agency. Constructing an external control arm (ECA) from RWD for a single-arm trial has been conducted occasionally. A complication in this design is that patients from RWD may be eligible at multiple time points. Most studies approach this by selecting one time point as the index date for ECA patients. Here, we propose a novel design for externally controlled trials that permits the inclusion of ECA patients at various entry points. Accompanying this design, we make recommendations for statistical methods to account for measured confounders, limited sample size, within-subject correlation, and potential overdispersion inherent in count data. Furthermore, we present an idea for the blinding process for this type of study. We have conducted a series of simulations to assess the performance of the design and statistical methods in terms of bias, type I error, and efficiency, as compared to the approach of selecting only one entry per ECA patient. The study and parameter setup were based on a hypothetical case inspired by a rare disease study. The results indicate that allowing multiple entries for ECA patients can lead to enhanced performance in many aspects. It provides a controlled type I error, robustness against certain model misspecifications, and a moderate power improvement compared with selecting a single entry per ECA patient.</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-13"},"PeriodicalIF":1.2,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142513228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-24DOI: 10.1080/10543406.2024.2418139
Hongfei Li, Qian H Li, Chuan Tian, Kevin Hou
{"title":"Issues in cox proportional hazards model with unequal randomization.","authors":"Hongfei Li, Qian H Li, Chuan Tian, Kevin Hou","doi":"10.1080/10543406.2024.2418139","DOIUrl":"https://doi.org/10.1080/10543406.2024.2418139","url":null,"abstract":"","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-6"},"PeriodicalIF":1.2,"publicationDate":"2024-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142513227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-08DOI: 10.1080/10543406.2024.2374857
Gaohong Dong, Ying Cui, Margaret Gamalo-Siebers, Ran Liao, Dacheng Liu, David C Hoaglin, Ying Lu
Dong et al. (2023) showed that the win statistics (win ratio, win odds, and net benefit) can complement each another to demonstrate the strength of treatment effects in randomized trials with prioritized multiple outcomes. This result was built on the connections among the point and variance estimates of the three statistics, and the approximate equality of Z-values in their statistical tests. However, the impact of this approximation was not clear. This Discussion refines this approach and shows that the approximate equality of Z-values for the win statistics holds more generally. Thus, the three win statistics consistently yield closely similar p-values. In addition, our simulations show an example that the naive approach without adjustment for censoring bias may produce a completely opposite conclusion from the true results, whereas the IPCW (inverse-probability-of-censoring weighting) approach can effectively adjust the win statistics to the corresponding true values (i.e. IPCW-adjusted win statistics are unbiased estimators of treatment effect).
Dong 等人(2023 年)的研究表明,胜出统计量(胜出率、胜出几率和净收益)可以互为补充,在优先考虑多种结果的随机试验中证明治疗效果的强度。这一结果建立在三个统计量的点和方差估计值之间的联系以及统计检验中 Z 值的近似相等之上。然而,这一近似值的影响并不明确。本讨论完善了这一方法,并表明赢家统计的 Z 值近似相等在更大范围内成立。因此,三种胜出统计量都能得出非常接近的 p 值。此外,我们的模拟还举例说明,不对删减偏倚进行调整的天真方法可能会得出与真实结果完全相反的结论,而 IPCW(反删减概率加权)方法可以有效地将胜出统计量调整为相应的真实值(即 IPCW 调整后的胜出统计量是无偏的治疗效果估计值)。
{"title":"On approximate equality of Z-values of the statistical tests for win statistics (win ratio, win odds, and net benefit).","authors":"Gaohong Dong, Ying Cui, Margaret Gamalo-Siebers, Ran Liao, Dacheng Liu, David C Hoaglin, Ying Lu","doi":"10.1080/10543406.2024.2374857","DOIUrl":"https://doi.org/10.1080/10543406.2024.2374857","url":null,"abstract":"<p><p>Dong et al. (2023) showed that the win statistics (win ratio, win odds, and net benefit) can complement each another to demonstrate the strength of treatment effects in randomized trials with prioritized multiple outcomes. This result was built on the connections among the point and variance estimates of the three statistics, and the approximate equality of Z-values in their statistical tests. However, the impact of this approximation was not clear. This Discussion refines this approach and shows that the approximate equality of Z-values for the win statistics holds more generally. Thus, the three win statistics consistently yield closely similar p-values. In addition, our simulations show an example that the naive approach without adjustment for censoring bias may produce a completely opposite conclusion from the true results, whereas the IPCW (inverse-probability-of-censoring weighting) approach can effectively adjust the win statistics to the corresponding true values (i.e. IPCW-adjusted win statistics are unbiased estimators of treatment effect).</p>","PeriodicalId":54870,"journal":{"name":"Journal of Biopharmaceutical Statistics","volume":" ","pages":"1-8"},"PeriodicalIF":1.2,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142395406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}