Enhancing generalizability and efficiency in clinical trials through dynamic information borrowing for both experimental and control arms: A simulation study
{"title":"Enhancing generalizability and efficiency in clinical trials through dynamic information borrowing for both experimental and control arms: A simulation study","authors":"Jiaying Yang, Guochun Li","doi":"10.1111/jebm.12574","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Aim</h3>\n \n <p>Utilizing external information in clinical trials enhances validity by including a wider population and expedites the implementation of adaptive designs, ultimately improving research efficiency. However, current research focused on scenarios in which only the control group benefited from the utilization of external information, while trials involving external information in both experimental and control arms were more complex and might pose challenges when applied in real-world settings.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>To address these concerns, our study pioneered the application of test-then-pool, normalized power prior, calibrated power prior, and elastic prior to a two-arm information borrowing framework and systematically compared their operating characteristics through a series of simulation studies under most and least desirable scenarios.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>In the most desirable scenarios of information borrowing, all methods managed to control the mean of type I error rates within 5%, among which the normalized power prior, calibrated power prior and elastic prior approaches increased the mean of power from 85.94% to 95%. In the least desirable scenarios, the mean type I error rates for normalized power prior, calibrated power prior and elastic prior approaches exceeded 20%, while the mean power decreased to around 80%.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>Our findings reveal that the normalized power prior, calibrated power prior and elastic prior approaches are suitable for situations with minimal heterogeneity between historical and current data, whereas the test-then-pool approach emerges as a more prudent choice when facing substantial discrepancies between historical and current information for trials consider information borrow in both arms.</p>\n </section>\n </div>","PeriodicalId":16090,"journal":{"name":"Journal of Evidence‐Based Medicine","volume":"16 4","pages":"547-556"},"PeriodicalIF":3.6000,"publicationDate":"2023-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jebm.12574","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Evidence‐Based Medicine","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jebm.12574","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Aim
Utilizing external information in clinical trials enhances validity by including a wider population and expedites the implementation of adaptive designs, ultimately improving research efficiency. However, current research focused on scenarios in which only the control group benefited from the utilization of external information, while trials involving external information in both experimental and control arms were more complex and might pose challenges when applied in real-world settings.
Methods
To address these concerns, our study pioneered the application of test-then-pool, normalized power prior, calibrated power prior, and elastic prior to a two-arm information borrowing framework and systematically compared their operating characteristics through a series of simulation studies under most and least desirable scenarios.
Results
In the most desirable scenarios of information borrowing, all methods managed to control the mean of type I error rates within 5%, among which the normalized power prior, calibrated power prior and elastic prior approaches increased the mean of power from 85.94% to 95%. In the least desirable scenarios, the mean type I error rates for normalized power prior, calibrated power prior and elastic prior approaches exceeded 20%, while the mean power decreased to around 80%.
Conclusions
Our findings reveal that the normalized power prior, calibrated power prior and elastic prior approaches are suitable for situations with minimal heterogeneity between historical and current data, whereas the test-then-pool approach emerges as a more prudent choice when facing substantial discrepancies between historical and current information for trials consider information borrow in both arms.
期刊介绍:
The Journal of Evidence-Based Medicine (EMB) is an esteemed international healthcare and medical decision-making journal, dedicated to publishing groundbreaking research outcomes in evidence-based decision-making, research, practice, and education. Serving as the official English-language journal of the Cochrane China Centre and West China Hospital of Sichuan University, we eagerly welcome editorials, commentaries, and systematic reviews encompassing various topics such as clinical trials, policy, drug and patient safety, education, and knowledge translation.