首页 > 最新文献

Statistics in Biopharmaceutical Research最新文献

英文 中文
What Can Be Achieved with the Estimand Framework? Estimand框架可以实现什么?
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-30 DOI: 10.1080/19466315.2023.2173645
Susan Mayo, Yongman Kim
Abstract The ICH E9(R1) guidance on estimands is a key tool for the creation and review of protocol design and analysis planning, for both industry and regulatory statisticians. The framework has been described as useful for improving study design, intercurrent event handling, data collection, analysis, and interpretation to align the estimand with the primary clinical question to add clarity and precision to support regulatory decision-making. In this article, we describe our experience as regulatory statisticians in review of Investigational New Drug protocols and statistical analysis plans, with an emphasis on trials used to support substantial evidence of effectiveness in New Drug Applications and Biologic License Applications. Our intent is to describe our experience with this powerful and effective framework tool, to align the clinical trial’s primary objective with its analysis outcomes and interpretation.
ICH E9(R1)评估指南是行业和监管统计人员创建和审查方案设计和分析计划的关键工具。该框架被描述为有助于改进研究设计、并发事件处理、数据收集、分析和解释,以使评估与主要临床问题保持一致,从而增加清晰度和准确性,以支持监管决策。在本文中,我们描述了我们作为监管统计学家在审查新药研究方案和统计分析计划方面的经验,重点是用于支持新药申请和生物许可证申请中有效性的实质性证据的试验。我们的目的是描述我们使用这个强大而有效的框架工具的经验,使临床试验的主要目标与其分析结果和解释保持一致。
{"title":"What Can Be Achieved with the Estimand Framework?","authors":"Susan Mayo, Yongman Kim","doi":"10.1080/19466315.2023.2173645","DOIUrl":"https://doi.org/10.1080/19466315.2023.2173645","url":null,"abstract":"Abstract The ICH E9(R1) guidance on estimands is a key tool for the creation and review of protocol design and analysis planning, for both industry and regulatory statisticians. The framework has been described as useful for improving study design, intercurrent event handling, data collection, analysis, and interpretation to align the estimand with the primary clinical question to add clarity and precision to support regulatory decision-making. In this article, we describe our experience as regulatory statisticians in review of Investigational New Drug protocols and statistical analysis plans, with an emphasis on trials used to support substantial evidence of effectiveness in New Drug Applications and Biologic License Applications. Our intent is to describe our experience with this powerful and effective framework tool, to align the clinical trial’s primary objective with its analysis outcomes and interpretation.","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42953720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Statistical Considerations and Challenges for Pivotal Clinical Studies of Artificial Intelligence Medical Tests for Widespread Use: Opportunities for Inter-Disciplinary Collaboration 广泛使用的人工智能医学测试关键临床研究的统计考虑和挑战:跨学科合作的机会
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-18 DOI: 10.1080/19466315.2023.2169752
Arkendra De
Abstract The application of Artificial Intelligence to medical testing has received much attention in recent years, as evidenced by the flurry of published studies describing Artificial Intelligence software developed to solve problems in medical testing. While this recent activity is exciting, developed Artificial Intelligence medical tests ultimately can only be considered as candidates for widespread use if these tests demonstrate good performance in pivotal clinical studies. What are pivotal clinical studies for Artificial Intelligence medical tests aimed for widespread use? What are some of the major considerations and challenges for assessing performance of these tests in this context? What are some of the outstanding areas where statisticians, in collaboration with professionals outside the statistical community, could help in this endeavor? This article addresses these questions. This article is meant to appeal to a broad audience with varying levels of statistical and medical testing knowledge so that inter-disciplinary collaboration could be enhanced.
摘要近年来,人工智能在医学检测中的应用受到了极大的关注,一系列已发表的研究证明了这一点,这些研究描述了为解决医学检测问题而开发的人工智能软件。虽然最近的这项活动令人兴奋,但只有在关键临床研究中表现出良好性能的情况下,开发的人工智能医学测试才能最终被视为广泛使用的候选测试。人工智能医学测试的关键临床研究是什么?在这种情况下,评估这些测试的性能的主要考虑因素和挑战是什么?统计学家与统计界以外的专业人士合作,可以在哪些方面提供帮助?本文解决了这些问题。这篇文章旨在吸引具有不同水平统计和医学检测知识的广大受众,以便加强学科间的合作。
{"title":"Statistical Considerations and Challenges for Pivotal Clinical Studies of Artificial Intelligence Medical Tests for Widespread Use: Opportunities for Inter-Disciplinary Collaboration","authors":"Arkendra De","doi":"10.1080/19466315.2023.2169752","DOIUrl":"https://doi.org/10.1080/19466315.2023.2169752","url":null,"abstract":"Abstract The application of Artificial Intelligence to medical testing has received much attention in recent years, as evidenced by the flurry of published studies describing Artificial Intelligence software developed to solve problems in medical testing. While this recent activity is exciting, developed Artificial Intelligence medical tests ultimately can only be considered as candidates for widespread use if these tests demonstrate good performance in pivotal clinical studies. What are pivotal clinical studies for Artificial Intelligence medical tests aimed for widespread use? What are some of the major considerations and challenges for assessing performance of these tests in this context? What are some of the outstanding areas where statisticians, in collaboration with professionals outside the statistical community, could help in this endeavor? This article addresses these questions. This article is meant to appeal to a broad audience with varying levels of statistical and medical testing knowledge so that inter-disciplinary collaboration could be enhanced.","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41493376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Designing Dose-Optimization Studies in Cancer Drug Development: Discussions with Regulators 设计癌症药物开发中的剂量优化研究:与监管机构的讨论
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-09 DOI: 10.1080/19466315.2023.2166099
Olga V. Marchenko, R. Sridhara, Qi Jiang, Elizabeth Barksdale, Y. Ando, D. D. Alwis, Katie Brown, L. Fernandes, M. V. van Bussel, Qiuyi Choo, M. Coory, E. Garrett-Mayer, T. Gwise, Lorenzo Hess, Rong Liu, S. Mandrekar, D. Ouellet, J. Pinheiro, M. Posch, N. Rahman, K. Rantell, A. Raven, Sarem Sarem, S. Sen, M. Shah, Y. Shen, Richard Simon, M. Theoret, Ying Yuan, R. Pazdur
Abstract The article provides a summary of discussions from the American Statistical Association (ASA) Biopharmaceutical (BIOP) Section Open Forums on March 18th, June 10th, and July 8th of 2021, organized by the ASA BIOP Statistical Methods in Oncology Scientific Working Group in coordination with the U.S. Food and Drug Administration (FDA) Oncology Center of Excellence and the LUNGevity Foundation. Diverse stakeholders including oncologists, patient advocates, experts from regulatory agencies across the world, academicians, and representatives from the pharmaceutical industry engaged in a lively discussion on strategies for and designs of dose-optimization studies in cancer drug development. Dose-optimization is one of the major challenges in oncology drug development. The discussions were focused on considerations in designing dose-optimization studies of products for treatment of cancer patients in pre-approval and post-approval stages. Presenters and panelists discussed diverse ideas and methods and agreed that a shift in paradigm is required in oncology drug development that should improve dose optimization while not unnecessarily delaying patient access to potentially efficacious new treatments.
摘要:本文提供了2021年3月18日、6月10日和7月8日美国统计协会(ASA)生物制药(BIOP)分会公开论坛的讨论总结,该论坛由ASA BIOP肿瘤科学工作组与美国食品和药物管理局(FDA)肿瘤卓越中心和LUNGevity基金会协调组织。包括肿瘤学家、患者倡导者、来自世界各地监管机构的专家、学者和制药行业代表在内的各种利益相关者就癌症药物开发中剂量优化研究的策略和设计进行了热烈的讨论。剂量优化是肿瘤药物开发的主要挑战之一。讨论的重点是在批准前和批准后阶段设计用于治疗癌症患者的产品的剂量优化研究的考虑因素。演讲者和小组成员讨论了不同的想法和方法,并一致认为肿瘤药物开发需要转变模式,以改善剂量优化,同时不会不必要地延迟患者获得潜在有效的新治疗方法。
{"title":"Designing Dose-Optimization Studies in Cancer Drug Development: Discussions with Regulators","authors":"Olga V. Marchenko, R. Sridhara, Qi Jiang, Elizabeth Barksdale, Y. Ando, D. D. Alwis, Katie Brown, L. Fernandes, M. V. van Bussel, Qiuyi Choo, M. Coory, E. Garrett-Mayer, T. Gwise, Lorenzo Hess, Rong Liu, S. Mandrekar, D. Ouellet, J. Pinheiro, M. Posch, N. Rahman, K. Rantell, A. Raven, Sarem Sarem, S. Sen, M. Shah, Y. Shen, Richard Simon, M. Theoret, Ying Yuan, R. Pazdur","doi":"10.1080/19466315.2023.2166099","DOIUrl":"https://doi.org/10.1080/19466315.2023.2166099","url":null,"abstract":"Abstract The article provides a summary of discussions from the American Statistical Association (ASA) Biopharmaceutical (BIOP) Section Open Forums on March 18th, June 10th, and July 8th of 2021, organized by the ASA BIOP Statistical Methods in Oncology Scientific Working Group in coordination with the U.S. Food and Drug Administration (FDA) Oncology Center of Excellence and the LUNGevity Foundation. Diverse stakeholders including oncologists, patient advocates, experts from regulatory agencies across the world, academicians, and representatives from the pharmaceutical industry engaged in a lively discussion on strategies for and designs of dose-optimization studies in cancer drug development. Dose-optimization is one of the major challenges in oncology drug development. The discussions were focused on considerations in designing dose-optimization studies of products for treatment of cancer patients in pre-approval and post-approval stages. Presenters and panelists discussed diverse ideas and methods and agreed that a shift in paradigm is required in oncology drug development that should improve dose optimization while not unnecessarily delaying patient access to potentially efficacious new treatments.","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48005392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comment on” Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions” 评论“新冠肺炎大流行影响的临床试验的估计及其估计:NISS Ingram Olkin论坛系列关于计划外临床试验中断的报告”
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/19466315.2022.2128405
S. Vansteelandt
I would like to thank the editor, Prof. Hamasaki, for the opportunity to comment on the thought-provoking work by the NISS working group on unplanned clinical trial disruptions (Van Lancker et al. 2022). The working group’s proposals focus on two basic problems relevant to clinical trials affected by the COVID19 pandemic. The first problem is that, due to the pandemic, the patient population may change systematically over the course of the trial. This raises questions over what is the relevant patient population for which the effect is of interest. The second problem, which receives the major focus in the paper, relates to problems of intercurrent events fueled by the pandemic. The solutions proposed by the working group are interesting and useful. In this commentary, I will nonetheless raise two conceptual shortcomings, which I will attempt to resolve by making more explicit use of methods from causal inference (as opposed to missing data analysis). First, the data collected in a randomized clinical trial are so precious that it is generally difficult to justify ignoring the data collected before or after the start of the pandemic. Those data will often still carry useful information about treatment efficacy, and should ideally be used. Second, whenever possible, analyses of randomized clinical trials should protect the null hypothesis of no treatment effect in the sense that rejection rates should be no larger than the nominal (5%) rate, even when the adopted assumptions fail. Intercurrent events 6 and 7 appear such that they will occur with equal rates in both arms of the trial. If this is so, then this suggests that standard analyses that target the treatment policy estimand, thus ignoring intercurrent events, will protect the null hypothesis of no treatment effect; indeed, the treatment policy estimand then reduces to the balanced estimand of Michiels et al. (2021), which expresses what the treatment effect had been had intercurrent events occurred at “equal rates” in both arms. In this light, analyses that invoke Missing At Random (MAR) assumptions must be taken with caution, as they may be biased whenever the MAR assumption fails. More importantly, analyses that explicitly combine biased and unbiased estimators, as in
我要感谢编辑滨崎步教授给我机会对NISS工作组关于计划外临床试验中断的发人深省的工作发表评论(Van Lancker等人,2022)。工作组的建议集中在与受新冠肺炎疫情影响的临床试验相关的两个基本问题上。第一个问题是,由于大流行,患者群体可能会在试验过程中发生系统性变化。这就提出了一个问题,即感兴趣的相关患者群体是什么。论文主要关注的第二个问题与疫情引发的并发事件有关。工作组提出的解决方案是令人感兴趣和有用的。然而,在这篇评论中,我将提出两个概念上的缺陷,我将试图通过更明确地使用因果推断的方法(而不是缺失的数据分析)来解决这两个缺陷。首先,随机临床试验中收集的数据非常宝贵,通常很难证明忽视在大流行开始之前或之后收集的数据是合理的。这些数据通常仍然会包含有关治疗效果的有用信息,并且应该在理想情况下使用。其次,在可能的情况下,随机临床试验的分析应保护无治疗效果的无效假设,即排斥率不应大于标称(5%),即使所采用的假设失败。并发事件6和7的出现使得它们在试验的两个阶段中的发生率相等。如果是这样的话,那么这表明针对治疗政策估计的标准分析,从而忽略并发事件,将保护没有治疗效果的无效假设;事实上,治疗政策的估计需求随后减少到Michiels等人的平衡估计需求。(2021),它表达了如果两组同时发生的事件以“相等的比率”发生,治疗效果是什么。有鉴于此,必须谨慎对待援引随机缺失(MAR)假设的分析,因为每当MAR假设失败时,这些分析可能会有偏差。更重要的是,明确结合有偏和无偏估计量的分析,如
{"title":"Comment on” Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions”","authors":"S. Vansteelandt","doi":"10.1080/19466315.2022.2128405","DOIUrl":"https://doi.org/10.1080/19466315.2022.2128405","url":null,"abstract":"I would like to thank the editor, Prof. Hamasaki, for the opportunity to comment on the thought-provoking work by the NISS working group on unplanned clinical trial disruptions (Van Lancker et al. 2022). The working group’s proposals focus on two basic problems relevant to clinical trials affected by the COVID19 pandemic. The first problem is that, due to the pandemic, the patient population may change systematically over the course of the trial. This raises questions over what is the relevant patient population for which the effect is of interest. The second problem, which receives the major focus in the paper, relates to problems of intercurrent events fueled by the pandemic. The solutions proposed by the working group are interesting and useful. In this commentary, I will nonetheless raise two conceptual shortcomings, which I will attempt to resolve by making more explicit use of methods from causal inference (as opposed to missing data analysis). First, the data collected in a randomized clinical trial are so precious that it is generally difficult to justify ignoring the data collected before or after the start of the pandemic. Those data will often still carry useful information about treatment efficacy, and should ideally be used. Second, whenever possible, analyses of randomized clinical trials should protect the null hypothesis of no treatment effect in the sense that rejection rates should be no larger than the nominal (5%) rate, even when the adopted assumptions fail. Intercurrent events 6 and 7 appear such that they will occur with equal rates in both arms of the trial. If this is so, then this suggests that standard analyses that target the treatment policy estimand, thus ignoring intercurrent events, will protect the null hypothesis of no treatment effect; indeed, the treatment policy estimand then reduces to the balanced estimand of Michiels et al. (2021), which expresses what the treatment effect had been had intercurrent events occurred at “equal rates” in both arms. In this light, analyses that invoke Missing At Random (MAR) assumptions must be taken with caution, as they may be biased whenever the MAR assumption fails. More importantly, analyses that explicitly combine biased and unbiased estimators, as in","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48715465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The NISS Ingram Olkin Forum on Unplanned Clinical Trial Disruptions NISS Ingram Olkin非计划临床试验中断论坛
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/19466315.2022.2152090
N. Flournoy
CONTACT Nancy Flournoy flournoyn@missouri.edu Department of Statistics, University of Missouri (emerita), Columbia. The efforts arose from working groups formed during a NISS Ingram Olkin Forum series on the following topics: (1)Estimands and Missing Data, (2) The Role of Randomization Tests, (3) Methods to Cope with Information Loss and the Use of Auxiliary Sources of Data and (4) Bayes and Frequentist Approaches to Rescuing Disrupted Trials. These groups consider how existing methods can be applied in the context of unplanned clinical trial disruptions and uncover unsolved issues requiring further research. In addition to introducing you to these research projects, I am pleased to provide a brief introduction to the NISS Ingram Olkin Forums. The National Institute of Statistical Sciences (NISS) created Ingram Olkin Forums (IOFs) to foster Statistics Serving Society (S3) in memory of Professor Ingram Olkin. Motivated by the aspirations set forth by Olkin et al. (1990), each forum focuses on a current societal issue that might benefit from new or renewed attention from the statistical community. IOFs aim to bring the latest innovations in statistical methodology and data science into new research and public policy collaborations, working to accelerate the development of innovative approaches that impact societal problems. As a Forum brings a particular group of experts together for the first time to consider an issue, new energy and synergy is expected to produce a flurry of new ideas and approaches. The inaugural IOF was held in June 1919 on Gun Violence, prior to the arrival of the Covid-19 pandemic. Knowing that many statisticians would use their expertise to monitor the pandemic and to design vaccine and therapeutic trials, the IOF Committee looked for a need that might be neglected and decided to host an online IOF on Unplanned Clinical Trial Disruptions. A major concern in moving online was not to get stuck with one-directional webinars, but to get statisticians and other scientists who did not know each other previously to work together without meeting in-person. I am delighted to announce four papers resulting from this IOF will appear in Statistics in Biopharmaceutical Research. NISS is very happy with how well the IOF on Unplanned Clinical Trial Disruptions met its S3 objectives, with enthusiastic collegiality and productivity, and although in-person and hybrid launches will again be possible, this IOF is now NISS’s model.
联系Nancy Flournoy flournoyn@missouri.edu哥伦比亚密苏里大学统计学系(荣誉退休)。这些努力来自于NISS英格拉姆·奥尔金论坛系列会议期间组成的工作组,讨论以下主题:(1)估计和丢失数据;(2)随机化测试的作用;(3)处理信息丢失和使用辅助数据源的方法;(4)挽救中断试验的贝叶斯和频率方法。这些小组考虑如何将现有方法应用于计划外临床试验中断的背景下,并发现需要进一步研究的未解决问题。除了向大家介绍这些研究项目外,我还很高兴为NISS英格拉姆·奥尔金论坛做一个简短的介绍。为了纪念英格拉姆•奥尔金教授,国立统计科学研究所(NISS)创建了英格拉姆•奥尔金论坛(IOFs),以培育“统计服务社会”(S3)。在Olkin等人(1990)提出的愿望的推动下,每个论坛都侧重于当前的社会问题,这些问题可能会从统计界的新关注或重新关注中受益。IOFs旨在将统计方法和数据科学的最新创新引入新的研究和公共政策合作中,努力加速影响社会问题的创新方法的发展。由于论坛首次将一群特定专家聚集在一起审议一个问题,预计新的能量和协同作用将产生一系列新的想法和方法。首届IOF于1919年6月在2019冠状病毒病大流行到来之前举行,主题是枪支暴力。认识到许多统计学家将利用他们的专门知识来监测大流行并设计疫苗和治疗试验,临床试验联合会委员会寻找可能被忽视的需求,并决定举办一次关于意外临床试验中断的在线临床试验联合会。转向网络的一个主要问题是不要陷入单向的网络研讨会,而是要让以前互不认识的统计学家和其他科学家在没有面对面会面的情况下一起工作。我很高兴地宣布,这次IOF的四篇论文将发表在《生物制药研究中的统计学》杂志上。NISS对IOF在计划外临床试验中断方面的表现感到非常高兴,因为它具有热情的合作精神和生产力,能够很好地实现其S3目标,尽管面对面和混合发射将再次成为可能,但这种IOF现在是NISS的模式。
{"title":"The NISS Ingram Olkin Forum on Unplanned Clinical Trial Disruptions","authors":"N. Flournoy","doi":"10.1080/19466315.2022.2152090","DOIUrl":"https://doi.org/10.1080/19466315.2022.2152090","url":null,"abstract":"CONTACT Nancy Flournoy flournoyn@missouri.edu Department of Statistics, University of Missouri (emerita), Columbia. The efforts arose from working groups formed during a NISS Ingram Olkin Forum series on the following topics: (1)Estimands and Missing Data, (2) The Role of Randomization Tests, (3) Methods to Cope with Information Loss and the Use of Auxiliary Sources of Data and (4) Bayes and Frequentist Approaches to Rescuing Disrupted Trials. These groups consider how existing methods can be applied in the context of unplanned clinical trial disruptions and uncover unsolved issues requiring further research. In addition to introducing you to these research projects, I am pleased to provide a brief introduction to the NISS Ingram Olkin Forums. The National Institute of Statistical Sciences (NISS) created Ingram Olkin Forums (IOFs) to foster Statistics Serving Society (S3) in memory of Professor Ingram Olkin. Motivated by the aspirations set forth by Olkin et al. (1990), each forum focuses on a current societal issue that might benefit from new or renewed attention from the statistical community. IOFs aim to bring the latest innovations in statistical methodology and data science into new research and public policy collaborations, working to accelerate the development of innovative approaches that impact societal problems. As a Forum brings a particular group of experts together for the first time to consider an issue, new energy and synergy is expected to produce a flurry of new ideas and approaches. The inaugural IOF was held in June 1919 on Gun Violence, prior to the arrival of the Covid-19 pandemic. Knowing that many statisticians would use their expertise to monitor the pandemic and to design vaccine and therapeutic trials, the IOF Committee looked for a need that might be neglected and decided to host an online IOF on Unplanned Clinical Trial Disruptions. A major concern in moving online was not to get stuck with one-directional webinars, but to get statisticians and other scientists who did not know each other previously to work together without meeting in-person. I am delighted to announce four papers resulting from this IOF will appear in Statistics in Biopharmaceutical Research. NISS is very happy with how well the IOF on Unplanned Clinical Trial Disruptions met its S3 objectives, with enthusiastic collegiality and productivity, and although in-person and hybrid launches will again be possible, this IOF is now NISS’s model.","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44043081","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions 受COVID-19大流行影响的临床试验的估计及其估计:NISS英格拉姆奥尔金论坛系列关于计划外临床试验中断的报告
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/19466315.2022.2094459
Kelly Van Lancker, S. Tarima, J. Bartlett, M. Bauer, Bharani Bharani-Dharan, F. Bretz, N. Flournoy, Hege Michiels, Camila Olarte Parra, J. L. Rosenberger, S. Cro
Abstract The COVID-19 pandemic continues to affect the conduct of clinical trials globally. Complications may arise from pandemic-related operational challenges such as site closures, travel limitations and interruptions to the supply chain for the investigational product, or from health-related challenges such as COVID-19 infections. Some of these complications lead to unforeseen intercurrent events in the sense that they affect either the interpretation or the existence of the measurements associated with the clinical question of interest. In this article, we demonstrate how the ICH E9(R1) Addendum on estimands and sensitivity analyses provides a rigorous basis to discuss potential pandemic-related trial disruptions and to embed these disruptions in the context of study objectives and design elements. We introduce several hypothetical estimand strategies and review various causal inference and missing data methods, as well as a statistical method that combines unbiased and possibly biased estimators for estimation. To illustrate, we describe the features of a stylized trial, and how it may have been impacted by the pandemic. This stylized trial will then be revisited by discussing the changes to the estimand and the estimator to account for pandemic disruptions. Finally, we outline considerations for designing future trials in the context of unforeseen disruptions.
摘要新冠肺炎大流行继续影响全球临床试验的进行。并发症可能源于与流行病相关的操作挑战,如研究产品的现场关闭、旅行限制和供应链中断,或与健康相关的挑战,如新冠肺炎感染。其中一些并发症会导致不可预见的并发事件,因为它们会影响与感兴趣的临床问题相关的测量的解释或存在。在这篇文章中,我们展示了ICH E9(R1)关于估计和敏感性分析的附录如何为讨论潜在的与大流行相关的试验中断提供了严格的基础,并将这些中断嵌入研究目标和设计元素的背景中。我们介绍了几种假设的估计策略,并回顾了各种因果推断和缺失数据方法,以及一种结合无偏和可能有偏估计量进行估计的统计方法。为了说明这一点,我们描述了程式化试验的特点,以及它可能如何受到疫情的影响。然后,将通过讨论估计需求和估计量的变化来重新审视这一程式化试验,以解释疫情的干扰。最后,我们概述了在不可预见的中断情况下设计未来试验的考虑因素。
{"title":"Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions","authors":"Kelly Van Lancker, S. Tarima, J. Bartlett, M. Bauer, Bharani Bharani-Dharan, F. Bretz, N. Flournoy, Hege Michiels, Camila Olarte Parra, J. L. Rosenberger, S. Cro","doi":"10.1080/19466315.2022.2094459","DOIUrl":"https://doi.org/10.1080/19466315.2022.2094459","url":null,"abstract":"Abstract The COVID-19 pandemic continues to affect the conduct of clinical trials globally. Complications may arise from pandemic-related operational challenges such as site closures, travel limitations and interruptions to the supply chain for the investigational product, or from health-related challenges such as COVID-19 infections. Some of these complications lead to unforeseen intercurrent events in the sense that they affect either the interpretation or the existence of the measurements associated with the clinical question of interest. In this article, we demonstrate how the ICH E9(R1) Addendum on estimands and sensitivity analyses provides a rigorous basis to discuss potential pandemic-related trial disruptions and to embed these disruptions in the context of study objectives and design elements. We introduce several hypothetical estimand strategies and review various causal inference and missing data methods, as well as a statistical method that combines unbiased and possibly biased estimators for estimation. To illustrate, we describe the features of a stylized trial, and how it may have been impacted by the pandemic. This stylized trial will then be revisited by discussing the changes to the estimand and the estimator to account for pandemic disruptions. Finally, we outline considerations for designing future trials in the context of unforeseen disruptions.","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43711539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Good Data Science Practice: Moving toward a Code of Practice for Drug Development (Rejoinder) 良好数据科学实践:迈向药物开发实践规范(复辩状)
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/19466315.2022.2128402
Mark Baillie, Conor Moloney, Carsten Philipp Mueller, Jonas Dorn, J. Branson, D. Ohlssen
Fang and He ask why we focus on exploratory (cite “[...] 26 times exploratory [...] only 3 times confirmatory [/.]”) over confirmatory activities and if as a consequence our data science definition is limited in scope. They also ask if the definition of data science should be more specific, with a focus on treatment effectiveness: “exploratory activities are insufficient for the purpose of establishing the existence and estimating the magnitude of treatment effects, which is confirmatory in nature.”
方和何问,为什么我们把重点放在探索性活动上(引用“[…]26次探索性[…]只有3次验证性[/.]”),而不是验证性活动,因此,我们的数据科学定义范围是否有限。他们还询问,数据科学的定义是否应该更具体,重点关注治疗效果:“探索性活动不足以确定治疗效果的存在性和估计治疗效果的大小,这在本质上是证实性的。”
{"title":"Good Data Science Practice: Moving toward a Code of Practice for Drug Development (Rejoinder)","authors":"Mark Baillie, Conor Moloney, Carsten Philipp Mueller, Jonas Dorn, J. Branson, D. Ohlssen","doi":"10.1080/19466315.2022.2128402","DOIUrl":"https://doi.org/10.1080/19466315.2022.2128402","url":null,"abstract":"Fang and He ask why we focus on exploratory (cite “[...] 26 times exploratory [...] only 3 times confirmatory [/.]”) over confirmatory activities and if as a consequence our data science definition is limited in scope. They also ask if the definition of data science should be more specific, with a focus on treatment effectiveness: “exploratory activities are insufficient for the purpose of establishing the existence and estimating the magnitude of treatment effects, which is confirmatory in nature.”","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42842820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comment on “Estimands and Their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions” 对“受COVID-19大流行影响的临床试验的估计及其估计量:NISS英格拉姆奥尔金论坛系列关于计划外临床试验中断的报告”的评论
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/19466315.2022.2151507
M. Akacha, Tianmeng Lyu
We
我们
{"title":"Comment on “Estimands and Their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions”","authors":"M. Akacha, Tianmeng Lyu","doi":"10.1080/19466315.2022.2151507","DOIUrl":"https://doi.org/10.1080/19466315.2022.2151507","url":null,"abstract":"We","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43052969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Editor’s Note: Special Section on a Collection of Articles on Opportunities and Challenges in Utilizing Real-World Data for Clinical Trials and Medical Product Development 编者注:关于利用真实世界数据进行临床试验和医疗产品开发的机遇和挑战的文章集合的特别部分
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-02 DOI: 10.1080/19466315.2022.2162291
T. Hamasaki
There have been increasing discussions on how real-world data (RWD) and real-world evidence (RWE) can play a role in health care decisions, particularly in medical product regulation, where RWD are the data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources (e.g., observational studies, electronic health records, product, and disease registries, etc.), and RWE is the clinical evidence regarding the usage and potential benefits or risks of a medical product derived from analysis of RWD (Food and Drug Administration (FDA) 2017). Unitizing external data sources in the design and analysis of clinical trials or medical product development is not a new idea. In assessing clinical trial feasibility of a medical product, external data sources have often been used to find new hypotheses/findings, characterizing relevant patient populations and subpopulations, understanding unmet need, identifying important assumptions about the impact of potential eligibility criteria on trial feasibility. At the protocol development of the clinical trials, they have been used to estimate the expected effect size of the medical products, to calculate the sample size, and to support patient recruitment, and during the trial conduct, they might be used to change or modify the trial protocol or designs, or sometimes to stop the trial. At the end of the development of the medical product, in general, comprehensive integrated analysis of the efficacy and safety has been conducted, including other sources of information relevant to efficacy and safety of the product. Furthermore, in Japan, there is a very unique regulatory decision-making framework for evaluating off-label use of unapproved medical products, so called “Public KnowledgeBased Applications” (“Kochi Shinsei” in Japanese) (Ministry of Health and Welfare (MHLW) 1980). A sponsor is able to submit an application without conducting (additional) clinical trials, if efficacy and safety for a new indication of the medical product are recognized to be well known in the medical and pharmacological field through publications. This framework is a great practice of regulatory decision-making based on RWD/RWE. What is happening right now? What is different from current practice? Due to the latest advanced technologies, it is much easier to gather and store huge amounts of health-related data in “real time.” It is expected that RWD/RWE can be used into
关于真实世界数据(RWD)和真实世界证据(RWE)如何在医疗保健决策中发挥作用,特别是在医疗产品监管中,RWD是从各种来源(例如,观察性研究、电子健康记录、产品和疾病登记等)常规收集的与患者健康状况和/或医疗保健提供有关的数据,RWE是关于RWD分析得出的医疗产品的使用和潜在益处或风险的临床证据(美国食品药品监督管理局(FDA)2017)。在临床试验或医疗产品开发的设计和分析中统一外部数据源并不是一个新想法。在评估医疗产品的临床试验可行性时,经常使用外部数据源来寻找新的假设/发现,表征相关患者群体和亚群体,了解未满足的需求,确定关于潜在资格标准对试验可行性影响的重要假设。在临床试验的方案制定过程中,它们被用于估计医疗产品的预期效果大小,计算样本量,并支持患者招募,在试验进行过程中,可能被用于更改或修改试验方案或设计,有时甚至停止试验。在医疗产品开发结束时,通常会对疗效和安全性进行全面的综合分析,包括与产品疗效和安全相关的其他信息来源。此外,在日本,有一个非常独特的监管决策框架来评估未经批准的医疗产品的标签外使用,即所谓的“基于公共知识的应用”(日语为“Kochi Shinsei”)(卫生福利部(MHLW)1980)。如果通过出版物确认医疗产品新适应症的疗效和安全性在医学和药理学领域众所周知,赞助商可以在不进行(额外)临床试验的情况下提交申请。该框架是基于RWD/RWE的监管决策的一个伟大实践。现在发生了什么?与目前的做法有什么不同?由于最新的先进技术,可以更容易地“实时”收集和存储大量与健康相关的数据。预计RWD/RWE可以用于
{"title":"Editor’s Note: Special Section on a Collection of Articles on Opportunities and Challenges in Utilizing Real-World Data for Clinical Trials and Medical Product Development","authors":"T. Hamasaki","doi":"10.1080/19466315.2022.2162291","DOIUrl":"https://doi.org/10.1080/19466315.2022.2162291","url":null,"abstract":"There have been increasing discussions on how real-world data (RWD) and real-world evidence (RWE) can play a role in health care decisions, particularly in medical product regulation, where RWD are the data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources (e.g., observational studies, electronic health records, product, and disease registries, etc.), and RWE is the clinical evidence regarding the usage and potential benefits or risks of a medical product derived from analysis of RWD (Food and Drug Administration (FDA) 2017). Unitizing external data sources in the design and analysis of clinical trials or medical product development is not a new idea. In assessing clinical trial feasibility of a medical product, external data sources have often been used to find new hypotheses/findings, characterizing relevant patient populations and subpopulations, understanding unmet need, identifying important assumptions about the impact of potential eligibility criteria on trial feasibility. At the protocol development of the clinical trials, they have been used to estimate the expected effect size of the medical products, to calculate the sample size, and to support patient recruitment, and during the trial conduct, they might be used to change or modify the trial protocol or designs, or sometimes to stop the trial. At the end of the development of the medical product, in general, comprehensive integrated analysis of the efficacy and safety has been conducted, including other sources of information relevant to efficacy and safety of the product. Furthermore, in Japan, there is a very unique regulatory decision-making framework for evaluating off-label use of unapproved medical products, so called “Public KnowledgeBased Applications” (“Kochi Shinsei” in Japanese) (Ministry of Health and Welfare (MHLW) 1980). A sponsor is able to submit an application without conducting (additional) clinical trials, if efficacy and safety for a new indication of the medical product are recognized to be well known in the medical and pharmacological field through publications. This framework is a great practice of regulatory decision-making based on RWD/RWE. What is happening right now? What is different from current practice? Due to the latest advanced technologies, it is much easier to gather and store huge amounts of health-related data in “real time.” It is expected that RWD/RWE can be used into","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41767006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparative Effectiveness Research using Bayesian Adaptive Designs for Rare Diseases: Response Adaptive Randomization Reusing Participants. 利用贝叶斯自适应设计进行罕见病比较效益研究:响应自适应随机化重复使用参与者。
IF 1.8 4区 医学 Q2 Mathematics Pub Date : 2023-01-01 Epub Date: 2021-08-31 DOI: 10.1080/19466315.2021.1961854
Fengming Tang, Byron J Gajewski

Slow accrual rate is a major challenge in clinical trials for rare diseases and is identified as the most frequent reason for clinical trials to fail. This challenge is amplified in comparative effectiveness research where multiple treatments are compared to identify the best treatment. Novel efficient clinical trial designs are in urgent need in these areas. Our proposed response adaptive randomization (RAR) reusing participants trial design mimics the real-world clinical practice that allows patients to switch treatments when desired outcome is not achieved. The proposed design increases efficiency by two strategies: 1) Allowing participants to switch treatments so that each participant can have more than one observation and hence it is possible to control for participant specific variability to increase statistical power; and 2) Utilizing RAR to allocate more participants to the promising arms such that ethical and efficient studies will be achieved. Extensive simulations were conducted and showed that, compared with trials where each participant receives one treatment, the proposed participants reusing RAR design can achieve comparable power with a smaller sample size and a shorter trial duration, especially when the accrual rate is low. The efficiency gain decreases as the accrual rate increases.

累积率低是罕见病临床试验的一大挑战,也是临床试验失败的最常见原因。在比较有效性研究中,这一挑战更为严峻,因为在这种研究中,需要对多种治疗方法进行比较,以确定最佳治疗方法。这些领域迫切需要新的高效临床试验设计。我们提出的反应自适应随机化(RAR)重复使用参与者试验设计模拟了现实世界中的临床实践,允许患者在未达到预期结果时更换治疗方法。拟议的设计通过两种策略提高效率:1)允许参与者转换治疗方法,这样每个参与者可以有不止一次的观察机会,从而有可能控制参与者的特定变异性,提高统计功率;以及 2)利用 RAR 将更多参与者分配到有希望的臂中,从而实现道德和高效的研究。我们进行了大量的模拟试验,结果表明,与每个参与者接受一种治疗的试验相比,拟议的参与者重复使用 RAR 设计能以较小的样本量和较短的试验持续时间达到相当的功率,尤其是在应计率较低的情况下。效率增益随着应计率的增加而降低。
{"title":"Comparative Effectiveness Research using Bayesian Adaptive Designs for Rare Diseases: Response Adaptive Randomization Reusing Participants.","authors":"Fengming Tang, Byron J Gajewski","doi":"10.1080/19466315.2021.1961854","DOIUrl":"10.1080/19466315.2021.1961854","url":null,"abstract":"<p><p>Slow accrual rate is a major challenge in clinical trials for rare diseases and is identified as the most frequent reason for clinical trials to fail. This challenge is amplified in comparative effectiveness research where multiple treatments are compared to identify the best treatment. Novel efficient clinical trial designs are in urgent need in these areas. Our proposed response adaptive randomization (RAR) reusing participants trial design mimics the real-world clinical practice that allows patients to switch treatments when desired outcome is not achieved. The proposed design increases efficiency by two strategies: 1) Allowing participants to switch treatments so that each participant can have more than one observation and hence it is possible to control for participant specific variability to increase statistical power; and 2) Utilizing RAR to allocate more participants to the promising arms such that ethical and efficient studies will be achieved. Extensive simulations were conducted and showed that, compared with trials where each participant receives one treatment, the proposed participants reusing RAR design can achieve comparable power with a smaller sample size and a shorter trial duration, especially when the accrual rate is low. The efficiency gain decreases as the accrual rate increases.</p>","PeriodicalId":51280,"journal":{"name":"Statistics in Biopharmaceutical Research","volume":null,"pages":null},"PeriodicalIF":1.8,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9979780/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10845588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Statistics in Biopharmaceutical Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1