Pub Date : 2024-11-01Epub Date: 2024-08-21DOI: 10.1007/s43441-024-00689-4
Karl Köchert, Tim Friede, Michael Kunz, Herbert Pang, Yijie Zhou, Elena Rantou
Whereas AI/ML methods were considered experimental tools in clinical development for some time, nowadays they are widely available. However, stakeholders in the health care industry still need to answer the question which role these methods can realistically play and what standards should be adhered to. Clinical research in late-stage clinical development has particular requirements in terms of robustness, transparency and traceability. These standards should also be adhered to when applying AI/ML methods. Currently there is some formal regulatory guidance available, but this is more directed at settings where a device or medical software is investigated. Here we focus on the application of AI/ML methods in late-stage clinical drug development, i.e. in a setting where currently less guidance is available. This is done via first summarizing available regulatory guidance and work done by regulatory statisticians followed by the presentation of an industry application where the influence of extensive sets of baseline characteristics on the treatment effect can be investigated by applying ML-methods in a standardized manner with intuitive graphical displays leveraging explainable AI methods. The paper aims at stimulating discussions on the role such analyses can play in general rather than advocating for a particular AI/ML-method or indication where such methods could be meaningful.
人工智能/ML 方法在一段时间内被认为是临床开发中的实验工具,而如今它们已被广泛使用。然而,医疗保健行业的利益相关者仍需要回答这些方法究竟能发挥什么作用,以及应遵守哪些标准。后期临床开发阶段的临床研究在稳健性、透明度和可追溯性方面有特殊要求。在应用人工智能/ML 方法时也应遵守这些标准。目前有一些正式的监管指南,但更多是针对设备或医疗软件的研究环境。在此,我们将重点关注人工智能/ML 方法在临床药物开发后期的应用,即在目前指导较少的情况下的应用。为此,我们首先总结了现有的监管指南和监管统计人员所做的工作,然后介绍了一个行业应用案例,在该案例中,可以通过标准化的方式应用 ML 方法,并利用可解释的人工智能方法进行直观的图形显示,从而研究大量基线特征集对治疗效果的影响。本文旨在激发对此类分析所能发挥的一般作用的讨论,而不是提倡使用某种特定的人工智能/ML 方法或此类方法可能有意义的适应症。
{"title":"On the Application of Artificial Intelligence/Machine Learning (AI/ML) in Late-Stage Clinical Development.","authors":"Karl Köchert, Tim Friede, Michael Kunz, Herbert Pang, Yijie Zhou, Elena Rantou","doi":"10.1007/s43441-024-00689-4","DOIUrl":"10.1007/s43441-024-00689-4","url":null,"abstract":"<p><p>Whereas AI/ML methods were considered experimental tools in clinical development for some time, nowadays they are widely available. However, stakeholders in the health care industry still need to answer the question which role these methods can realistically play and what standards should be adhered to. Clinical research in late-stage clinical development has particular requirements in terms of robustness, transparency and traceability. These standards should also be adhered to when applying AI/ML methods. Currently there is some formal regulatory guidance available, but this is more directed at settings where a device or medical software is investigated. Here we focus on the application of AI/ML methods in late-stage clinical drug development, i.e. in a setting where currently less guidance is available. This is done via first summarizing available regulatory guidance and work done by regulatory statisticians followed by the presentation of an industry application where the influence of extensive sets of baseline characteristics on the treatment effect can be investigated by applying ML-methods in a standardized manner with intuitive graphical displays leveraging explainable AI methods. The paper aims at stimulating discussions on the role such analyses can play in general rather than advocating for a particular AI/ML-method or indication where such methods could be meaningful.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1080-1093"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142018703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01Epub Date: 2024-08-08DOI: 10.1007/s43441-024-00679-6
Guannan Sun, Xin Sun, Huijuan Su, Yuqin Liao, Di Wei, Hanqing Ma, Xinyu Li, Ran Fan, Xiaowei Ren
In multi-regional clinical trials, planning the sample size for participating regions is essential for the evaluation of the treatment effect consistency across regions. Based on the MRCT design and sample size allocation to regions, consistency probability is usually used to predict the consistent trend between regions and the overall population, while preserving a certain proportion of the overall treatment effect. Specific enrollment characteristics in a region of interest should also be considered during the time of the sample size planning. To facilitate efficient and harmonized regional sample size planning, we have developed RegionSizeR, a comprehensive and user-friendly interactive web-based R shiny application that can be obtained from https://github.com/rsr-ss/RegionSizeR . This simulation-based app can serve as an initial point for discussions on sample size allocation plans, following preservation of treatment effect method in ICH E17. The app accommodates various types of endpoints and designs, including continuous, binary, and time-to-event endpoints, for superiority, non-inferiority, and MCP-Mod designs. To ensure the validity of this app, independent testing is conducted allowing a discrepancy of no more than 1% across all results considering various scenarios.
在多地区临床试验中,规划参与地区的样本量对于评价各地区治疗效果的一致性至关重要。根据 MRCT 的设计和各地区样本量的分配,一致性概率通常用于预测各地区与总体之间的一致性趋势,同时保留一定比例的总体治疗效果。在规划样本量时,还应考虑相关地区的具体入组特征。为了促进高效、统一的地区样本量规划,我们开发了 RegionSizeR,这是一个全面、用户友好的交互式网络 R 闪应用程序,可从 https://github.com/rsr-ss/RegionSizeR 上获取。这一基于模拟的应用程序可作为讨论样本量分配计划的初始点,并遵循 ICH E17 中的治疗效果保留方法。该应用程序适用于各种类型的终点和设计,包括连续终点、二元终点和时间到事件终点,适用于优效、非劣效和 MCP-Mod 设计。为确保该应用程序的有效性,我们进行了独立测试,在考虑各种情况的所有结果中,允许差异不超过 1%。
{"title":"RegionSizeR- A Novel App for Regional Sample Size Planning in MRCTs.","authors":"Guannan Sun, Xin Sun, Huijuan Su, Yuqin Liao, Di Wei, Hanqing Ma, Xinyu Li, Ran Fan, Xiaowei Ren","doi":"10.1007/s43441-024-00679-6","DOIUrl":"10.1007/s43441-024-00679-6","url":null,"abstract":"<p><p>In multi-regional clinical trials, planning the sample size for participating regions is essential for the evaluation of the treatment effect consistency across regions. Based on the MRCT design and sample size allocation to regions, consistency probability is usually used to predict the consistent trend between regions and the overall population, while preserving a certain proportion of the overall treatment effect. Specific enrollment characteristics in a region of interest should also be considered during the time of the sample size planning. To facilitate efficient and harmonized regional sample size planning, we have developed RegionSizeR, a comprehensive and user-friendly interactive web-based R shiny application that can be obtained from https://github.com/rsr-ss/RegionSizeR . This simulation-based app can serve as an initial point for discussions on sample size allocation plans, following preservation of treatment effect method in ICH E17. The app accommodates various types of endpoints and designs, including continuous, binary, and time-to-event endpoints, for superiority, non-inferiority, and MCP-Mod designs. To ensure the validity of this app, independent testing is conducted allowing a discrepancy of no more than 1% across all results considering various scenarios.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1071-1079"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11530476/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141907717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01Epub Date: 2024-08-17DOI: 10.1007/s43441-024-00685-8
Sharon Jiang, David Lebo, Thomas Schultz
The FDA published a final rule for Medical Devices; Laboratory Developed Tests in the Federal Register on May 6, 2024, which aims to ensure the safety and effectiveness of laboratory developed tests (LDTs) by amending current regulations. The rule also includes a policy to phase out the FDA's general enforcement discretion approach for LDTs, aligning them with other In Vitro Diagnostic Devices. Notably, direct-to-consumer (DTC) testing is exempt from this policy shift, as the FDA believes this category of tests has already met applicable requirements. This rule was first proposed in the Federal Register on October 3, 2023. The publication of this proposed rule sparked a considerable volume of public reactions during the comment period of the rule-making process, comprising general sentiment, key concerns, and suggestions. This commentary analyzes these concerns, particularly focusing on DTC tests, and offers recommendations, including reassessing the FDA's enforcement discretion for hybrid DTC tests, advocating for clear guidance on clinical oversight, and prioritizing a risk-based enforcement approach. Additionally, enhancing public education about the risks of DTC testing is crucial for safeguarding public health.
{"title":"Public Perspectives on Direct-to-Consumer Testing Oversight.","authors":"Sharon Jiang, David Lebo, Thomas Schultz","doi":"10.1007/s43441-024-00685-8","DOIUrl":"10.1007/s43441-024-00685-8","url":null,"abstract":"<p><p>The FDA published a final rule for Medical Devices; Laboratory Developed Tests in the Federal Register on May 6, 2024, which aims to ensure the safety and effectiveness of laboratory developed tests (LDTs) by amending current regulations. The rule also includes a policy to phase out the FDA's general enforcement discretion approach for LDTs, aligning them with other In Vitro Diagnostic Devices. Notably, direct-to-consumer (DTC) testing is exempt from this policy shift, as the FDA believes this category of tests has already met applicable requirements. This rule was first proposed in the Federal Register on October 3, 2023. The publication of this proposed rule sparked a considerable volume of public reactions during the comment period of the rule-making process, comprising general sentiment, key concerns, and suggestions. This commentary analyzes these concerns, particularly focusing on DTC tests, and offers recommendations, including reassessing the FDA's enforcement discretion for hybrid DTC tests, advocating for clear guidance on clinical oversight, and prioritizing a risk-based enforcement approach. Additionally, enhancing public education about the risks of DTC testing is crucial for safeguarding public health.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1027-1030"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141996548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01Epub Date: 2024-07-24DOI: 10.1007/s43441-024-00678-7
Hiroaki Mamiya, Ken-Ichi Izutsu, Daichi Mitani
The increasing global drug shortage poses a substantial challenge to national healthcare systems and affects access to essential therapies. In Japan, this problem is exacerbated by a large-scale government campaign to switch from brand-name products to generic drugs and manufacturing/marketing authorization holders with poor development and manufacturing controls. Regulatory bodies, such as the U.S. Food and Drug Administration and the European Medicines Agency have developed guidelines aimed at ensuring continuous drug supply and mitigating manufacturing risks. However, Japan's efforts have primarily relied on voluntary industry guidelines, lacking the robust regulatory frameworks of other developed nations. Therefore, this study proposes a draft guideline for Japan's pharmaceutical industry to manage drug shortages effectively. The Japanese government needs to establish a framework system that will enable pharmaceutical companies to effectively maintain a stable supply based on the proposals developed in this study.
{"title":"Draft Guideline for Industry to Manage Drug Shortages in Japan.","authors":"Hiroaki Mamiya, Ken-Ichi Izutsu, Daichi Mitani","doi":"10.1007/s43441-024-00678-7","DOIUrl":"10.1007/s43441-024-00678-7","url":null,"abstract":"<p><p>The increasing global drug shortage poses a substantial challenge to national healthcare systems and affects access to essential therapies. In Japan, this problem is exacerbated by a large-scale government campaign to switch from brand-name products to generic drugs and manufacturing/marketing authorization holders with poor development and manufacturing controls. Regulatory bodies, such as the U.S. Food and Drug Administration and the European Medicines Agency have developed guidelines aimed at ensuring continuous drug supply and mitigating manufacturing risks. However, Japan's efforts have primarily relied on voluntary industry guidelines, lacking the robust regulatory frameworks of other developed nations. Therefore, this study proposes a draft guideline for Japan's pharmaceutical industry to manage drug shortages effectively. The Japanese government needs to establish a framework system that will enable pharmaceutical companies to effectively maintain a stable supply based on the proposals developed in this study.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1023-1026"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01Epub Date: 2024-07-24DOI: 10.1007/s43441-024-00677-8
Francesca Mangia, Yameng Melly Lin, John Armando, Kareny Dominguez, Vera Rozhnova, Susanne Ausborn
Post-approval changes (PACs) to marketed products are routinely introduced to continuously enhance the product lifecycle management. However, bringing a chemistry, manufacturing and control (CMC) change through the global health authorities can be a complex and lengthy process taking up to several years, therefore negatively impacting supply continuity. In order to accelerate the review and approval of regulatory submissions and ensure continuous supply to patients, the World Health Organization (WHO) is strongly supporting the implementation of reliance among National Regulatory Authorities (NRAs). While some promising developments have been made with the use of reliance pathways for initial marketing authorizations, reliance is still not widely used for PACs. With the support of the European Medicines Agency (EMA) and WHO, Roche launched a reliance pilot based on EMA approval to file a supply critical variation for a monoclonal antibody. The variation constitutes major changes to the approved manufacturing process. Sameness of the product is ensured by submitting to all participants the same variation package as in the EU. The objectives of the pilot are to ensure continuous supply of this critical medicine by targeting global approval in 6.5 months, to promote regulatory convergence by waiving country specific requirements, and enhance greater transparency by sharing EMA Committee for Medicinal Products for Human Use (CHMP) final assessment report and Q&As to participating NRAs. Globally 48 NRAs have agreed to join the pilot. This article outlines the process of establishing the pilot project, including a planning phase and an engagement phase with the EMA, WHO and the participating NRAs.
{"title":"Unleashing the Power of Reliance for Post-Approval Changes: A Journey with 48 National Regulatory Authorities.","authors":"Francesca Mangia, Yameng Melly Lin, John Armando, Kareny Dominguez, Vera Rozhnova, Susanne Ausborn","doi":"10.1007/s43441-024-00677-8","DOIUrl":"10.1007/s43441-024-00677-8","url":null,"abstract":"<p><p>Post-approval changes (PACs) to marketed products are routinely introduced to continuously enhance the product lifecycle management. However, bringing a chemistry, manufacturing and control (CMC) change through the global health authorities can be a complex and lengthy process taking up to several years, therefore negatively impacting supply continuity. In order to accelerate the review and approval of regulatory submissions and ensure continuous supply to patients, the World Health Organization (WHO) is strongly supporting the implementation of reliance among National Regulatory Authorities (NRAs). While some promising developments have been made with the use of reliance pathways for initial marketing authorizations, reliance is still not widely used for PACs. With the support of the European Medicines Agency (EMA) and WHO, Roche launched a reliance pilot based on EMA approval to file a supply critical variation for a monoclonal antibody. The variation constitutes major changes to the approved manufacturing process. Sameness of the product is ensured by submitting to all participants the same variation package as in the EU. The objectives of the pilot are to ensure continuous supply of this critical medicine by targeting global approval in 6.5 months, to promote regulatory convergence by waiving country specific requirements, and enhance greater transparency by sharing EMA Committee for Medicinal Products for Human Use (CHMP) final assessment report and Q&As to participating NRAs. Globally 48 NRAs have agreed to join the pilot. This article outlines the process of establishing the pilot project, including a planning phase and an engagement phase with the EMA, WHO and the participating NRAs.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"997-1005"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11530517/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01Epub Date: 2024-07-25DOI: 10.1007/s43441-024-00680-z
Laura Elisabeth Gressler, Danica Marinac-Dabic, Frederic S Resnic, Stuart Williams, Kevin Yang, Frank Weichold, Erika Avila-Tang, Christina Mack, Paul Coplan, Orestis A Panagiotou, Gregory Pappas
<p><strong>Objectives: </strong>This manuscript presents a comprehensive framework for the assessment of the value of real-world evidence (RWE) in healthcare decision-making. While RWE has been proposed to overcome some limitations of traditional, one-off studies, no systematic framework exists to measure if RWE actually lowers the burden. This framework aims to fill that gap by providing conceptual approaches for evaluating the time and cost efficiencies of RWE, thus guiding strategic investments in RWE infrastructure.</p><p><strong>Methods: </strong>The framework consists of four components: (114th Congress. 21st Century Cures Act.; 2015. https://www.congress.gov/114/plaws/publ255/PLAW-114publ255.pdf .) identification of stakeholders using and producing RWE, (National Health Council. Glossary of Patient Engagement Terms. Published 2019. Accessed May 18. 2021. https://nationalhealthcouncil.org/glossary-of-patient-engagement-terms/ .) understanding value propositions on how RWE can benefit stakeholders, (Center for Drug Evaluation and Research. CDER Patient-Focused Drug Development. U.S. Food & Drug Administration.) defining key performance indicators (KPIs), and (U.S. Department of Health and Human Services - Food and Drug Administration: Center for Devices and Radiological Health and Center for Biologics Evaluation and Research. Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices - Guidance for Industry and Food and Drug Administration Staff. 2017. http://www.fda.gov/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guida .) establishing metrics and case studies to assess value. KPIs are categorized as 'better, faster, or cheaper" as an indicator of value: better focusing on high-quality actionable evidence; 'faster,' denoting time-saving in evidence generation, and 'cheaper,' emphasizing cost-efficiency decision compared to methodologies that do not involve data routinely collected in clinical practice. Metrics and relevant case studies are tailored based on stakeholder value propositions and selected KPIs that can be used to assess what value has been created by using RWE compared to traditional evidence-generation approaches and comparing different RWE sources.</p><p><strong>Results: </strong>Operationalized through metrics and case studies drawn from the literature, the value of RWE is documented as improving treatment effect heterogeneity evaluation, expanding medical product labels, and expediting post-market compliance. RWE is also shown to reduce the cost and time required to produce evidence compared to traditional one-off approaches. An original example of a metric that measures the time saved by RWE methods to detect a signal of a product failure was presented based on analysis of the National Cardiovascular Disease Registry.</p><p><strong>Conclusions: </strong>The framework presented in this manuscript offers a comprehensive approach for evaluating the value of RWE, applicable to all sta
{"title":"A Comprehensive Framework for Evaluating the Value Created by Real-World Evidence for Diverse Stakeholders: The Case for Coordinated Registry Networks.","authors":"Laura Elisabeth Gressler, Danica Marinac-Dabic, Frederic S Resnic, Stuart Williams, Kevin Yang, Frank Weichold, Erika Avila-Tang, Christina Mack, Paul Coplan, Orestis A Panagiotou, Gregory Pappas","doi":"10.1007/s43441-024-00680-z","DOIUrl":"10.1007/s43441-024-00680-z","url":null,"abstract":"<p><strong>Objectives: </strong>This manuscript presents a comprehensive framework for the assessment of the value of real-world evidence (RWE) in healthcare decision-making. While RWE has been proposed to overcome some limitations of traditional, one-off studies, no systematic framework exists to measure if RWE actually lowers the burden. This framework aims to fill that gap by providing conceptual approaches for evaluating the time and cost efficiencies of RWE, thus guiding strategic investments in RWE infrastructure.</p><p><strong>Methods: </strong>The framework consists of four components: (114th Congress. 21st Century Cures Act.; 2015. https://www.congress.gov/114/plaws/publ255/PLAW-114publ255.pdf .) identification of stakeholders using and producing RWE, (National Health Council. Glossary of Patient Engagement Terms. Published 2019. Accessed May 18. 2021. https://nationalhealthcouncil.org/glossary-of-patient-engagement-terms/ .) understanding value propositions on how RWE can benefit stakeholders, (Center for Drug Evaluation and Research. CDER Patient-Focused Drug Development. U.S. Food & Drug Administration.) defining key performance indicators (KPIs), and (U.S. Department of Health and Human Services - Food and Drug Administration: Center for Devices and Radiological Health and Center for Biologics Evaluation and Research. Use of Real-World Evidence to Support Regulatory Decision-Making for Medical Devices - Guidance for Industry and Food and Drug Administration Staff. 2017. http://www.fda.gov/BiologicsBloodVaccines/GuidanceComplianceRegulatoryInformation/Guida .) establishing metrics and case studies to assess value. KPIs are categorized as 'better, faster, or cheaper\" as an indicator of value: better focusing on high-quality actionable evidence; 'faster,' denoting time-saving in evidence generation, and 'cheaper,' emphasizing cost-efficiency decision compared to methodologies that do not involve data routinely collected in clinical practice. Metrics and relevant case studies are tailored based on stakeholder value propositions and selected KPIs that can be used to assess what value has been created by using RWE compared to traditional evidence-generation approaches and comparing different RWE sources.</p><p><strong>Results: </strong>Operationalized through metrics and case studies drawn from the literature, the value of RWE is documented as improving treatment effect heterogeneity evaluation, expanding medical product labels, and expediting post-market compliance. RWE is also shown to reduce the cost and time required to produce evidence compared to traditional one-off approaches. An original example of a metric that measures the time saved by RWE methods to detect a signal of a product failure was presented based on analysis of the National Cardiovascular Disease Registry.</p><p><strong>Conclusions: </strong>The framework presented in this manuscript offers a comprehensive approach for evaluating the value of RWE, applicable to all sta","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1042-1052"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141767426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: Clinical trials have become larger and more complex. Thus, eSource should be used to enhance efficiency. This study aimed to evaluate the impact of the multisite implementation of eSource direct data capture (DDC), which we define as eCRFs for direct data entry in this study, on efficiency by analyzing data from a single investigator-initiated clinical trial in oncology.
Methods: Operational data associated with the targeted study conducted in Japan was used to analyze time from data occurrence to data entry and data finalization, and number of visits to the site and time spent at the site by clinical research associates (CRAs). Additionally, simulations were performed on the change in hours at the clinical sites during the implementation of eSource DDC.
Results: No difference in time from data occurrence to data entry was observed between the DDC and the transcribed data fields. However, the DDC fields could be finalized 4 days earlier than the non-DDC fields. Additionally, although no difference was observed in the number of visits for source data verification (SDV) by CRAs, a comparison among sites that introduced eSource DDC and those that did not showed that the time spent at the site for SDV was reduced. Furthermore, the simulation results indicated that even a small amount of data to be collected or a small percentage of DDC-capable items may lead to greater efficiency when the number of subjects per site is significant.
Conclusions: The implementation of eSource DDC may enhance efficiency depending on the study framework and type and number of items to be collected.
{"title":"Efficiency of eSource Direct Data Capture in Investigator-Initiated Clinical Trials in Oncology.","authors":"Hiroko Yaegashi, Yukikazu Hayashi, Makoto Takeda, Shih-Wei Chiu, Haruhiko Nakayama, Hiroyuki Ito, Atsushi Takano, Masahiro Tsuboi, Koji Teramoto, Hiroyuki Suzuki, Tatsuya Kato, Hiroshi Yasui, Fumitaka Nagamura, Yataro Daigo, Takuhiro Yamaguchi","doi":"10.1007/s43441-024-00671-0","DOIUrl":"10.1007/s43441-024-00671-0","url":null,"abstract":"<p><strong>Background: </strong>Clinical trials have become larger and more complex. Thus, eSource should be used to enhance efficiency. This study aimed to evaluate the impact of the multisite implementation of eSource direct data capture (DDC), which we define as eCRFs for direct data entry in this study, on efficiency by analyzing data from a single investigator-initiated clinical trial in oncology.</p><p><strong>Methods: </strong>Operational data associated with the targeted study conducted in Japan was used to analyze time from data occurrence to data entry and data finalization, and number of visits to the site and time spent at the site by clinical research associates (CRAs). Additionally, simulations were performed on the change in hours at the clinical sites during the implementation of eSource DDC.</p><p><strong>Results: </strong>No difference in time from data occurrence to data entry was observed between the DDC and the transcribed data fields. However, the DDC fields could be finalized 4 days earlier than the non-DDC fields. Additionally, although no difference was observed in the number of visits for source data verification (SDV) by CRAs, a comparison among sites that introduced eSource DDC and those that did not showed that the time spent at the site for SDV was reduced. Furthermore, the simulation results indicated that even a small amount of data to be collected or a small percentage of DDC-capable items may lead to greater efficiency when the number of subjects per site is significant.</p><p><strong>Conclusions: </strong>The implementation of eSource DDC may enhance efficiency depending on the study framework and type and number of items to be collected.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1031-1041"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11530566/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141493520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01Epub Date: 2024-08-04DOI: 10.1007/s43441-024-00683-w
Fawzi Thomas, Onome T Abiri, Thomas A Conteh, Olufunsho Awodele
Background: Access to medical products of the required efficacy, quality and safety is essential for everyone's health and wellbeing. To achieve this milestone, every country needs a robust and strong performing National Regulatory Authority (NRA) that is independent and outcome oriented. With the help of the World Health Organization (WHO), the global benchmarking tool is the gold standard used to assess the regulatory capacity of NRAs.
Objectives: This study assessed the capacity of the National Medicines Regulatory Authority in Sierra Leone to perform its regulatory functions.
Methods: This descriptive cross-sectional study used both qualitative and quantitative approaches. A self-administered questionnaire was used for the quantitative approach, and the qualitative aspect consisted of a desk review looking at key regulatory documents such as laws, regulations, policies, guidelines, standard operating procedures and reports. The data collection tool used was the WHO global benchmarking tool (GBT) for "Evaluation of National Regulatory System of Medical Product Version VI.
Results: The majority of the participants had a postgraduate degree (60%), and 72% had over 10 years of experience working at the NRA. Out of 251 sub-indicators assessed, 85 (34%) sub-indicators were fully implemented. Of the eight (8) functions assessed, sub-indicators related to clinical trial oversight and vigilance were the most implemented, with 67% and 62%, respectively. Of the 9 indicators assessed, 79% of the sub-indicators that are related to quality and risk management were implemented. The results of this study showed that PBSL operates at maturity level 1. The absence of laws and regulations that give PBSL the mandate to perform its regulatory functions was a major challenge even though other indicators were met. The study reported other challenges toward effective functioning, including but not limited to a lack of sufficient staff, weak enforcement of the sale of medicines and a poorly equipped quality control laboratory.
{"title":"Capacity Assessment of the National Medicines Regulatory Authority in a Low -Income Country.","authors":"Fawzi Thomas, Onome T Abiri, Thomas A Conteh, Olufunsho Awodele","doi":"10.1007/s43441-024-00683-w","DOIUrl":"10.1007/s43441-024-00683-w","url":null,"abstract":"<p><strong>Background: </strong>Access to medical products of the required efficacy, quality and safety is essential for everyone's health and wellbeing. To achieve this milestone, every country needs a robust and strong performing National Regulatory Authority (NRA) that is independent and outcome oriented. With the help of the World Health Organization (WHO), the global benchmarking tool is the gold standard used to assess the regulatory capacity of NRAs.</p><p><strong>Objectives: </strong>This study assessed the capacity of the National Medicines Regulatory Authority in Sierra Leone to perform its regulatory functions.</p><p><strong>Methods: </strong>This descriptive cross-sectional study used both qualitative and quantitative approaches. A self-administered questionnaire was used for the quantitative approach, and the qualitative aspect consisted of a desk review looking at key regulatory documents such as laws, regulations, policies, guidelines, standard operating procedures and reports. The data collection tool used was the WHO global benchmarking tool (GBT) for \"Evaluation of National Regulatory System of Medical Product Version VI.</p><p><strong>Results: </strong>The majority of the participants had a postgraduate degree (60%), and 72% had over 10 years of experience working at the NRA. Out of 251 sub-indicators assessed, 85 (34%) sub-indicators were fully implemented. Of the eight (8) functions assessed, sub-indicators related to clinical trial oversight and vigilance were the most implemented, with 67% and 62%, respectively. Of the 9 indicators assessed, 79% of the sub-indicators that are related to quality and risk management were implemented. The results of this study showed that PBSL operates at maturity level 1. The absence of laws and regulations that give PBSL the mandate to perform its regulatory functions was a major challenge even though other indicators were met. The study reported other challenges toward effective functioning, including but not limited to a lack of sufficient staff, weak enforcement of the sale of medicines and a poorly equipped quality control laboratory.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1053-1060"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141890143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Post-approval changes (PACs) to the control and manufacturing processes of medicines and vaccines are routinely undertaken and critical to enable both innovation and secure sustained supply. In a world of global supply chains, the existence of divergent national PAC requirements (with additional countries introducing new requirements with potential differences) and other factors including document preparation and response timelines, can lead to long delays in approval (of up to 3-5 years) increasing the risk of disruption and shortages.We undertook an Industry survey in 2023 to assess implementation of ICH Q12, PAC procedures (change categorisation and review timelines) and use of reliance mechanisms across different countries (9 selected ICH Members and 19 Observers). Although this survey revealed limited implementation of Q12 in ICH Member countries, when comparing the data collected with those of a previous survey performed in 2020, we observed a broader adoption of risk-based approaches to variation categorisation (in all countries). This, however, was not reflected in improved timelines for approval.With regards to ICH Q12 adoption, the uptake of Post-Approval Change Management Protocols (PACMPs) was unchanged (with only one country reporting in-use) and implementation gaps were evident for Established Conditions (EC) and the Product Life Cycle Management document (PLCM). The survey found greater awareness of ICH Q12 and its tools compared to 2020, potentially illustrating the positive impact of training efforts. This illustrates the challenges being faced to broaden its implementation and use globally.In the same Industry survey, we also assessed PAC processes across different international countries. Long unpredictable timelines were the major concern across the countries surveyed together with limited capacity of the regulators. Four different CMC changes were selected and categorized by the respondents according to current knowledge of national classifications and timelines in the selected countries and compared with a reference classification and timeline from the European Medicines Agency and the World Health Organisation. This highlighted the lack of harmonisation of many countries with EU/WHO requirements, especially within the ICH Observer group.Last, this survey showed that some use of unilateral forms of reliance to Reference Authorities for PACs is starting. This is a mechanism all countries can employ, regardless of convergence of requirements and expertise, to enhance capacity building and reduce duplication of reviews, streamline variations approval, whilst accelerating patient access to innovation and securing supply.
对药品和疫苗的控制和生产流程进行批准后变更 (PAC) 是一项例行工作,对于实现创新和确保持续供应至关重要。我们在 2023 年开展了一项行业调查,以评估 ICH Q12、PAC 程序(变更分类和审查时限)的实施情况以及不同国家(9 个选定的 ICH 成员和 19 个观察员)对依赖机制的使用情况。虽然此次调查显示 ICH 成员国对 Q12 的实施有限,但将收集到的数据与 2020 年进行的上一次调查的数据进行比较时,我们发现(所有国家)更广泛地采用了基于风险的变更分类方法。关于 ICH Q12 的采用情况,批准后变更管理规程 (PACMP) 的采用率没有变化(只有一个国家报告正在使用),既定条件 (EC) 和产品生命周期管理文件 (PLCM) 的实施差距明显。调查发现,与 2020 年相比,人们对 ICH Q12 及其工具的认识有所提高,这可能说明了培训工作的积极影响。在同一项行业调查中,我们还评估了不同国家的 PAC 流程。在同一项行业调查中,我们还评估了不同国际国家的 PAC 流程。在接受调查的国家中,不可预测的冗长时间表以及监管机构的有限能力是主要问题。受访者根据目前对所选国家分类和时间表的了解,选择了四种不同的 CMC 更改并进行了分类,然后与欧洲药品管理局和世界卫生组织的参考分类和时间表进行了比较。最后,本次调查显示,一些国家开始采用单边形式依赖 PAC 参考机构。无论要求和专业知识是否趋同,所有国家都可以采用这种机制来加强能力建设,减少重复审查,简化变异审批,同时加快患者对创新药物的使用并确保供应。
{"title":"A Global Industry Survey on Post-Approval Change Management and Use of Reliance.","authors":"Andrew Deavin, Aliyah Hossain, Isabelle Colmagne-Poulard, Kum Cheun Wong, Mónica Perea-Vélez, Sonia Cappellini, Susanne Ausborn, Sylvie Meillerais, Céline Bourguignon","doi":"10.1007/s43441-024-00681-y","DOIUrl":"10.1007/s43441-024-00681-y","url":null,"abstract":"<p><p>Post-approval changes (PACs) to the control and manufacturing processes of medicines and vaccines are routinely undertaken and critical to enable both innovation and secure sustained supply. In a world of global supply chains, the existence of divergent national PAC requirements (with additional countries introducing new requirements with potential differences) and other factors including document preparation and response timelines, can lead to long delays in approval (of up to 3-5 years) increasing the risk of disruption and shortages.We undertook an Industry survey in 2023 to assess implementation of ICH Q12, PAC procedures (change categorisation and review timelines) and use of reliance mechanisms across different countries (9 selected ICH Members and 19 Observers). Although this survey revealed limited implementation of Q12 in ICH Member countries, when comparing the data collected with those of a previous survey performed in 2020, we observed a broader adoption of risk-based approaches to variation categorisation (in all countries). This, however, was not reflected in improved timelines for approval.With regards to ICH Q12 adoption, the uptake of Post-Approval Change Management Protocols (PACMPs) was unchanged (with only one country reporting in-use) and implementation gaps were evident for Established Conditions (EC) and the Product Life Cycle Management document (PLCM). The survey found greater awareness of ICH Q12 and its tools compared to 2020, potentially illustrating the positive impact of training efforts. This illustrates the challenges being faced to broaden its implementation and use globally.In the same Industry survey, we also assessed PAC processes across different international countries. Long unpredictable timelines were the major concern across the countries surveyed together with limited capacity of the regulators. Four different CMC changes were selected and categorized by the respondents according to current knowledge of national classifications and timelines in the selected countries and compared with a reference classification and timeline from the European Medicines Agency and the World Health Organisation. This highlighted the lack of harmonisation of many countries with EU/WHO requirements, especially within the ICH Observer group.Last, this survey showed that some use of unilateral forms of reliance to Reference Authorities for PACs is starting. This is a mechanism all countries can employ, regardless of convergence of requirements and expertise, to enhance capacity building and reduce duplication of reviews, streamline variations approval, whilst accelerating patient access to innovation and securing supply.</p>","PeriodicalId":23084,"journal":{"name":"Therapeutic innovation & regulatory science","volume":" ","pages":"1094-1107"},"PeriodicalIF":2.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142047248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}