首页 > 最新文献

Clinical Trials最新文献

英文 中文
Commentary on Toerper et al: A step in the right direction for learning health systems. 对Toerper等人的评论:朝着学习卫生系统的正确方向迈出了一步。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-12-29 DOI: 10.1177/17407745241302023
Mark J Pletcher
{"title":"Commentary on Toerper et al: A step in the right direction for learning health systems.","authors":"Mark J Pletcher","doi":"10.1177/17407745241302023","DOIUrl":"https://doi.org/10.1177/17407745241302023","url":null,"abstract":"","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":"22 2","pages":"152-154"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11992430/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143969136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
NHS-Galleri trial: Enriched enrolment approaches and sociodemographic characteristics of enrolled participants. NHS-Galleri试验:丰富的入组方法和入组参与者的社会人口学特征。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2025-01-25 DOI: 10.1177/17407745241302477
Charles Swanton, Velicia Bachtiar, Chris Mathews, Adam R Brentnall, Ian Lowenhoff, Jo Waller, Martine Bomb, Sean McPhail, Heather Pinches, Rebecca Smittenaar, Sara Hiom, Richard D Neal, Peter Sasieni

Background/aims: Certain sociodemographic groups are routinely underrepresented in clinical trials, limiting generalisability. Here, we describe the extent to which enriched enrolment approaches yielded a diverse trial population enriched for older age in a randomised controlled trial of a blood-based multi-cancer early detection test (NCT05611632).

Methods: Participants aged 50-77 years were recruited from eight Cancer Alliance regions in England. Most were identified and invited from centralised health service lists; a dynamic invitation algorithm was used to target those in older and more deprived groups. Others were invited by their general practice surgery (GP-based Participant Identification Centres in selected regions); towards the end of recruitment, specifically Asian and Black individuals were invited via this route, as part of a concerted effort to encourage enrolment among these individuals. Some participants self-referred, often following engagement activities involving community organisations. Enrolment took place in 11 mobile clinics at 151 locations that were generally more socioeconomically deprived and ethnically diverse than the England average. We reduced logistical barriers to trial participation by offering language interpretation and translation and disabled access measures. After enrolment, we examined (1) sociodemographic distribution of participants versus England and Cancer Alliance populations, and (2) number needed to invite (NNI; the number of invitations sent to enrol one participant) by age, sex, index of multiple deprivation (IMD) and ethnicity, and GP surgery-level bowel screening participation.

Results: Approximately 1.5 million individuals were invited and 142,924 enrolled (98% via centralised health service lists/invitation algorithm) in 10.5 months. The enrolled population was older and more deprived than the England population aged 50-77 years (73.3% vs 56.8% aged 60-77 years; 42.3% vs 35.3% in IMD groups 1-2). Ethnic diversity was lower in the trial than the England population (1.4% vs 2.8% Black; 3.3% vs 5.3% Asian). NNI was highest in Black (32.8), Asian (28.2) and most-deprived (21.5) groups, and lowest in mixed ethnicity (8.1) and least-deprived (4.6) groups.

Conclusions: Enrolment approaches used in the NHS-Galleri trial enabled recruitment of an older, socioeconomically diverse participant population relatively rapidly. Compared with the England and Cancer Alliance populations, the enrolled population was enriched for those in older age and more deprived groups. Better ethnicity data availability in central health service records could enable better invitation targeting to further enhance ethnically diverse recruitment. Future research should evaluate approaches used to facilitate recruitment from underrepresented groups in clinical trials.

背景/目的:某些社会人口统计学群体在临床试验中通常代表性不足,限制了普遍性。在这里,我们描述了在一项基于血液的多种癌症早期检测试验(NCT05611632)的随机对照试验中,强化入组方法在多大程度上产生了丰富的老年试验人群。方法:从英国八个癌症联盟地区招募年龄在50-77岁的参与者。大多数是从集中卫生服务名单中确定和邀请的;一种动态邀请算法被用于针对年龄较大和较贫困的群体。其他人则由他们的全科医生(选定地区的全科医生参与者身份识别中心)邀请;在招募结束时,特别通过这一途径邀请了亚洲人和黑人,作为鼓励这些人入学的共同努力的一部分。一些参与者往往是在参与社区组织的参与活动后自我介绍的。登记在151个地点的11个流动诊所进行,这些地点通常比英格兰平均水平更缺乏社会经济和种族多样性。我们通过提供语言口译和翻译以及残疾人无障碍措施,减少了参与试验的后勤障碍。入组后,我们检查了(1)参与者与英格兰和癌症联盟人群的社会人口分布,(2)需要邀请的人数(NNI;根据年龄、性别、多重剥夺指数(IMD)和种族,以及全科医生手术水平的肠道筛查参与程度,发送邀请的数量。结果:在10.5个月内,约有150万人被邀请,142,924人注册(98%通过集中卫生服务列表/邀请算法)。入组人群比50-77岁的英格兰人口年龄更大、更贫困(73.3% vs 60-77岁的56.8%;在IMD 1-2组中为42.3% vs 35.3%)。该试验的种族多样性低于英格兰人口(1.4% vs 2.8%黑人;3.3% vs 5.3%亚洲)。NNI在黑人(32.8)、亚洲(28.2)和最贫困(21.5)群体中最高,在混合种族(8.1)和最贫困(4.6)群体中最低。结论:在NHS-Galleri试验中使用的招募方法能够相对快速地招募年龄较大、社会经济背景不同的参与者。与英格兰和癌症联盟的人群相比,入组人群中年龄较大和更贫困的人群更丰富。在中央卫生服务记录中更好地提供族裔数据,可以更好地确定邀请目标,进一步加强族裔多样化的招聘。未来的研究应评估用于促进从临床试验中代表性不足的群体中招募的方法。
{"title":"NHS-Galleri trial: Enriched enrolment approaches and sociodemographic characteristics of enrolled participants.","authors":"Charles Swanton, Velicia Bachtiar, Chris Mathews, Adam R Brentnall, Ian Lowenhoff, Jo Waller, Martine Bomb, Sean McPhail, Heather Pinches, Rebecca Smittenaar, Sara Hiom, Richard D Neal, Peter Sasieni","doi":"10.1177/17407745241302477","DOIUrl":"10.1177/17407745241302477","url":null,"abstract":"<p><strong>Background/aims: </strong>Certain sociodemographic groups are routinely underrepresented in clinical trials, limiting generalisability. Here, we describe the extent to which enriched enrolment approaches yielded a diverse trial population enriched for older age in a randomised controlled trial of a blood-based multi-cancer early detection test (NCT05611632).</p><p><strong>Methods: </strong>Participants aged 50-77 years were recruited from eight Cancer Alliance regions in England. Most were identified and invited from centralised health service lists; a dynamic invitation algorithm was used to target those in older and more deprived groups. Others were invited by their general practice surgery (GP-based Participant Identification Centres in selected regions); towards the end of recruitment, specifically Asian and Black individuals were invited via this route, as part of a concerted effort to encourage enrolment among these individuals. Some participants self-referred, often following engagement activities involving community organisations. Enrolment took place in 11 mobile clinics at 151 locations that were generally more socioeconomically deprived and ethnically diverse than the England average. We reduced logistical barriers to trial participation by offering language interpretation and translation and disabled access measures. After enrolment, we examined (1) sociodemographic distribution of participants versus England and Cancer Alliance populations, and (2) number needed to invite (NNI; the number of invitations sent to enrol one participant) by age, sex, index of multiple deprivation (IMD) and ethnicity, and GP surgery-level bowel screening participation.</p><p><strong>Results: </strong>Approximately 1.5 million individuals were invited and 142,924 enrolled (98% via centralised health service lists/invitation algorithm) in 10.5 months. The enrolled population was older and more deprived than the England population aged 50-77 years (73.3% vs 56.8% aged 60-77 years; 42.3% vs 35.3% in IMD groups 1-2). Ethnic diversity was lower in the trial than the England population (1.4% vs 2.8% Black; 3.3% vs 5.3% Asian). NNI was highest in Black (32.8), Asian (28.2) and most-deprived (21.5) groups, and lowest in mixed ethnicity (8.1) and least-deprived (4.6) groups.</p><p><strong>Conclusions: </strong>Enrolment approaches used in the NHS-Galleri trial enabled recruitment of an older, socioeconomically diverse participant population relatively rapidly. Compared with the England and Cancer Alliance populations, the enrolled population was enriched for those in older age and more deprived groups. Better ethnicity data availability in central health service records could enable better invitation targeting to further enhance ethnically diverse recruitment. Future research should evaluate approaches used to facilitate recruitment from underrepresented groups in clinical trials.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"227-238"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11986080/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143036914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using non-inferiority test of proportions in design of randomized non-inferiority trials with time-to-event endpoint with a focus on low-event-rate setting. 在设计以时间为终点的随机非劣效性试验时使用比例非劣效性检验,重点关注低事件率环境。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-10-12 DOI: 10.1177/17407745241284786
Lingyun Ji, Todd A Alonzo

Background/aimsFor cancers with low incidence, low event rates, and a time-to-event endpoint, a randomized non-inferiority trial designed based on the logrank test can require a large sample size with significantly prolonged enrollment duration, making such a non-inferiority trial not feasible. This article evaluates a design based on a non-inferiority test of proportions, compares its required sample size to the non-inferiority logrank test, assesses whether there are scenarios for which a non-inferiority test of proportions can be more efficient, and provides guidelines in usage of a non-inferiority test of proportions.MethodsThis article describes the sample size calculation for a randomized non-inferiority trial based on a non-inferiority logrank test or a non-inferiority test of proportions. The sample size required by the two design methods are compared for a wide range of scenarios, varying the underlying Weibull survival functions, the non-inferiority margin, and loss to follow-up rate.ResultsOur results showed that there are scenarios for which the non-inferiority test of proportions can have significantly reduced sample size. Specifically, the non-inferiority test of proportions can be considered for cancers with more than 80% long-term survival rate. We provide guidance in choice of this design approach based on parameters of the Weibull survival functions, the non-inferiority margin, and loss to follow-up rate.ConclusionFor cancers with low incidence and low event rates, a non-inferiority trial based on the logrank test is not feasible due to its large required sample size and prolonged enrollment duration. The use of a non-inferiority test of proportions can make a randomized non-inferiority Phase III trial feasible.

背景/目的:对于发病率低、事件发生率低且以时间为终点的癌症,基于logrank检验设计的随机非劣效性试验可能需要较大的样本量,且入组时间明显延长,因此这种非劣效性试验并不可行。本文评估了基于非劣效性比例检验的设计,比较了其与非劣效性 logrank 检验所需的样本量,评估了是否存在非劣效性比例检验更有效的情况,并提供了使用非劣效性比例检验的指南:本文介绍了基于非劣效 logrank 检验或非劣效比例检验的随机非劣效试验的样本量计算。文章比较了两种设计方法在不同情况下所需的样本量,包括基础 Weibull 生存函数、非劣效边际和随访损失率:结果:我们的研究结果表明,在某些情况下,比例非劣效性检验可以显著减少样本量。具体来说,对于长期生存率超过 80% 的癌症,可以考虑采用比例非劣效性检验。我们根据 Weibull 生存函数的参数、非劣效边际和随访损失率,为选择这种设计方法提供指导:结论:对于低发病率和低事件发生率的癌症,基于对数秩检验的非劣效性试验是不可行的,因为它所需的样本量大,入组时间长。使用比例非劣效性检验可以使随机非劣效性 III 期试验变得可行。
{"title":"Using non-inferiority test of proportions in design of randomized non-inferiority trials with time-to-event endpoint with a focus on low-event-rate setting.","authors":"Lingyun Ji, Todd A Alonzo","doi":"10.1177/17407745241284786","DOIUrl":"10.1177/17407745241284786","url":null,"abstract":"<p><p>Background/aimsFor cancers with low incidence, low event rates, and a time-to-event endpoint, a randomized non-inferiority trial designed based on the logrank test can require a large sample size with significantly prolonged enrollment duration, making such a non-inferiority trial not feasible. This article evaluates a design based on a non-inferiority test of proportions, compares its required sample size to the non-inferiority logrank test, assesses whether there are scenarios for which a non-inferiority test of proportions can be more efficient, and provides guidelines in usage of a non-inferiority test of proportions.MethodsThis article describes the sample size calculation for a randomized non-inferiority trial based on a non-inferiority logrank test or a non-inferiority test of proportions. The sample size required by the two design methods are compared for a wide range of scenarios, varying the underlying Weibull survival functions, the non-inferiority margin, and loss to follow-up rate.ResultsOur results showed that there are scenarios for which the non-inferiority test of proportions can have significantly reduced sample size. Specifically, the non-inferiority test of proportions can be considered for cancers with more than 80% long-term survival rate. We provide guidance in choice of this design approach based on parameters of the Weibull survival functions, the non-inferiority margin, and loss to follow-up rate.ConclusionFor cancers with low incidence and low event rates, a non-inferiority trial based on the logrank test is not feasible due to its large required sample size and prolonged enrollment duration. The use of a non-inferiority test of proportions can make a randomized non-inferiority Phase III trial feasible.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"131-141"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11991896/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142459904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimating treatment effects from a randomized controlled trial with mid-trial design changes. 从随机对照试验中评估试验设计改变的治疗效果。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-12-30 DOI: 10.1177/17407745241304120
Sudeshna Paul, Jaeun Choi, Mi-Kyung Song

BackgroundIn randomized controlled trials (RCTs), unplanned design modifications due to unexpected circumstances are seldom reported. Naively lumping data from pre- and post-design changes to estimate the size of the treatment effect, as planned in the original study, can introduce systematic bias and limit interpretability of the trial findings. There has been limited discussion on how to estimate the treatment effect when an RCT undergoes major design changes during the trial. Using our recently completed RCT, which underwent multiple design changes, as an example, we examined the statistical implications of design changes on the treatment effect estimates.MethodsOur example RCT aimed to test an advance care planning intervention targeting dementia patients and their surrogate decision-makers compared to usual care. The original trial underwent two major mid-trial design changes resulting in three smaller studies. The changes included altering the number of study arms and adding new recruitment sites, thus perturbing the initial statistical assumptions. We used a simulation study to mimic these design modifications in our RCT, generate independent patient-level data and evaluate naïve lumping of data, a two-stage fixed-effect and random-effect meta-analysis model to obtain an average effect size estimate from all studies. Standardized mean-difference and odds-ratio estimates at post-intervention were used as effect sizes for continuous and binary outcomes, respectively. The performance of the estimates from different methods were compared by studying their statistical properties (e.g. bias, mean squared error, and coverage probability of 95% confidence intervals).ResultsWhen between-design heterogeneity is negligible, the fixed- and random-effect meta-analysis models yielded accurate and precise effect-size estimates for both continuous and binary data. As between-design heterogeneity increased, the estimates from random meta-analysis methods indicated less bias and higher coverage probability compared to the naïve and fixed-effect methods, however the mean squared error was higher indicating greater uncertainty arising from a small number of studies. The between-study heterogeneity parameter was not precisely estimable due to fewer studies. With increasing sample sizes within each study, the effect-size estimates showed improved precision and statistical power.ConclusionsWhen a trial undergoes unplanned major design changes, the statistical approach to estimate the treatment effect needs to be determined carefully. Naïve lumping of data across designs is not appropriate even when the overall goal of the trial remains unchanged. Understanding the implications of the different aspects of design changes and accounting for them in the analysis of the data are essential for internal validity and reporting of the trial findings. Importantly, investigators must disclose the design changes clearly in their study reports.

在随机对照试验(RCTs)中,由于意外情况而导致的计划外设计修改很少被报道。按照原始研究的计划,天真地将设计前和设计后的数据集中起来,以估计治疗效果的大小,可能会引入系统偏倚,并限制试验结果的可解释性。当一项随机对照试验在试验期间发生重大设计变化时,关于如何评估治疗效果的讨论有限。以我们最近完成的RCT为例,它经历了多次设计更改,我们检查了设计更改对治疗效果估计的统计含义。方法一项示例RCT旨在测试针对痴呆患者及其替代决策者的预先护理计划干预与常规护理的比较。最初的试验经历了两次主要的试验中期设计变更,导致三个较小的研究。这些变化包括改变研究组的数量和增加新的招募地点,从而扰乱了最初的统计假设。我们在我们的RCT中使用模拟研究来模拟这些设计修改,生成独立的患者水平数据,并评估naïve数据集总,两阶段固定效应和随机效应荟萃分析模型,以获得所有研究的平均效应大小估计。干预后的标准化均差和优势比估计值分别用作连续和二元结果的效应量。通过研究不同方法的统计特性(例如偏差、均方误差和95%置信区间的覆盖概率),比较了不同方法估计的性能。当设计间异质性可以忽略不计时,固定效应和随机效应荟萃分析模型对连续和二元数据均产生了准确和精确的效应大小估计。随着设计间异质性的增加,随机荟萃分析方法的估计值与naïve和固定效应方法相比,偏倚更小,覆盖概率更高,但均方误差更高,表明研究数量少,不确定性更大。由于研究较少,研究间异质性参数不能精确估计。随着每项研究中样本量的增加,效应量估计显示出精度和统计能力的提高。结论当试验发生计划外的重大设计变化时,评估治疗效果的统计方法需要仔细确定。Naïve即使在试验的总体目标保持不变的情况下,跨设计的数据集中也是不合适的。了解设计变化的不同方面的影响,并在数据分析中考虑它们,对于试验结果的内部有效性和报告至关重要。重要的是,研究者必须在他们的研究报告中清楚地披露设计变更。
{"title":"Estimating treatment effects from a randomized controlled trial with mid-trial design changes.","authors":"Sudeshna Paul, Jaeun Choi, Mi-Kyung Song","doi":"10.1177/17407745241304120","DOIUrl":"https://doi.org/10.1177/17407745241304120","url":null,"abstract":"<p><p>BackgroundIn randomized controlled trials (RCTs), unplanned design modifications due to unexpected circumstances are seldom reported. Naively lumping data from pre- and post-design changes to estimate the size of the treatment effect, as planned in the original study, can introduce systematic bias and limit interpretability of the trial findings. There has been limited discussion on how to estimate the treatment effect when an RCT undergoes major design changes during the trial. Using our recently completed RCT, which underwent multiple design changes, as an example, we examined the statistical implications of design changes on the treatment effect estimates.MethodsOur example RCT aimed to test an advance care planning intervention targeting dementia patients and their surrogate decision-makers compared to usual care. The original trial underwent two major mid-trial design changes resulting in three smaller studies. The changes included altering the number of study arms and adding new recruitment sites, thus perturbing the initial statistical assumptions. We used a simulation study to mimic these design modifications in our RCT, generate independent patient-level data and evaluate naïve lumping of data, a two-stage fixed-effect and random-effect meta-analysis model to obtain an average effect size estimate from all studies. Standardized mean-difference and odds-ratio estimates at post-intervention were used as effect sizes for continuous and binary outcomes, respectively. The performance of the estimates from different methods were compared by studying their statistical properties (e.g. bias, mean squared error, and coverage probability of 95% confidence intervals).ResultsWhen between-design heterogeneity is negligible, the fixed- and random-effect meta-analysis models yielded accurate and precise effect-size estimates for both continuous and binary data. As between-design heterogeneity increased, the estimates from random meta-analysis methods indicated less bias and higher coverage probability compared to the naïve and fixed-effect methods, however the mean squared error was higher indicating greater uncertainty arising from a small number of studies. The between-study heterogeneity parameter was not precisely estimable due to fewer studies. With increasing sample sizes within each study, the effect-size estimates showed improved precision and statistical power.ConclusionsWhen a trial undergoes unplanned major design changes, the statistical approach to estimate the treatment effect needs to be determined carefully. Naïve lumping of data across designs is not appropriate even when the overall goal of the trial remains unchanged. Understanding the implications of the different aspects of design changes and accounting for them in the analysis of the data are essential for internal validity and reporting of the trial findings. Importantly, investigators must disclose the design changes clearly in their study reports.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":"22 2","pages":"209-219"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11996067/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143981263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Use of Epic® to facilitate high-quality randomization of emergency department-based pragmatic clinical trials. 使用Epic®促进急诊部实用临床试验的高质量随机化。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-12-29 DOI: 10.1177/17407745241301998
Matthew F Toerper, Jason Haukoos, Emily Hopkins, Sarah E Rowan, Michael S Lyons, James W Galbraith, Yu-Hsiang Hsieh, Douglas Ae White, Scott Levin, Jeremiah Hinson, Richard E Rothman
<p><strong>Background: </strong>Pragmatic clinical trials are critical to determine the real-world effectiveness of interventions. Emergency departments serve as key clinical sites for such trials because they provide care to large numbers of patients at the earliest point in their hospital encounter. However, few methods that facilitate efficient emergency department-based pragmatic trials have been described. Our objective was to design and embed randomization schemes directly into the electronic health record to facilitate enrollment of emergency department patients by clinical staff 24 h per day, while maintaining concealed and balanced allocation.</p><p><strong>Methods: </strong>We designed two multi-center pragmatic trials screening for human immunodeficiency virus (HIV TESTED trial) and hepatitis C virus (DETECT Hep C trial). HIV TESTED included four sites, three arms, and compared two forms of risk-assessed (targeted) to non-risk-assessed (nontargeted) screening for human immunodeficiency virus; DETECT Hep C included three sites, two arms, and compared targeted to nontargeted screening for hepatitis C virus. Participant entry occurred during a patient's emergency department visit in conjunction with standard emergency department care. Patient-visit level randomization schemes were designed in each electronic health record system using Epic<sup>®</sup> (Epic Systems, Verona, WI; two sites for HIV TESTED; all three sites for DETECT Hep C). Randomization and all forms of screening were fully embedded and integrated in the electronic health record and administered by nurses as part of routine care. Absolute differences and chi-square testing were used to evaluate randomness of study arms and to compare baseline characteristics. Time-motion methods were also used to assess the time of screening and randomization by nurses.</p><p><strong>Results: </strong>During 61 cumulative enrollment months, 365,462 patient visits occurred. After excluding 184,023 visits by designed electronic health record logic or manual nurse input due to age, previously known human immunodeficiency virus or hepatitis C virus, high acuity or altered mental status, 181,439 patient visits were randomized to one of the interventions. Absolute differences between targeted and nontargeted arms differed by 0.2% and 0.4% (HIV TESTED), and 0.1% (DETECT Hep C), and median absolute differences across all baseline characteristics (i.e. age, sex, race, ethnicity, language, payor, arrival mode, and acuity) between arms were 0.02% (range: -0.7% to +0.5%) and -0.07% (range: -0.3% to +0.7%), and -0.02% (range: -0.7% to +0.7%), respectively. Median time required for nurses to execute randomization ranged from 16 to 67 s, depending on the arm.</p><p><strong>Conclusion: </strong>Integration of blinded randomization schemes into electronic health record systems resulted in high-volume balanced enrollment of participants 24 h per day while maintaining concealed allocation. Use of this technol
背景:实用的临床试验对于确定干预措施的实际有效性至关重要。急诊科是此类试验的关键临床场所,因为他们在医院遇到的第一时间为大量患者提供护理。然而,很少有方法,促进有效的基于急诊科的实用试验已被描述。我们的目标是设计并将随机化方案直接嵌入电子健康记录中,以方便临床工作人员每天24小时登记急诊科患者,同时保持隐蔽和平衡的分配。方法:设计筛选人类免疫缺陷病毒(HIV - testing试验)和丙型肝炎病毒(DETECT Hep - C试验)两项多中心实用试验。艾滋病毒检测包括四个地点,三个分支,并比较了两种形式的风险评估(靶向)和非风险评估(非靶向)筛查人类免疫缺陷病毒;DETECT丙型肝炎包括三个位点,两个组,并比较了丙型肝炎病毒的靶向和非靶向筛查。参与者的进入发生在患者急诊就诊与标准急诊护理期间。每个电子健康记录系统采用Epic®(Epic Systems, Verona, WI;两个艾滋病毒检测地点;所有三个检测丙型肝炎的地点)。随机化和所有形式的筛查都完全嵌入和整合到电子健康记录中,并由护士作为常规护理的一部分进行管理。绝对差异和卡方检验用于评价研究组的随机性和比较基线特征。时间-运动法还用于评估护士筛查和随机化的时间。结果:在61个累计入组月期间,共有365,462例患者就诊。在排除了184,023例因年龄、已知的人类免疫缺陷病毒或丙型肝炎病毒、高灵敏度或精神状态改变而通过设计的电子健康记录逻辑或手动护士输入就诊的患者后,181,439例患者就诊被随机分配到其中一种干预措施中。靶向治疗组和非靶向治疗组之间的绝对差异分别为0.2%和0.4% (HIV检测)和0.1%(检测丙型肝炎),两组之间所有基线特征(即年龄、性别、种族、民族、语言、付款人、到达方式和视力)的绝对差异中位数分别为0.02%(范围:-0.7%至+0.5%)和-0.07%(范围:-0.3%至+0.7%)和-0.02%(范围:-0.7%至+0.7%)。护士执行随机化所需的中位时间从16到67秒不等,取决于手臂。结论:将盲法随机化方案整合到电子健康记录系统中,可以在保持隐蔽分配的同时,每天24小时大量均衡入组参与者。使用该技术是在急诊室环境中扩大高质量实用试验性能的重要工具,同时最大限度地减少偏见。
{"title":"Use of Epic<sup>®</sup> to facilitate high-quality randomization of emergency department-based pragmatic clinical trials.","authors":"Matthew F Toerper, Jason Haukoos, Emily Hopkins, Sarah E Rowan, Michael S Lyons, James W Galbraith, Yu-Hsiang Hsieh, Douglas Ae White, Scott Levin, Jeremiah Hinson, Richard E Rothman","doi":"10.1177/17407745241301998","DOIUrl":"https://doi.org/10.1177/17407745241301998","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Pragmatic clinical trials are critical to determine the real-world effectiveness of interventions. Emergency departments serve as key clinical sites for such trials because they provide care to large numbers of patients at the earliest point in their hospital encounter. However, few methods that facilitate efficient emergency department-based pragmatic trials have been described. Our objective was to design and embed randomization schemes directly into the electronic health record to facilitate enrollment of emergency department patients by clinical staff 24 h per day, while maintaining concealed and balanced allocation.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We designed two multi-center pragmatic trials screening for human immunodeficiency virus (HIV TESTED trial) and hepatitis C virus (DETECT Hep C trial). HIV TESTED included four sites, three arms, and compared two forms of risk-assessed (targeted) to non-risk-assessed (nontargeted) screening for human immunodeficiency virus; DETECT Hep C included three sites, two arms, and compared targeted to nontargeted screening for hepatitis C virus. Participant entry occurred during a patient's emergency department visit in conjunction with standard emergency department care. Patient-visit level randomization schemes were designed in each electronic health record system using Epic&lt;sup&gt;®&lt;/sup&gt; (Epic Systems, Verona, WI; two sites for HIV TESTED; all three sites for DETECT Hep C). Randomization and all forms of screening were fully embedded and integrated in the electronic health record and administered by nurses as part of routine care. Absolute differences and chi-square testing were used to evaluate randomness of study arms and to compare baseline characteristics. Time-motion methods were also used to assess the time of screening and randomization by nurses.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;During 61 cumulative enrollment months, 365,462 patient visits occurred. After excluding 184,023 visits by designed electronic health record logic or manual nurse input due to age, previously known human immunodeficiency virus or hepatitis C virus, high acuity or altered mental status, 181,439 patient visits were randomized to one of the interventions. Absolute differences between targeted and nontargeted arms differed by 0.2% and 0.4% (HIV TESTED), and 0.1% (DETECT Hep C), and median absolute differences across all baseline characteristics (i.e. age, sex, race, ethnicity, language, payor, arrival mode, and acuity) between arms were 0.02% (range: -0.7% to +0.5%) and -0.07% (range: -0.3% to +0.7%), and -0.02% (range: -0.7% to +0.7%), respectively. Median time required for nurses to execute randomization ranged from 16 to 67 s, depending on the arm.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusion: &lt;/strong&gt;Integration of blinded randomization schemes into electronic health record systems resulted in high-volume balanced enrollment of participants 24 h per day while maintaining concealed allocation. Use of this technol","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":"22 2","pages":"142-151"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11992431/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143983972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ethical considerations for sharing aggregate results from pragmatic clinical trials. 分享实用临床试验综合结果的伦理考虑。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-11-25 DOI: 10.1177/17407745241290782
Stephanie R Morain, Abigail Brickler, Joseph Ali, Patricia Pearl O'Rourke, Kayte Spector-Bagdady, Benjamin Wilfond, Vasiliki Rahimzadeh, Caleigh Propes, Kayla Mehl, David Wendler

A growing literature has explored the ethical obligations and current practices related to sharing aggregate results with research participants. However, no prior work has examined these issues in the context of pragmatic clinical trials. Several characteristics of pragmatic clinical trials may complicate both the ethics and the logistics of sharing aggregate results. Among these characteristics include that pragmatic clinical trials may affect the rights, welfare, and interests of not only patient-subjects but also clinicians, meaning that results may be owed to a broader range of groups than typically considered in other research contexts. In addition, some pragmatic clinical trials are conducted under a waiver of informed consent, meaning sharing results may alert participants that they were enrolled without their consent. This article explores the ethical dimensions that can inform decision-making about sharing aggregate results from pragmatic clinical trials, and provides recommendations for that sharing. A central insight is that healthcare institutions-as key partners for the conduct of pragmatic clinical trials-must also be key partners in decision-making about sharing aggregate pragmatic clinical trial results. We conclude with insights for future research.

越来越多的文献探讨了与研究参与者共享综合结果的相关伦理义务和现行做法。然而,此前还没有研究在实用临床试验的背景下探讨过这些问题。务实临床试验的几个特点可能会使共享总体结果的伦理和后勤问题变得更加复杂。这些特点包括:务实临床试验不仅会影响患者受试者的权利、福利和利益,还会影响临床医生的权利、福利和利益,这意味着与其他研究相比,试验结果可能会涉及更广泛的群体。此外,一些实用临床试验是在放弃知情同意的情况下进行的,这意味着共享结果可能会提醒参与者,他们是在未经同意的情况下参加试验的。本文探讨了伦理方面的问题,这些问题可以为共享实用临床试验的总体结果提供决策依据,并为共享提供建议。其中一个核心观点是,医疗机构作为开展实用临床试验的关键合作伙伴,也必须成为共享实用临床试验总体结果决策的关键合作伙伴。最后,我们提出了对未来研究的见解。
{"title":"Ethical considerations for sharing aggregate results from pragmatic clinical trials.","authors":"Stephanie R Morain, Abigail Brickler, Joseph Ali, Patricia Pearl O'Rourke, Kayte Spector-Bagdady, Benjamin Wilfond, Vasiliki Rahimzadeh, Caleigh Propes, Kayla Mehl, David Wendler","doi":"10.1177/17407745241290782","DOIUrl":"10.1177/17407745241290782","url":null,"abstract":"<p><p>A growing literature has explored the ethical obligations and current practices related to sharing aggregate results with research participants. However, no prior work has examined these issues in the context of pragmatic clinical trials. Several characteristics of pragmatic clinical trials may complicate both the ethics and the logistics of sharing aggregate results. Among these characteristics include that pragmatic clinical trials may affect the rights, welfare, and interests of not only patient-subjects but also clinicians, meaning that results may be owed to a broader range of groups than typically considered in other research contexts. In addition, some pragmatic clinical trials are conducted under a waiver of informed consent, meaning sharing results may alert participants that they were enrolled without their consent. This article explores the ethical dimensions that can inform decision-making about sharing aggregate results from pragmatic clinical trials, and provides recommendations for that sharing. A central insight is that healthcare institutions-as key partners for the conduct of pragmatic clinical trials-must also be key partners in decision-making about sharing aggregate pragmatic clinical trial results. We conclude with insights for future research.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"248-254"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11991889/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142715141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pragmatic monitoring of emerging efficacy data in randomized controlled trials. 对随机对照试验中新出现的疗效数据进行务实监测。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-11-09 DOI: 10.1177/17407745241290729
Shrikant I Bangdiwala, Salim Yusuf

Monitoring the conduct of phase III randomized controlled trials is driven by ethical reasons to protect the study integrity and the safety of trial participants. We propose a group sequential, pragmatic approach for monitoring the accumulating efficacy information in randomized controlled trials. The "Population Health Research Institute boundary" is simple to implement and sensible, as it considers the reduction in uncertainty with increasing information as the study progresses. It is also pragmatic, since it takes into consideration the typical monitoring behavior of monitoring committees of large multicenter trials and is relatively easily implemented. It not only controls the overall Lan-DeMets type I error probability (alpha) spent, but performs better than other group sequential boundaries for the total nominal study alpha. We illustrate the use of our monitoring approach in the early termination of two past completed trials.

监督 III 期随机对照试验的进行是出于保护研究完整性和试验参与者安全的道德原因。我们提出了一种按组排序的务实方法,用于监测随机对照试验中不断积累的疗效信息。人口健康研究所边界 "既简单易行,又合情合理,因为它考虑到了随着研究的进展,信息的增加会降低不确定性。同时,它也很实用,因为它考虑到了大型多中心试验监测委员会的典型监测行为,而且相对容易实施。它不仅能控制整个 Lan-DeMets I 型误差概率(α)的花费,而且在总名义研究α方面的表现优于其他分组顺序界限。我们在过去完成的两项试验的提前终止中说明了我们的监控方法的使用情况。
{"title":"Pragmatic monitoring of emerging efficacy data in randomized controlled trials.","authors":"Shrikant I Bangdiwala, Salim Yusuf","doi":"10.1177/17407745241290729","DOIUrl":"10.1177/17407745241290729","url":null,"abstract":"<p><p>Monitoring the conduct of phase III randomized controlled trials is driven by ethical reasons to protect the study integrity and the safety of trial participants. We propose a group sequential, pragmatic approach for monitoring the accumulating efficacy information in randomized controlled trials. The \"Population Health Research Institute boundary\" is simple to implement and sensible, as it considers the reduction in uncertainty with increasing information as the study progresses. It is also pragmatic, since it takes into consideration the typical monitoring behavior of monitoring committees of large multicenter trials and is relatively easily implemented. It not only controls the overall Lan-DeMets type I error probability (alpha) spent, but performs better than other group sequential boundaries for the total nominal study alpha. We illustrate the use of our monitoring approach in the early termination of two past completed trials.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"155-160"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11986074/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142616308","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
UK paediatric clinical trial protocols: A review of guidance for participant management and care in the event of premature termination. 英国儿科临床试验协议:对提前终止试验时的参与者管理和护理指南的审查。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-11-19 DOI: 10.1177/17407745241296864
Helen Pluess-Hall, Paula Smith, Julie Menzies

Background/aims: Clinical trials provide an opportunity to identify new treatments and can offer patients access to treatments otherwise unavailable. However, approximately 10% of paediatric clinical trials discontinue before the trial has completed. If this premature termination is because the trial treatment(s) being investigated are identified to be ineffective or unsafe, it results in the abrupt discontinuation of the investigational medicinal product for participants. For some participants, there may not be other treatment options to pursue at the trial-end. Trials prematurely terminating can be a distressing experience for all involved and currently there is little published evidence about the guidance provided to healthcare professionals in the event of premature trial termination. The study protocol is the source of guidance for healthcare professionals delivering clinical research, detailing how to conduct all aspects of the trial. The aim was to quantify the proportion of clinical trial protocols that included premature trial termination and subsequently those that provided instructions related to participant management and care. In addition, to analyse the context in which premature termination was included and the detail of any instructions for participant management and care.

Methods: The ClinicalTrials.gov database was searched by a single reviewer for UK interventional drug trials enrolling children with an available study protocol. Protocols were searched to assess if the risk of premature trial termination was identified, the context for premature termination being included, if information was provided to support the management and care of participants should this situation occur and the detail of those instructions. Data were summarised descriptively.

Results: Of 245 clinical trial protocols, 235 (95.9%) identified the possibility of premature trial termination, the majority within the context of the sponsor asserting their right to terminate the trial (82.7%, 115/235) and providing reasons why the trial could be stopped (65.5%, 91/235). Forty-two percent (98/235) provided guidance for participant management and care, most commonly to contact/inform the participant (45.9%, 45/98). Directions varied in the quantity and level of detail.

Conclusions: This review of UK clinical trial protocol highlights that information surrounding premature termination is lacking, with only 42% providing guidance on the care of trial participants. While this ensures regulatory compliance, it fails to consider the challenge for healthcare professionals in managing participants on-going care or the duty of care owed to participants. Further research is required to understand if additional documents are being used in practice, and if these meet the needs of healthcare professionals in supporting research participants and families during premature trial termination

背景/目的:临床试验为确定新的治疗方法提供了机会,并能为患者提供在其他情况下无法获得的治疗方法。然而,约有 10% 的儿科临床试验在试验结束前就终止了。如果这种提前终止的原因是试验所研究的治疗方法被确认为无效或不安全,那么就会导致试验参与者突然停用试验用医药产品。对于某些参与者来说,试验结束时可能没有其他治疗方案可供选择。试验提前结束可能会给所有参与者带来痛苦,而目前关于在试验提前结束的情况下为医护人员提供指导的公开证据很少。研究方案是医护人员开展临床研究的指导来源,详细说明了如何开展试验的各个方面。研究的目的是量化包含提前终止试验的临床试验方案的比例,以及随后提供与受试者管理和护理相关说明的临床试验方案的比例。此外,还将分析提前终止试验的背景,以及有关参与者管理和护理说明的细节:方法:由一名审稿人在 ClinicalTrials.gov 数据库中搜索英国的介入性药物试验,这些试验均有儿童参与,并提供了研究方案。对试验方案进行检索,以评估是否确定了试验提前终止的风险、提前终止的背景、是否提供了相关信息以支持在出现这种情况时对参与者的管理和护理,以及这些说明的详细内容。对数据进行了描述性总结:在 245 份临床试验方案中,有 235 份(95.9%)确定了提前终止试验的可能性,其中大部分是在申办者主张其有权终止试验的情况下(82.7%,115/235),并提供了可以停止试验的理由(65.5%,91/235)。42%(98/235)的指南提供了参试者管理和护理方面的指导,最常见的是联系/通知参试者(45.9%,45/98)。指导的数量和详细程度各不相同:对英国临床试验方案的审查表明,有关提前终止试验的信息缺乏,只有 42% 的方案提供了有关试验参与者护理的指导。虽然这能确保符合法规要求,但却没有考虑到医护人员在管理参与者的持续护理或对参与者的护理责任方面所面临的挑战。我们需要进一步研究,以了解在实践中是否使用了额外的文件,以及这些文件是否满足了医护人员在试验提前终止期间为研究参与者及其家属提供支持的需求。
{"title":"UK paediatric clinical trial protocols: A review of guidance for participant management and care in the event of premature termination.","authors":"Helen Pluess-Hall, Paula Smith, Julie Menzies","doi":"10.1177/17407745241296864","DOIUrl":"10.1177/17407745241296864","url":null,"abstract":"<p><strong>Background/aims: </strong>Clinical trials provide an opportunity to identify new treatments and can offer patients access to treatments otherwise unavailable. However, approximately 10% of paediatric clinical trials discontinue before the trial has completed. If this premature termination is because the trial treatment(s) being investigated are identified to be ineffective or unsafe, it results in the abrupt discontinuation of the investigational medicinal product for participants. For some participants, there may not be other treatment options to pursue at the trial-end. Trials prematurely terminating can be a distressing experience for all involved and currently there is little published evidence about the guidance provided to healthcare professionals in the event of premature trial termination. The study protocol is the source of guidance for healthcare professionals delivering clinical research, detailing how to conduct all aspects of the trial. The aim was to quantify the proportion of clinical trial protocols that included premature trial termination and subsequently those that provided instructions related to participant management and care. In addition, to analyse the context in which premature termination was included and the detail of any instructions for participant management and care.</p><p><strong>Methods: </strong>The ClinicalTrials.gov database was searched by a single reviewer for UK interventional drug trials enrolling children with an available study protocol. Protocols were searched to assess if the risk of premature trial termination was identified, the context for premature termination being included, if information was provided to support the management and care of participants should this situation occur and the detail of those instructions. Data were summarised descriptively.</p><p><strong>Results: </strong>Of 245 clinical trial protocols, 235 (95.9%) identified the possibility of premature trial termination, the majority within the context of the sponsor asserting their right to terminate the trial (82.7%, 115/235) and providing reasons why the trial could be stopped (65.5%, 91/235). Forty-two percent (98/235) provided guidance for participant management and care, most commonly to contact/inform the participant (45.9%, 45/98). Directions varied in the quantity and level of detail.</p><p><strong>Conclusions: </strong>This review of UK clinical trial protocol highlights that information surrounding premature termination is lacking, with only 42% providing guidance on the care of trial participants. While this ensures regulatory compliance, it fails to consider the challenge for healthcare professionals in managing participants on-going care or the duty of care owed to participants. Further research is required to understand if additional documents are being used in practice, and if these meet the needs of healthcare professionals in supporting research participants and families during premature trial termination","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"220-226"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11986081/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detecting irregularities in randomized controlled trials using machine learning. 利用机器学习检测随机对照试验中的违规行为。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-11-25 DOI: 10.1177/17407745241297947
Walter Nelson, Jeremy Petch, Jonathan Ranisau, Robin Zhao, Kumar Balasubramanian, Shrikant I Bangdiwala

Background: Over the course of a clinical trial, irregularities may arise in the data. Trialists implement human-intensive, expensive central statistical monitoring procedures to identify and correct these irregularities before the results of the trial are analyzed and disseminated. Machine learning algorithms have shown promise for identifying center-level irregularities in multi-center clinical trials with minimal human intervention. We aimed to characterize the form-level data irregularities in several historical clinical trials and evaluate the ability of a machine learning-based outlier detection algorithm to identify them.

Methods: Data irregularities previously identified by humans in historical clinical trials were ascertained by comparing preliminary snapshots of the trial databases to the final, locked databases. We measured the ability of a machine learning based outlier detection algorithm to identify form-level irregularities using concordance (area under the receiver operator characteristic), positive predictive value (precision), and sensitivity (recall).

Results: We examined preliminary snapshots of seven historical clinical trials which randomized a total of 77,001 participants. We extracted a total of 1,267,484 completed entries from 358 case report forms containing irregularities from all snapshots across all trials, containing a total of 24,850 form-wide irregularities (median per-form form-level irregularity rate: 1.81%). Our proposed machine learning algorithm detects form-level irregularities with a median concordance of 0.74 (interquartile range = 0.57-0.89), slightly exceeding the performance of a previously proposed machine learning approach with a median area under the receiver operator characteristic of 0.73 (interquartile range = 0.54-0.88).

Conclusion: Data irregularities in historical clinical trials were ascertained by comparing preliminary snapshots of the trial database to the final database. These irregularities can be categorized according to their scope. Irregularities can be successfully detected by a machine learning algorithm as early or earlier than a human can, without human intervention. Such an approach may complement existing techniques for central statistical monitoring in large multi-center randomized controlled trials and possibly improve the efficiency of costly data verification processes.

背景:在临床试验过程中,数据可能会出现异常。试验者需要实施人力密集、成本高昂的中央统计监测程序,以便在分析和发布试验结果之前识别并纠正这些违规现象。机器学习算法在识别多中心临床试验中中心层面的违规行为方面大有可为,只需极少的人工干预。我们的目的是描述几项历史临床试验中表格级数据异常的特征,并评估基于机器学习的离群点检测算法识别这些异常的能力:方法:通过比较试验数据库的初步快照和最终锁定的数据库,我们确定了之前由人类在历史临床试验中识别出的数据不规则性。我们使用一致性(接收者运算特征下的面积)、阳性预测值(精确度)和灵敏度(召回率)衡量了基于机器学习的离群点检测算法识别形式级不规范的能力:我们研究了七项历史临床试验的初步快照,这些试验共随机抽取了 77,001 名参与者。我们从所有试验的所有快照中提取了 358 份病例报告表中包含违规行为的 1,267,484 个完整条目,共包含 24,850 个全表违规行为(每表违规率中位数:1.81%)。我们提出的机器学习算法检测表单级不规范性的中位一致性为 0.74(四分位间范围 = 0.57-0.89),略高于之前提出的机器学习方法的性能,后者的接收算子特征下的中位面积为 0.73(四分位间范围 = 0.54-0.88):通过比较试验数据库的初步快照和最终数据库,确定了历史临床试验中的数据不规则性。这些违规数据可根据其范围进行分类。机器学习算法可以在不需要人工干预的情况下,比人类更早或更早地成功检测出违规数据。这种方法可以补充现有的大型多中心随机对照试验中央统计监测技术,并有可能提高成本高昂的数据验证过程的效率。
{"title":"Detecting irregularities in randomized controlled trials using machine learning.","authors":"Walter Nelson, Jeremy Petch, Jonathan Ranisau, Robin Zhao, Kumar Balasubramanian, Shrikant I Bangdiwala","doi":"10.1177/17407745241297947","DOIUrl":"10.1177/17407745241297947","url":null,"abstract":"<p><strong>Background: </strong>Over the course of a clinical trial, irregularities may arise in the data. Trialists implement human-intensive, expensive central statistical monitoring procedures to identify and correct these irregularities before the results of the trial are analyzed and disseminated. Machine learning algorithms have shown promise for identifying center-level irregularities in multi-center clinical trials with minimal human intervention. We aimed to characterize the form-level data irregularities in several historical clinical trials and evaluate the ability of a machine learning-based outlier detection algorithm to identify them.</p><p><strong>Methods: </strong>Data irregularities previously identified by humans in historical clinical trials were ascertained by comparing preliminary snapshots of the trial databases to the final, locked databases. We measured the ability of a machine learning based outlier detection algorithm to identify form-level irregularities using concordance (area under the receiver operator characteristic), positive predictive value (precision), and sensitivity (recall).</p><p><strong>Results: </strong>We examined preliminary snapshots of seven historical clinical trials which randomized a total of 77,001 participants. We extracted a total of 1,267,484 completed entries from 358 case report forms containing irregularities from all snapshots across all trials, containing a total of 24,850 form-wide irregularities (median per-form form-level irregularity rate: 1.81%). Our proposed machine learning algorithm detects form-level irregularities with a median concordance of 0.74 (interquartile range = 0.57-0.89), slightly exceeding the performance of a previously proposed machine learning approach with a median area under the receiver operator characteristic of 0.73 (interquartile range = 0.54-0.88).</p><p><strong>Conclusion: </strong>Data irregularities in historical clinical trials were ascertained by comparing preliminary snapshots of the trial database to the final database. These irregularities can be categorized according to their scope. Irregularities can be successfully detected by a machine learning algorithm as early or earlier than a human can, without human intervention. Such an approach may complement existing techniques for central statistical monitoring in large multi-center randomized controlled trials and possibly improve the efficiency of costly data verification processes.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"178-187"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142715120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Statistical properties of items and summary scores from the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE®) in a diverse cancer sample. 不同癌症样本中患者报告结果版《不良事件通用术语标准》(PRO-CTCAE®)项目和总分的统计特性。
IF 2.2 3区 医学 Q3 MEDICINE, RESEARCH & EXPERIMENTAL Pub Date : 2025-04-01 Epub Date: 2024-10-23 DOI: 10.1177/17407745241286065
Carolyn Mead-Harvey, Ethan Basch, Lauren J Rogak, Blake T Langlais, Gita Thanarajasingam, Brenda F Ginos, Minji K Lee, Claire Yee, Sandra A Mitchell, Lori M Minasian, Tito R Mendoza, Antonia V Bennett, Deborah Schrag, Amylou C Dueck, Gina L Mazza

Background/aims: The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE®) was developed to capture symptomatic adverse events from the patient perspective. We aim to describe statistical properties of PRO-CTCAE items and summary scores and to provide evidence for recommendations regarding PRO-CTCAE administration and reporting.

Methods: Using data from the PRO-CTCAE validation study (NCT02158637), prevalence, means, and standard deviations of PRO-CTCAE items, composite scores, and mean and maximum scores across attributes (frequency, severity, and/or interference) of symptomatic adverse events were calculated. For each adverse event, correlations and agreement between attributes, correlations between attributes and composite scores, and correlations between composite, mean, and maximum scores were estimated.

Results: PRO-CTCAE items were completed by 899 patients with various cancer types. Most patients reported experiencing one or more adverse events, with the most prevalent being fatigue (87.7%), sad/unhappy feelings (66.0%), anxiety (63.6%), pain (63.2%), insomnia (61.8%), and dry mouth (60.0%). Attributes were moderately to strongly correlated within an adverse event (r = 0.53 to 0.77, all p < 0.001) but not fully concordant (κweighted = 0.26 to 0.60, all p < 0.001), with interference demonstrating lowest mean scores and prevalence among attributes of the same adverse event. Attributes were moderately to strongly correlated with composite scores (r = 0.67 to 0.97, all p < 0.001). Composite scores were moderately to strongly correlated with mean and maximum scores for the same adverse event (r = 0.69 to 0.94, all p < 0.001). Correlations between composite scores of different adverse events varied widely (r = 0.04 to 0.68) but were moderate to strong for conceptually related adverse events.

Conclusions: Results provide evidence for PRO-CTCAE administration and reporting recommendations that the full complement of attributes be administered for each adverse event, and that attributes as well as summary scores be reported.

背景/目的:患者报告结果版不良事件通用术语标准(PRO-CTCAE®)旨在从患者角度捕捉症状性不良事件。我们旨在描述 PRO-CTCAE 项目和总分的统计特性,并为有关 PRO-CTCAE 管理和报告的建议提供证据:利用 PRO-CTCAE 验证研究(NCT02158637)的数据,计算了 PRO-CTCAE 项目、综合评分以及症状性不良事件不同属性(频率、严重程度和/或干扰)的平均分和最高分的流行率、平均值和标准偏差。对每种不良事件的属性之间的相关性和一致性、属性与综合评分之间的相关性以及综合评分、平均分和最高分之间的相关性进行了估算:899名不同癌症类型的患者完成了PRO-CTCAE项目。大多数患者报告经历了一种或多种不良事件,其中最普遍的不良事件是疲劳(87.7%)、悲伤/不开心(66.0%)、焦虑(63.6%)、疼痛(63.2%)、失眠(61.8%)和口干(60.0%)。在一个不良事件中,属性的相关性为中度到高度相关(r = 0.53 到 0.77,所有 p 加权 = 0.26 到 0.60,所有 p r = 0.67 到 0.97,所有 p r = 0.69 到 0.94,所有 p r = 0.04 到 0.68),但在概念相关的不良事件中,属性的相关性为中度到高度相关:结论:研究结果为 PRO-CTCAE 的管理和报告建议提供了证据,建议对每种不良事件进行全套属性管理,并报告属性和总分。
{"title":"Statistical properties of items and summary scores from the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE<sup>®</sup>) in a diverse cancer sample.","authors":"Carolyn Mead-Harvey, Ethan Basch, Lauren J Rogak, Blake T Langlais, Gita Thanarajasingam, Brenda F Ginos, Minji K Lee, Claire Yee, Sandra A Mitchell, Lori M Minasian, Tito R Mendoza, Antonia V Bennett, Deborah Schrag, Amylou C Dueck, Gina L Mazza","doi":"10.1177/17407745241286065","DOIUrl":"10.1177/17407745241286065","url":null,"abstract":"<p><strong>Background/aims: </strong>The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE<sup>®</sup>) was developed to capture symptomatic adverse events from the patient perspective. We aim to describe statistical properties of PRO-CTCAE items and summary scores and to provide evidence for recommendations regarding PRO-CTCAE administration and reporting.</p><p><strong>Methods: </strong>Using data from the PRO-CTCAE validation study (NCT02158637), prevalence, means, and standard deviations of PRO-CTCAE items, composite scores, and mean and maximum scores across attributes (frequency, severity, and/or interference) of symptomatic adverse events were calculated. For each adverse event, correlations and agreement between attributes, correlations between attributes and composite scores, and correlations between composite, mean, and maximum scores were estimated.</p><p><strong>Results: </strong>PRO-CTCAE items were completed by 899 patients with various cancer types. Most patients reported experiencing one or more adverse events, with the most prevalent being fatigue (87.7%), sad/unhappy feelings (66.0%), anxiety (63.6%), pain (63.2%), insomnia (61.8%), and dry mouth (60.0%). Attributes were moderately to strongly correlated within an adverse event (<i>r</i> = 0.53 to 0.77, all <i>p</i> < 0.001) but not fully concordant (κ<sub>weighted</sub> = 0.26 to 0.60, all <i>p</i> < 0.001), with interference demonstrating lowest mean scores and prevalence among attributes of the same adverse event. Attributes were moderately to strongly correlated with composite scores (<i>r</i> = 0.67 to 0.97, all <i>p</i> < 0.001). Composite scores were moderately to strongly correlated with mean and maximum scores for the same adverse event (<i>r</i> = 0.69 to 0.94, all <i>p</i> < 0.001). Correlations between composite scores of different adverse events varied widely (<i>r</i> = 0.04 to 0.68) but were moderate to strong for conceptually related adverse events.</p><p><strong>Conclusions: </strong>Results provide evidence for PRO-CTCAE administration and reporting recommendations that the full complement of attributes be administered for each adverse event, and that attributes as well as summary scores be reported.</p>","PeriodicalId":10685,"journal":{"name":"Clinical Trials","volume":" ","pages":"161-169"},"PeriodicalIF":2.2,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11986086/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142496568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Clinical Trials
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1