首页 > 最新文献

Journal of Clinical Epidemiology最新文献

英文 中文
A methodological review identified several options for utilizing registries for randomized controlled trials 一项方法审查确定了利用登记册进行随机对照试验的几种方案。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111614
Luisa Urban , Nina Haller , Dawid Pieper , Tim Mathes

Objectives

Registry-based randomized controlled trials (RRCTs) can provide internally valid results in a real-world context at relatively low effort and cost. However, the main characteristics, the extent to which the registry is utilized (eg, proportion of data from registry) and registry-related limitations are not well characterized. This methodological review of RRCTs aims to analyze the trial design features, investigate potential usage options, and identify possible limitations of using registry data for randomized controlled trials (RCTs).

Study Design and Setting

A systematic search in PubMed for ongoing and published RRCTs was conducted up to February 2, 2023. Studies that reported at least one outcome derived from a registry were included. Study selection was independently performed by two reviewers. All data were extracted into a standardized table, and descriptive statistics were generated.

Results

We included 162 RRCTs (41 protocols and 121 studies). Most RRCTs were multicenter trials (n = 127; 78.4%) comprising a large number of participants (median = 1787; range = 41 to 683,927) and a long follow-up period (median = 60 months; range = 1 to 367 months) with a minimal loss to follow-up. The inclusion criteria of participants were mostly broadly defined. Types of interventions ranged from surgical procedures to behavioral interventions, and almost half of the interventions (46.9%) had a preventive purpose. The main registry outcome was mostly a clinical endpoint (40.1%) or a composite endpoint of major clinical events (30.9%) that was objectively measurable. We found different degrees of registry utilization, ranging from the exclusive use of long-term monitoring of previously published data to the more comprehensive registry utilization for patient recruitment, endpoint collection, and long-term follow-up. Limitations related to the use of registry data comprised potential coding errors or incomplete data (eg, due to under-recording of mild cases). In addition, technical challenges must be considered (eg, failed linkages or time-delayed data entry).

Conclusion

A broad spectrum of potential usage options and usage extent of registry data exist. Our analysis suggests that in many cases, the potential of using registry data and thus their benefits were not fully utilized. In addition, the study illustrates that there is not a single, unified methodology for designing RRCTs but that registries can support RCTs in various ways. Therefore, future RRCTs should specify for what purposes and to what extent registries were utilized. Moreover, a clear definition and taxonomy of RRCTs appears necessary for facilitating future dialogue and research on RRCTs.
目的:以登记处为基础的随机对照试验(RRCTs)能以相对较低的工作量和成本在现实世界中提供内部有效的结果。然而,RRCT 的主要特点、注册表的利用程度(如来自注册表的数据比例)以及与注册表相关的局限性并不十分明确。本研究对RRCT进行了方法学回顾,旨在分析试验设计的特点,调查潜在的使用方案,并找出在RCT中使用登记数据可能存在的局限性:在PubMed上对截至2023/28/02正在进行的和已发表的RRCT进行了系统检索。纳入的研究报告中至少有一项结果来自登记处。研究筛选由两名审稿人独立完成。所有数据均被提取到标准表格中,并生成描述性统计:我们纳入了 162 项 RRCT(41 项方案和 121 项研究)。大多数 RRCT 为多中心试验(n=127;78.4%),包括大量参与者(中位数=1,787;范围=41-683,927)和较长的随访期(中位数=60 个月;范围=1-367 个月),随访损失极小。参与者的纳入标准大多定义宽泛。干预的类型从外科手术到行为干预不等,近一半的干预(46.9%)具有预防目的。主要登记结果大多是可客观测量的临床终点(40.1%)或主要临床事件的复合终点(30.9%)。我们发现登记册的使用程度各不相同,有的仅用于长期监测之前公布的数据,有的则更全面地用于招募患者、收集终点和长期随访。登记数据使用的局限性包括潜在的编码错误或数据不完整(如轻度病例记录不足)。此外,还必须考虑技术方面的挑战(如链接失败或数据录入延迟):登记册数据存在多种潜在的使用选择和使用范围。我们的分析表明,在许多情况下,使用登记册数据的潜力及其益处并未得到充分利用。此外,本研究还表明,设计 RRCT 并不存在单一、统一的方法,登记册可以通过各种方式为 RCT 提供支持。因此,未来的 RRCT 应明确说明登记册的用途和使用程度。此外,RRCT 的明确定义和分类对于促进未来有关 RRCT 的对话和研究似乎很有必要。
{"title":"A methodological review identified several options for utilizing registries for randomized controlled trials","authors":"Luisa Urban ,&nbsp;Nina Haller ,&nbsp;Dawid Pieper ,&nbsp;Tim Mathes","doi":"10.1016/j.jclinepi.2024.111614","DOIUrl":"10.1016/j.jclinepi.2024.111614","url":null,"abstract":"<div><h3>Objectives</h3><div>Registry-based randomized controlled trials (RRCTs) can provide internally valid results in a real-world context at relatively low effort and cost. However, the main characteristics, the extent to which the registry is utilized (eg, proportion of data from registry) and registry-related limitations are not well characterized. This methodological review of RRCTs aims to analyze the trial design features, investigate potential usage options, and identify possible limitations of using registry data for randomized controlled trials (RCTs).</div></div><div><h3>Study Design and Setting</h3><div>A systematic search in PubMed for ongoing and published RRCTs was conducted up to February 2, 2023. Studies that reported at least one outcome derived from a registry were included. Study selection was independently performed by two reviewers. All data were extracted into a standardized table, and descriptive statistics were generated.</div></div><div><h3>Results</h3><div>We included 162 RRCTs (41 protocols and 121 studies). Most RRCTs were multicenter trials (<em>n</em> = 127; 78.4%) comprising a large number of participants (median = 1787; range = 41 to 683,927) and a long follow-up period (median = 60 months; range = 1 to 367 months) with a minimal loss to follow-up. The inclusion criteria of participants were mostly broadly defined. Types of interventions ranged from surgical procedures to behavioral interventions, and almost half of the interventions (46.9%) had a preventive purpose. The main registry outcome was mostly a clinical endpoint (40.1%) or a composite endpoint of major clinical events (30.9%) that was objectively measurable. We found different degrees of registry utilization, ranging from the exclusive use of long-term monitoring of previously published data to the more comprehensive registry utilization for patient recruitment, endpoint collection, and long-term follow-up. Limitations related to the use of registry data comprised potential coding errors or incomplete data (eg, due to under-recording of mild cases). In addition, technical challenges must be considered (eg, failed linkages or time-delayed data entry).</div></div><div><h3>Conclusion</h3><div>A broad spectrum of potential usage options and usage extent of registry data exist. Our analysis suggests that in many cases, the potential of using registry data and thus their benefits were not fully utilized. In addition, the study illustrates that there is not a single, unified methodology for designing RRCTs but that registries can support RCTs in various ways. Therefore, future RRCTs should specify for what purposes and to what extent registries were utilized. Moreover, a clear definition and taxonomy of RRCTs appears necessary for facilitating future dialogue and research on RRCTs.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111614"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142677474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sociodemographic bias in clinical machine learning models: a scoping review of algorithmic bias instances and mechanisms 临床机器学习模型中的社会人口偏见:算法偏差实例和机制的范围综述。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111606
Michael Colacci , Yu Qing Huang , Gemma Postill , Pavel Zhelnov , Orna Fennelly , Amol Verma , Sharon Straus , Andrea C. Tricco

Background and Objectives

Clinical machine learning (ML) technologies can sometimes be biased and their use could exacerbate health disparities. The extent to which bias is present, the groups who most frequently experience bias, and the mechanism through which bias is introduced in clinical ML applications is not well described. The objective of this study was to examine instances of bias in clinical ML models. We identified the sociodemographic subgroups PROGRESS that experienced bias and the reported mechanisms of bias introduction.

Methods

We searched MEDLINE, EMBASE, PsycINFO, and Web of Science for all studies that evaluated bias on sociodemographic factors within ML algorithms created for the purpose of facilitating clinical care. The scoping review was conducted according to the Joanna Briggs Institute guide and reported using the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) extension for scoping reviews.

Results

We identified 6448 articles, of which 760 reported on a clinical ML model and 91 (12.0%) completed a bias evaluation and met all inclusion criteria. Most studies evaluated a single sociodemographic factor (n = 56, 61.5%). The most frequently evaluated sociodemographic factor was race (n = 59, 64.8%), followed by sex/gender (n = 41, 45.1%), and age (n = 24, 26.4%), with one study (1.1%) evaluating intersectional factors. Of all studies, 74.7% (n = 68) reported that bias was present, 18.7% (n = 17) reported bias was not present, and 6.6% (n = 6) did not state whether bias was present. When present, 87% of studies reported bias against groups with socioeconomic disadvantage.

Conclusion

Most ML algorithms that were evaluated for bias demonstrated bias on sociodemographic factors. Furthermore, most bias evaluations concentrated on race, sex/gender, and age, while other sociodemographic factors and their intersection were infrequently assessed. Given potential health equity implications, bias assessments should be completed for all clinical ML models.
背景:临床机器学习(ML)技术有时可能存在偏见,使用这些技术可能会加剧健康差异。关于临床机器学习应用中存在偏差的程度、最常出现偏差的群体以及引入偏差的机制,目前还没有很好的描述。本研究的目的是检查临床 ML 模型中的偏差实例。我们确定了出现偏倚的社会人口亚群(使用 PROGRESS-Plus 框架),以及报告的偏倚引入机制。 方法:我们检索了 MEDLINE、EMBASE、PsycINFO 和 Web of Science,以查找所有评估为促进临床护理而创建的 ML 算法中社会人口因素偏倚的研究。范围界定综述根据 JBI 指南进行,并使用范围界定综述的 PRISMA 扩展报告:我们确定了 6448 篇文章,其中 760 篇报告了临床 ML 模型,91 篇(12.0%)完成了偏倚评估并符合所有纳入标准。大多数研究只评估了一个社会人口因素(n=56,61.5%)。最常评估的社会人口因素是种族(n=59,64.8%),其次是性/性别(n=41,45.1%)和年龄(n=24,26.4%),有一项研究(1.1%)评估了交叉因素。在所有研究中,74.7%(n=68)报告存在偏见,18.7%(n=17)报告不存在偏见,6.6%(n=6)未说明是否存在偏见。87%的研究报告称存在针对社会经济弱势群体的偏见:结论:大多数被评估为存在偏差的 ML 算法都显示出社会人口因素方面的偏差。此外,大多数偏倚评估都集中在种族、性别和年龄上,而其他社会人口因素及其交叉因素很少得到评估。考虑到潜在的健康公平影响,所有临床 ML 模型都应完成偏倚评估。
{"title":"Sociodemographic bias in clinical machine learning models: a scoping review of algorithmic bias instances and mechanisms","authors":"Michael Colacci ,&nbsp;Yu Qing Huang ,&nbsp;Gemma Postill ,&nbsp;Pavel Zhelnov ,&nbsp;Orna Fennelly ,&nbsp;Amol Verma ,&nbsp;Sharon Straus ,&nbsp;Andrea C. Tricco","doi":"10.1016/j.jclinepi.2024.111606","DOIUrl":"10.1016/j.jclinepi.2024.111606","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>Clinical machine learning (ML) technologies can sometimes be biased and their use could exacerbate health disparities. The extent to which bias is present, the groups who most frequently experience bias, and the mechanism through which bias is introduced in clinical ML applications is not well described. The objective of this study was to examine instances of bias in clinical ML models. We identified the sociodemographic subgroups PROGRESS that experienced bias and the reported mechanisms of bias introduction.</div></div><div><h3>Methods</h3><div>We searched MEDLINE, EMBASE, PsycINFO, and Web of Science for all studies that evaluated bias on sociodemographic factors within ML algorithms created for the purpose of facilitating clinical care. The scoping review was conducted according to the Joanna Briggs Institute guide and reported using the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) extension for scoping reviews.</div></div><div><h3>Results</h3><div>We identified 6448 articles, of which 760 reported on a clinical ML model and 91 (12.0%) completed a bias evaluation and met all inclusion criteria. Most studies evaluated a single sociodemographic factor (<em>n</em> = 56, 61.5%). The most frequently evaluated sociodemographic factor was race (<em>n</em> = 59, 64.8%), followed by sex/gender (<em>n</em> = 41, 45.1%), and age (<em>n</em> = 24, 26.4%), with one study (1.1%) evaluating intersectional factors. Of all studies, 74.7% (<em>n</em> = 68) reported that bias was present, 18.7% (<em>n</em> = 17) reported bias was not present, and 6.6% (<em>n</em> = 6) did not state whether bias was present. When present, 87% of studies reported bias against groups with socioeconomic disadvantage.</div></div><div><h3>Conclusion</h3><div>Most ML algorithms that were evaluated for bias demonstrated bias on sociodemographic factors. Furthermore, most bias evaluations concentrated on race, sex/gender, and age, while other sociodemographic factors and their intersection were infrequently assessed. Given potential health equity implications, bias assessments should be completed for all clinical ML models.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111606"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142631723","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Patient-reported outcomes and measures are under-utilised in advanced therapy medicinal products trials for orphan conditions 在孤儿疾病的先进治疗药物试验中,患者报告的结果和措施未得到充分利用。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111617
Andrada Ciuca , Siddharth Banka , Tara Clancy , Simon Jones , Jamie J. Kirkham , William G. Newman , Katherine Payne , Ramona Moldovan

Objectives

Advanced therapy medicinal products (ATMPs) are medicines based on genes, tissues, or cells and can include gene therapy, somatic-cell therapy, and tissue-engineered medicines. Patient-reported outcomes (PROs) are reports on health and well-being that come directly from the individual without external interpretation. Patient-reported outcome measures (PROMs) are questionnaires aimed at assessing the individual and subjective experience with health and other psychosocial aspects. The aim of the present review is to assess the extent and quality of PROs and PROMs used in orphan ATMP trials.

Study Design and Setting

The database from National Health Service Special Pharmacy Service horizon scanning was searched on 27 March 2024 to identify all ATMPs for orphan conditions. Clinical trial protocols were included in this review if they investigated ATMPs for orphan conditions and were published in clinical trial databases.

Results

A total of 100 trials were included. These accounted for 64 conditions. Only 37% (37/100) of the trials included PROs. Overall, 17 different types of PROs were identified across the trials. Quality of life (QoL) and health-related quality of life (HRQoL) were the most frequent PROs found in 18% (18/100) and 13% (13/100) of the trials, respectively. A total of 33 PROMs were identified. Of these, 57% (19/33) were HRQoL (89% [17/19]) or QoL (11% [2/19]) measures. Of the HRQoL measures identified, 71% (12/17) were disease specific and 29% (5/17) were generic. Of the non-QoL PROMs, 29% (4/14) were designed to measure pain and 71% (10/14) PROMs focused on other psychological outcomes, including anxiety and depression.

Conclusion

Our results show that only 37% of the orphan ATMP trials include patient-reported outcomes and measures. This highlights the urgent need for relevant PROs/PROMs that capture benefits and harms and assimilation of existing PROMs for better comparison between or within conditions. It is essential to include and reflect the patients' experience so that those intended to benefit from the research have the opportunity to influence its direction.
目的:先进治疗药物(ATMPs)是基于基因、组织或细胞的药物,可包括基因治疗、体细胞治疗和组织工程药物。患者报告结果(PRO)是直接来自个人的健康和福祉报告,无需外部解释。患者报告结果措施(PROMs)是旨在评估个人和主观健康和其他社会心理方面经验的问卷。本综述的目的是评估孤儿atmp试验中使用的PROs和prom的程度和质量。研究设计和设置:于2024年3月27日检索NHS特殊药房服务水平扫描数据库,以确定所有用于孤儿疾病的atmp。如果临床试验方案研究了治疗孤儿病的atmp,并在临床试验数据库中发表,则纳入本综述。结果:共纳入100项试验。这些条件占64种。只有37%(37/100)的试验包括PROs。总的来说,在整个试验中确定了17种不同类型的PROs。QoL和HRQoL是最常见的PROs,分别占18%(18/100)和13%(13/100)。共鉴定出33个prom。其中57%(19/33)的HRQoL为89%(17/19)或11%(2/19)。在确定的HRQoL测量中,71%(12/17)是疾病特异性的,29%(5/17)是一般性的。在非生活质量问题中,29%(4/14)的问题被设计用于测量疼痛,71%(10/14)的问题被设计用于测量其他心理结果,包括焦虑和抑郁。结论:我们的结果显示,只有37%的孤儿atmp试验包括患者报告的结果和措施。这突出了迫切需要相关的PROs/PROMs来捕捉利弊,并吸收现有的PROMs,以便更好地在条件之间或条件内进行比较。必须包括和反映患者的经验,以便那些打算从研究中受益的人有机会影响其方向。
{"title":"Patient-reported outcomes and measures are under-utilised in advanced therapy medicinal products trials for orphan conditions","authors":"Andrada Ciuca ,&nbsp;Siddharth Banka ,&nbsp;Tara Clancy ,&nbsp;Simon Jones ,&nbsp;Jamie J. Kirkham ,&nbsp;William G. Newman ,&nbsp;Katherine Payne ,&nbsp;Ramona Moldovan","doi":"10.1016/j.jclinepi.2024.111617","DOIUrl":"10.1016/j.jclinepi.2024.111617","url":null,"abstract":"<div><h3>Objectives</h3><div>Advanced therapy medicinal products (ATMPs) are medicines based on genes, tissues, or cells and can include gene therapy, somatic-cell therapy, and tissue-engineered medicines. Patient-reported outcomes (PROs) are reports on health and well-being that come directly from the individual without external interpretation. Patient-reported outcome measures (PROMs) are questionnaires aimed at assessing the individual and subjective experience with health and other psychosocial aspects. The aim of the present review is to assess the extent and quality of PROs and PROMs used in orphan ATMP trials.</div></div><div><h3>Study Design and Setting</h3><div>The database from National Health Service Special Pharmacy Service horizon scanning was searched on 27 March 2024 to identify all ATMPs for orphan conditions. Clinical trial protocols were included in this review if they investigated ATMPs for orphan conditions and were published in clinical trial databases.</div></div><div><h3>Results</h3><div>A total of 100 trials were included. These accounted for 64 conditions. Only 37% (37/100) of the trials included PROs. Overall, 17 different types of PROs were identified across the trials. Quality of life (QoL) and health-related quality of life (HRQoL) were the most frequent PROs found in 18% (18/100) and 13% (13/100) of the trials, respectively. A total of 33 PROMs were identified. Of these, 57% (19/33) were HRQoL (89% [17/19]) or QoL (11% [2/19]) measures. Of the HRQoL measures identified, 71% (12/17) were disease specific and 29% (5/17) were generic. Of the non-QoL PROMs, 29% (4/14) were designed to measure pain and 71% (10/14) PROMs focused on other psychological outcomes, including anxiety and depression.</div></div><div><h3>Conclusion</h3><div>Our results show that only 37% of the orphan ATMP trials include patient-reported outcomes and measures. This highlights the urgent need for relevant PROs/PROMs that capture benefits and harms and assimilation of existing PROMs for better comparison between or within conditions. It is essential to include and reflect the patients' experience so that those intended to benefit from the research have the opportunity to influence its direction.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111617"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142752251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-time adaptive randomization of clinical trials 临床试验的实时自适应随机化。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111612
Gui Liberali , Eric Boersma , Hester Lingsma , Jasper Brugts , Diederik Dippel , Jan Tijssen , John Hauser
<div><h3>Objectives</h3><div>To evaluate real-time (day-to-day) adaptation of randomized controlled trials (RCTs) with delayed endpoints – a “forward-looking optimal-experimentation” form of response-adaptive randomization. To identify the implied tradeoffs between lowered mortality, CIs, statistical power, potential arm misidentification, and endpoint rate change during the trial.</div></div><div><h3>Study Design and Setting</h3><div>Using data from RCTs in acute myocardial infarction (30,732 patients in the Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries, GUSTO-1) and coronary heart disease (12,218 patients in the EURopean trial On reduction of cardiac events with Perindopril in stable coronary Artery disease, EUROPA), we resample treatment-arm assignments and expected endpoints to simulate (1) real-time assignment, (2) forward-looking assignments adapted after observing a fixed number of patients (“blocks”), and (3) a variant that balances RCT and real-time assignments. Blinded real-time adaptive randomizations (RTARs) adjust day-to-day arm assignments by optimizing the tradeoff between assigning the (likely) best treatment and learning about endpoint rates for future assignments.</div></div><div><h3>Results</h3><div>Despite delays in endpoints, real-time assignment quickly learns which arm is superior. In the simulations, by the end of the trials, real-time assignment allocated more patients to the superior arm and fewer patients to the inferior arm(s) resulting in less mortality over the course of the trial. Endpoint rates and odds ratios were well within (resampling) CIs of the RCTs, but with tighter CIs on the superior arm and less-tight CIs on the inferior arm(s) and the odds ratios. The variant and patient-block-based adaptation each provides intermediate levels of benefits and costs. When endpoint rates change within a trial, real-time assignment improves estimation of the end-of-trial superior-arm endpoint rates, but exaggerates differences relative to inferior arms. Unlike most response-adaptive randomizations, real-time assignment automatically adjusts to reduce biases when real changes are larger.</div></div><div><h3>Conclusion</h3><div>Real-time assignment improves patient outcomes within the trial and narrows the CI for the superior arm. Benefits are balanced with wider CIs on inferior arms and odds ratios. Forward-looking variants provide intermediate benefits and costs. In no simulations, was an inferior arm identified as statistically superior.</div></div><div><h3>Plain Language Summary</h3><div>Randomized controlled trials (RCT) are the gold standard in clinical trials — typically half of the patients are assigned to a new drug or procedure and the other half to a placebo (or the current best option). Typically, half of the patients might get an inferior drug or treatment. We explore a method, real-time adaptive randomization (RTAR), that uses information observed up to the t
目的评估采用延迟终点的随机对照临床试验(RCT)的实时(日常)适应性--一种 "前瞻性最优试验 "形式的反应适应性随机化(RAR)。目的是确定降低死亡率、置信区间、统计功率、潜在的臂误认以及试验期间终点率变化之间的隐含权衡:利用急性心肌梗死(GUSTO-1 中有 30732 例患者)和冠心病(EUROPA 中有 12218 例患者)的 RCT 数据,我们对治疗臂分配和预期终点进行了重新采样,以模拟(1)实时分配,(2)观察固定数量患者("区块")后调整的前瞻性分配,以及(3)兼顾 RCT 和实时分配的变体。盲法 RTAR 通过在分配(可能的)最佳治疗方案和了解终点率之间进行优化权衡,来调整每日的治疗方案分配:结果:尽管终点出现延迟,但实时分配很快就能了解到哪个治疗组更优。在模拟试验中,到试验结束时,实时分配将更多患者分配到优效治疗组,将更少的患者分配到劣效治疗组,从而在试验过程中减少了死亡率。终点发病率和几率比都在研究性临床试验的(重采样)置信区间内,但上位治疗组的置信区间较窄,下位治疗组和几率比的置信区间较窄。变异适应和基于患者分块的适应各自提供了中间水平的收益和成本。当试验中终点发生率发生变化时,实时分配可改善试验末期优势臂终点发生率的估计,但会夸大相对劣势臂的差异。与大多数 RAR 不同的是,当实际变化较大时,实时分配会自动调整以减少偏差:结论:实时分配改善了试验中患者的治疗效果,缩小了优势臂的置信区间。劣势臂和几率比的置信区间更宽,从而平衡了收益。前瞻性变量提供了中间效益和成本。在所有模拟试验中,均未发现劣势臂在统计学上具有优势。
{"title":"Real-time adaptive randomization of clinical trials","authors":"Gui Liberali ,&nbsp;Eric Boersma ,&nbsp;Hester Lingsma ,&nbsp;Jasper Brugts ,&nbsp;Diederik Dippel ,&nbsp;Jan Tijssen ,&nbsp;John Hauser","doi":"10.1016/j.jclinepi.2024.111612","DOIUrl":"10.1016/j.jclinepi.2024.111612","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Objectives&lt;/h3&gt;&lt;div&gt;To evaluate real-time (day-to-day) adaptation of randomized controlled trials (RCTs) with delayed endpoints – a “forward-looking optimal-experimentation” form of response-adaptive randomization. To identify the implied tradeoffs between lowered mortality, CIs, statistical power, potential arm misidentification, and endpoint rate change during the trial.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;Using data from RCTs in acute myocardial infarction (30,732 patients in the Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries, GUSTO-1) and coronary heart disease (12,218 patients in the EURopean trial On reduction of cardiac events with Perindopril in stable coronary Artery disease, EUROPA), we resample treatment-arm assignments and expected endpoints to simulate (1) real-time assignment, (2) forward-looking assignments adapted after observing a fixed number of patients (“blocks”), and (3) a variant that balances RCT and real-time assignments. Blinded real-time adaptive randomizations (RTARs) adjust day-to-day arm assignments by optimizing the tradeoff between assigning the (likely) best treatment and learning about endpoint rates for future assignments.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;Despite delays in endpoints, real-time assignment quickly learns which arm is superior. In the simulations, by the end of the trials, real-time assignment allocated more patients to the superior arm and fewer patients to the inferior arm(s) resulting in less mortality over the course of the trial. Endpoint rates and odds ratios were well within (resampling) CIs of the RCTs, but with tighter CIs on the superior arm and less-tight CIs on the inferior arm(s) and the odds ratios. The variant and patient-block-based adaptation each provides intermediate levels of benefits and costs. When endpoint rates change within a trial, real-time assignment improves estimation of the end-of-trial superior-arm endpoint rates, but exaggerates differences relative to inferior arms. Unlike most response-adaptive randomizations, real-time assignment automatically adjusts to reduce biases when real changes are larger.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;Real-time assignment improves patient outcomes within the trial and narrows the CI for the superior arm. Benefits are balanced with wider CIs on inferior arms and odds ratios. Forward-looking variants provide intermediate benefits and costs. In no simulations, was an inferior arm identified as statistically superior.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Plain Language Summary&lt;/h3&gt;&lt;div&gt;Randomized controlled trials (RCT) are the gold standard in clinical trials — typically half of the patients are assigned to a new drug or procedure and the other half to a placebo (or the current best option). Typically, half of the patients might get an inferior drug or treatment. We explore a method, real-time adaptive randomization (RTAR), that uses information observed up to the t","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111612"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142669987","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Results reporting for clinical trials led by medical universities and university hospitals in the Nordic countries was often missing or delayed.
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2025.111710
Gustav Nilsonne, Susanne Wieschowski, Nicholas J DeVito, Maia Salholz-Hillel, Love Ahnström, Till Bruckner, Katarzyna Klas, Tarik Suljic, Samruddhi Yerunkar, Natasha Olsson, Carolina Cruz, Karolina Strzebonska, Lars Småbrekke, Mateusz T Wasylewski, Johan Bengtsson, Martin Ringsten, Aminul Schuster, Tomasz Krawczyk, Themistoklis Paraskevas, Eero Raittio, Luca Herczeg, Jan-Ole Hesselberg, Sofia Karlsson, Ronak Borana, Matteo Bruschettini, Shai Mulinari, Karely Lizárraga, Maximilian Siebert, Nicole Hildebrand, Shreya Ramakrishnan, Perrine Janiaud, Emmanuel Zavalis, Delwen Franzen, Kim Boesen, Lars G Hemkens, Florian Naudet, Sofie Possmark, Rebecca M Willén, John P Ioannidis, Daniel Strech, Cathrine Axfors

Objective: To systematically evaluate timely reporting of clinical trial results at medical universities and university hospitals in the Nordic countries.

Study design and setting: In this cross-sectional study, we included trials (regardless of intervention) registered in the EU Clinical Trials Registry and/or ClinicalTrials.gov, completed 2016-2019, and led by a university with medical faculty or university hospital in Denmark, Finland, Iceland, Norway, or Sweden. We identified summary results posted at the trial registries, and conducted systematic manual searches for results publications (e.g., journal articles, preprints). We present proportions with 95% confidence intervals (CI), and medians with interquartile range (IQR).

Protocol: https://osf.io/wua3r RESULTS: Among 2,112 included clinical trials, 1,650 (78.1%, 95%CI 76.3-79.8%) reported any results during our follow-up; 1,097 (51.9%, 95%CI 49.8-54.1%) reported any results within 2 years of the global completion date; and 48 (2.3%, 95%CI 1.7-3.0%) posted summary results in the registry within 1 year. Median time from global completion date to results reporting was 690 days (IQR 1,103). 856/1,681 (50.9%) of ClinicalTrials.gov-registrations were prospective. Denmark contributed approximately half of all trials. Reporting performance varied widely between institutions.

Conclusion: Missing and delayed results reporting of academically led clinical trials is a pervasive problem in the Nordic countries. We relied on trial registry information, which can be incomplete. Institutions, funders, and policy makers need to support trial teams, ensure regulation adherence, and secure trial reporting before results are permanently lost.

{"title":"Results reporting for clinical trials led by medical universities and university hospitals in the Nordic countries was often missing or delayed.","authors":"Gustav Nilsonne, Susanne Wieschowski, Nicholas J DeVito, Maia Salholz-Hillel, Love Ahnström, Till Bruckner, Katarzyna Klas, Tarik Suljic, Samruddhi Yerunkar, Natasha Olsson, Carolina Cruz, Karolina Strzebonska, Lars Småbrekke, Mateusz T Wasylewski, Johan Bengtsson, Martin Ringsten, Aminul Schuster, Tomasz Krawczyk, Themistoklis Paraskevas, Eero Raittio, Luca Herczeg, Jan-Ole Hesselberg, Sofia Karlsson, Ronak Borana, Matteo Bruschettini, Shai Mulinari, Karely Lizárraga, Maximilian Siebert, Nicole Hildebrand, Shreya Ramakrishnan, Perrine Janiaud, Emmanuel Zavalis, Delwen Franzen, Kim Boesen, Lars G Hemkens, Florian Naudet, Sofie Possmark, Rebecca M Willén, John P Ioannidis, Daniel Strech, Cathrine Axfors","doi":"10.1016/j.jclinepi.2025.111710","DOIUrl":"https://doi.org/10.1016/j.jclinepi.2025.111710","url":null,"abstract":"<p><strong>Objective: </strong>To systematically evaluate timely reporting of clinical trial results at medical universities and university hospitals in the Nordic countries.</p><p><strong>Study design and setting: </strong>In this cross-sectional study, we included trials (regardless of intervention) registered in the EU Clinical Trials Registry and/or ClinicalTrials.gov, completed 2016-2019, and led by a university with medical faculty or university hospital in Denmark, Finland, Iceland, Norway, or Sweden. We identified summary results posted at the trial registries, and conducted systematic manual searches for results publications (e.g., journal articles, preprints). We present proportions with 95% confidence intervals (CI), and medians with interquartile range (IQR).</p><p><strong>Protocol: </strong>https://osf.io/wua3r RESULTS: Among 2,112 included clinical trials, 1,650 (78.1%, 95%CI 76.3-79.8%) reported any results during our follow-up; 1,097 (51.9%, 95%CI 49.8-54.1%) reported any results within 2 years of the global completion date; and 48 (2.3%, 95%CI 1.7-3.0%) posted summary results in the registry within 1 year. Median time from global completion date to results reporting was 690 days (IQR 1,103). 856/1,681 (50.9%) of ClinicalTrials.gov-registrations were prospective. Denmark contributed approximately half of all trials. Reporting performance varied widely between institutions.</p><p><strong>Conclusion: </strong>Missing and delayed results reporting of academically led clinical trials is a pervasive problem in the Nordic countries. We relied on trial registry information, which can be incomplete. Institutions, funders, and policy makers need to support trial teams, ensure regulation adherence, and secure trial reporting before results are permanently lost.</p>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":" ","pages":"111710"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143124071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Scoping review indicates heterogeneous methods for developing and integrating patient decision aids in the context of clinical practice guidelines.
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2025.111708
Lena Fischer, Leon Vincent Schewe, Fülöp Scheibler, Rahel Wollny, Corinna Schaefer, Torsten Karge, Thomas Langer, Jan Berghold, Ivan D Florez, Andrew Hutchinson, Sheyu Li, Marta Maes-Carballo, Zachary Munn, Lilisbeth Perestelo-Perez, Livia Puljak, Anne Stiggelbout, Dawid Pieper

Objectives: To review the methods used to develop and integrate patient decision aids (PDAs) based on the recommendations of clinical practice guidelines (CPGs).

Study design and setting: We conducted a scoping review covering bibliographic databases (PubMed, Embase; searched until December 2023), grey literature, references, and expert consultations to identify eligible documents. Documents published from 2000 onwards and describing methods related to guideline-based PDA development or linking CPGs and PDAs were included. Two reviewers independently selected and analyzed the documents. Results were synthesized and presented narratively.

Results: Based on 24 included documents, we categorized their methods into four topics. For topic (1), the selection of CPG recommendations for which PDAs are (most) needed, we found a total of 14 selection factors across n=11 documents, with uncertainty/variability in patient preferences and trade-offs between options being the most frequently mentioned. Topic (2) (n=24) covers methods for developing and/or updating guideline-based PDAs, such as forming a multidisciplinary development group, using CPGs and their evidence summaries along with other sources as the evidence base, and using digital solutions for semi-automated development and updating. Topic (3) (n=12) covers methods for PDA quality assessment and/or user testing, such as finalizing and approving the PDAs after a review and feedback process from the CPG group and an iterative user testing process. Topic (4) (n=20) covers methods for linking CPGs and PDAs, often through digital strategies.

Conclusion: We identified heterogeneous methods for developing and integrating PDAs based on CPG recommendations. Empirical testing is required to determine the most useful and practically feasible (combination of) methods. CPG organizations should focus on establishing adequate methods for linking CPG and PDA development to foster shared decision making.

{"title":"Scoping review indicates heterogeneous methods for developing and integrating patient decision aids in the context of clinical practice guidelines.","authors":"Lena Fischer, Leon Vincent Schewe, Fülöp Scheibler, Rahel Wollny, Corinna Schaefer, Torsten Karge, Thomas Langer, Jan Berghold, Ivan D Florez, Andrew Hutchinson, Sheyu Li, Marta Maes-Carballo, Zachary Munn, Lilisbeth Perestelo-Perez, Livia Puljak, Anne Stiggelbout, Dawid Pieper","doi":"10.1016/j.jclinepi.2025.111708","DOIUrl":"https://doi.org/10.1016/j.jclinepi.2025.111708","url":null,"abstract":"<p><strong>Objectives: </strong>To review the methods used to develop and integrate patient decision aids (PDAs) based on the recommendations of clinical practice guidelines (CPGs).</p><p><strong>Study design and setting: </strong>We conducted a scoping review covering bibliographic databases (PubMed, Embase; searched until December 2023), grey literature, references, and expert consultations to identify eligible documents. Documents published from 2000 onwards and describing methods related to guideline-based PDA development or linking CPGs and PDAs were included. Two reviewers independently selected and analyzed the documents. Results were synthesized and presented narratively.</p><p><strong>Results: </strong>Based on 24 included documents, we categorized their methods into four topics. For topic (1), the selection of CPG recommendations for which PDAs are (most) needed, we found a total of 14 selection factors across n=11 documents, with uncertainty/variability in patient preferences and trade-offs between options being the most frequently mentioned. Topic (2) (n=24) covers methods for developing and/or updating guideline-based PDAs, such as forming a multidisciplinary development group, using CPGs and their evidence summaries along with other sources as the evidence base, and using digital solutions for semi-automated development and updating. Topic (3) (n=12) covers methods for PDA quality assessment and/or user testing, such as finalizing and approving the PDAs after a review and feedback process from the CPG group and an iterative user testing process. Topic (4) (n=20) covers methods for linking CPGs and PDAs, often through digital strategies.</p><p><strong>Conclusion: </strong>We identified heterogeneous methods for developing and integrating PDAs based on CPG recommendations. Empirical testing is required to determine the most useful and practically feasible (combination of) methods. CPG organizations should focus on establishing adequate methods for linking CPG and PDA development to foster shared decision making.</p>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":" ","pages":"111708"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143124073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
When results from clinical trials are different from observational studies 致编辑的信 当临床试验结果不同于观察性研究时。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111573
Shi Wu Wen, Na Zeng, Daniel Krewski, Mark C. Walker
{"title":"When results from clinical trials are different from observational studies","authors":"Shi Wu Wen,&nbsp;Na Zeng,&nbsp;Daniel Krewski,&nbsp;Mark C. Walker","doi":"10.1016/j.jclinepi.2024.111573","DOIUrl":"10.1016/j.jclinepi.2024.111573","url":null,"abstract":"","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111573"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142480175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance of ICD-10-based injury severity scores in pediatric trauma patients using the ICD-AIS map and survival rate ratios 基于icd -10的损伤严重程度评分在使用ICD-AIS图和生存率的儿科创伤患者中的表现
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111634
Rayan Hojeij , Pia Brensing , Michael Nonnemacher , Bernd Kowall , Ursula Felderhoff-Müser , Marcel Dudda , Christian Dohna-Schwake , Andreas Stang , Nora Bruns

Objectives

The performance of injury severity scores (ISSs), used widely to quantify injury severity and predict outcomes, has not been investigated in German pediatric cases. This study aims to identify the most feasible and accurate injury score predictor of mortality in German children with trauma using International Classification of Diseases 10 (ICD-10).

Study Design and Setting

Between 2014 and 2020, a retrospective observational cohort study of hospital admissions cases aged <18 years with injury-related ICD-10 codes, using the German hospital database (GHD), was conducted. The maximum abbreviated injury scale and ISS were calculated using the International Classification of Diseases-Abbreviated Injury Scale (ICD-AIS) map provided by the Association for the Advancement of Automotive Medicine, adjusted to the German modification of the ICD-10 classification. The survival risk ratio was used to calculate the single-worst ICD-derived injury (single International Classification of Disease Injury Severity Score [ICISS]) and a multiplicative ICISS. Logistic regressions were conducted for each of the four above-mentioned scores (predictors) to predict in-hospital mortality (outcome) in the selected trauma population and within four clinically relevant subgroups using discrimination and calibration.

Results

1,720,802 were trauma patients, and ICD-AIS mapping was possible in 1,328,377 cases. Cases with mapping failure (n = 392,425; 22.8%) were younger and had a higher mortality rate were excluded from the performance analysis. ICISS-derived scores had a better discrimination and calibration than ICD-AIS based scores in the overall cohort and all four subgroups (area under the curve [AUC] ranges between 0.985 and 0.998 vs 0.886 and- 0.972, respectively).

Conclusion

Empirically derived measures of injury severity were superior to ICD-AIS mapped scores in the GHD to predict mortality in pediatric trauma patients. Given the high percentage of mapping failure and high mortality among cases with single-coded injury, the single ICISS may be the most suitable measure of injury severity in this group of patients.
目的:损伤严重程度评分被广泛用于量化损伤严重程度和预测结果,但在德国儿科病例中的表现尚未得到调查。本研究旨在利用《国际疾病分类 10》(ICD-10)确定德国儿童外伤死亡率最可行、最准确的损伤评分预测指标:2014 年至 2020 年期间,利用德国医院数据库(GHD)对年龄小于 18 岁、具有与损伤相关的 ICD-10 编码的入院病例进行了一项回顾性观察队列研究。使用汽车医学促进协会提供的 ICD-AIS 地图计算了最大简略损伤量表和损伤严重程度评分,并根据德国对 ICD-10 分类的修改进行了调整。生存风险比用于计算由 ICD 派生的单一最严重损伤(单一 ICISS)和乘法损伤严重程度评分(乘法 ICISS)。在选定的创伤人群和四个临床相关的亚组中,利用辨别和校准对上述四个评分(预测因子)中的每一个进行逻辑回归,以预测院内死亡率(结果):共有 1,720,802 名外伤患者,1,328,377 例可进行 ICD-AIS 映射。性能分析中排除了映射失败的病例(n = 392,425; 22.8%),这些病例年龄较小,死亡率较高。与基于 ICD-AIS 的评分相比,ICISS 得出的评分在总体队列和所有四个分组中都具有更好的区分度和校准性(AUC 范围分别为 0.985-0.998 与 0.886-0.972 之间):结论:在预测儿科创伤患者死亡率方面,根据经验得出的损伤严重程度测量值优于 ICD-AIS 映射得分。鉴于单一编码损伤病例中映射失败的比例较高且死亡率较高,单一 ICISS 可能是衡量这类患者损伤严重程度的最合适方法。
{"title":"Performance of ICD-10-based injury severity scores in pediatric trauma patients using the ICD-AIS map and survival rate ratios","authors":"Rayan Hojeij ,&nbsp;Pia Brensing ,&nbsp;Michael Nonnemacher ,&nbsp;Bernd Kowall ,&nbsp;Ursula Felderhoff-Müser ,&nbsp;Marcel Dudda ,&nbsp;Christian Dohna-Schwake ,&nbsp;Andreas Stang ,&nbsp;Nora Bruns","doi":"10.1016/j.jclinepi.2024.111634","DOIUrl":"10.1016/j.jclinepi.2024.111634","url":null,"abstract":"<div><h3>Objectives</h3><div>The performance of injury severity scores (ISSs), used widely to quantify injury severity and predict outcomes, has not been investigated in German pediatric cases. This study aims to identify the most feasible and accurate injury score predictor of mortality in German children with trauma using International Classification of Diseases 10 (ICD-10).</div></div><div><h3>Study Design and Setting</h3><div>Between 2014 and 2020, a retrospective observational cohort study of hospital admissions cases aged &lt;18 years with injury-related ICD-10 codes, using the German hospital database (GHD), was conducted. The maximum abbreviated injury scale and ISS were calculated using the International Classification of Diseases-Abbreviated Injury Scale (ICD-AIS) map provided by the Association for the Advancement of Automotive Medicine, adjusted to the German modification of the ICD-10 classification. The survival risk ratio was used to calculate the single-worst ICD-derived injury (single International Classification of Disease Injury Severity Score [ICISS]) and a multiplicative ICISS. Logistic regressions were conducted for each of the four above-mentioned scores (predictors) to predict in-hospital mortality (outcome) in the selected trauma population and within four clinically relevant subgroups using discrimination and calibration.</div></div><div><h3>Results</h3><div>1,720,802 were trauma patients, and ICD-AIS mapping was possible in 1,328,377 cases. Cases with mapping failure (<em>n</em> = 392,425; 22.8%) were younger and had a higher mortality rate were excluded from the performance analysis. ICISS-derived scores had a better discrimination and calibration than ICD-AIS based scores in the overall cohort and all four subgroups (area under the curve [AUC] ranges between 0.985 and 0.998 vs 0.886 and- 0.972, respectively).</div></div><div><h3>Conclusion</h3><div>Empirically derived measures of injury severity were superior to ICD-AIS mapped scores in the GHD to predict mortality in pediatric trauma patients. Given the high percentage of mapping failure and high mortality among cases with single-coded injury, the single ICISS may be the most suitable measure of injury severity in this group of patients.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111634"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142796472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Research culture influences in health and biomedical research: rapid scoping review and content analysis 健康和生物医学研究中的研究文化影响:快速范围审查和内容分析。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111616
Lesley Uttley , Louise Falzon , Jennifer A. Byrne , Andrea C. Tricco , Marcus R. Munafò , David Moher , Thomas Stoeger , Limbanazo Matandika , Cyril Labbé , Florian Naudet

Background

Research culture is strongly influenced by academic incentives and pressures such as the imperative to publish in academic journals, and can influence the nature and quality of the evidence we produce.

Objective

The purpose of this rapid scoping review is to capture the breadth of differential pressures and contributors to current research culture, drawing together content from empirical research specific to the health and biomedical sciences.

Study Design and Setting

PubMed and Web of Science were searched for empirical studies of influences and impacts on health and biomedical research culture, published between January 2012 and April 2024. Data charting extracted the key findings and relationships in research culture from included papers such as workforce composition; equitable access to research; academic journal trends, incentives, and reproducibility; erroneous research; questionable research practices; biases vested interests; and misconduct. A diverse author network was consulted to ensure content validity of the proposed framework of i) inclusivity, ii) transparency, iii) rigor, and iv) objectivity.

Results

A growing field of studies examining research culture exists ranging from the inclusivity of the scientific workforce, the transparency of the data generated, the rigor of the methods used and the objectivity of the researchers involved. Figurative diagrams are presented to storyboard the links between research culture content and findings.

Conclusion

The wide range of research culture influences in the recent literature indicates the need for coordinated and sustained research culture conversations. Core principles in effective research environments should include inclusive collaboration and diverse research workforces, rigorous methodological approaches, transparency, data sharing, and reflection on scientific objectivity.
背景:研究文化深受学术激励(如在学术期刊上发表论文的压力)的影响,并可能影响我们所提供证据的性质和质量:本快速范围界定综述的目的是通过收集健康和生物医学科学领域的经验研究内容,了解当前研究文化所面临的不同压力和促成因素:研究设计:我们在 PubMed 和 Web of Science 上搜索了 2012 年 1 月至 2024 年 4 月间发表的有关健康和生物医学研究文化的影响和冲击的实证研究。数据图表从收录的论文中提取了研究文化的主要发现和关系,如:劳动力构成;公平获取研究成果;学术期刊趋势、激励机制、可复制性;错误研究;有问题的研究实践;偏见既得利益和不当行为。为了确保拟议框架的内容有效性,我们咨询了不同作者的意见,包括 i) 包容性、ii) 透明度、iii) 严谨性和 iv) 客观性:越来越多的研究对科研文化进行了探讨,研究范围包括科学工作者的包容性、所生成数据的透明度、所使用方法的严谨性以及相关研究人员的客观性。本文通过形象化的图表,将研究文化内容与研究结果之间的联系故事化:最近的文献对研究文化的影响范围很广,这表明有必要开展协调、持续的研究文化对话。有效研究环境的核心原则应包括包容性合作和多元化研究队伍、严谨的方法论、透明度、数据共享以及对科学客观性的反思。
{"title":"Research culture influences in health and biomedical research: rapid scoping review and content analysis","authors":"Lesley Uttley ,&nbsp;Louise Falzon ,&nbsp;Jennifer A. Byrne ,&nbsp;Andrea C. Tricco ,&nbsp;Marcus R. Munafò ,&nbsp;David Moher ,&nbsp;Thomas Stoeger ,&nbsp;Limbanazo Matandika ,&nbsp;Cyril Labbé ,&nbsp;Florian Naudet","doi":"10.1016/j.jclinepi.2024.111616","DOIUrl":"10.1016/j.jclinepi.2024.111616","url":null,"abstract":"<div><h3>Background</h3><div>Research culture is strongly influenced by academic incentives and pressures such as the imperative to publish in academic journals, and can influence the nature and quality of the evidence we produce.</div></div><div><h3>Objective</h3><div>The purpose of this rapid scoping review is to capture the breadth of differential pressures and contributors to current research culture, drawing together content from empirical research specific to the health and biomedical sciences.</div></div><div><h3>Study Design and Setting</h3><div>PubMed and Web of Science were searched for empirical studies of influences and impacts on health and biomedical research culture, published between January 2012 and April 2024. Data charting extracted the key findings and relationships in research culture from included papers such as workforce composition; equitable access to research; academic journal trends, incentives, and reproducibility; erroneous research; questionable research practices; biases vested interests; and misconduct. A diverse author network was consulted to ensure content validity of the proposed framework of i) inclusivity, ii) transparency, iii) rigor, and iv) objectivity.</div></div><div><h3>Results</h3><div>A growing field of studies examining research culture exists ranging from the inclusivity of the scientific workforce, the transparency of the data generated, the rigor of the methods used and the objectivity of the researchers involved. Figurative diagrams are presented to storyboard the links between research culture content and findings.</div></div><div><h3>Conclusion</h3><div>The wide range of research culture influences in the recent literature indicates the need for coordinated and sustained research culture conversations. Core principles in effective research environments should include inclusive collaboration and diverse research workforces, rigorous methodological approaches, transparency, data sharing, and reflection on scientific objectivity.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111616"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142711243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A systematic review of stepped wedge cluster randomized trials in high impact journals: assessing the design, rationale, and analysis 在高影响力期刊上对阶梯楔形聚类随机试验的系统回顾:评估设计、基本原理和分析。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-02-01 DOI: 10.1016/j.jclinepi.2024.111622
Elizabeth Varghese , Anny Briola , Titouan Kennel , Abby Pooley , Richard A. Parker

Objectives

Stepped wedge cluster randomized trials (SW-CRTs) are an appealing study design because they enable sequential roll out of an intervention across clusters, bringing logistical advantages. This review aimed to evaluate the design rationale, design features, stepped wedge diagram, and analytical approaches of SW-CRTs published in high-impact medical journals from 2020 to 2023, focusing particularly on adherence to key guidelines from the Consolidated Standards of Reporting Trials extension to SW-CRTs.

Study Design and Setting

We conducted searches across PubMed and Cochrane Central Registry of Controlled Trials databases for SW-CRTs published between January 2020 and December 2023 in eight high-impact journals. Eligibility criteria included peer-reviewed publications of randomized SW-CRTs involving human participants, published in English.

Results

Of the 23 SW-CRTs included in the review, 70% had "stepped wedge" explicitly mentioned in their titles. Most studies (96%) included a stepped wedge diagram, but only 65% of these diagrams clearly communicated the duration of each time period. There was considerable variability in design features, including number of sequences (median of 7, range 3–20) and clusters (median of 15, range 9–19). The majority of trials (78%) provided robust justifications for selecting a SW-CRT design, for example, citing practical or logistical constraints. However, 22% of the studies offered less convincing rationales. Generalized linear mixed models were the most frequent analysis method employed.

Conclusion

Our review has highlighted areas for improvement in the presentation of SW-CRTs, particularly in clearly indicating the duration of time periods within diagrams and providing robust justifications for selecting a SW-CRT design.

Plain Language Summary

The stepped wedge cluster randomized trial (SW-CRT) is a type of study design that introduces interventions to different groups at different times. This review examined reports of SW-CRTs published in top medical journals from 2020 to 2023 to see if they followed certain guidelines such as including the word “stepped wedge” in their title. A total of 23 SW-CRTs were included in the review, with 70% mentioning "stepped wedge" in the title. Most (96%) included diagrams, but only 65% showed the duration of each time period clearly. There was variability in design, such as variations in the number of sequences and groups. 78% gave valid reasons for using SW-CRTs, citing practical benefits, whereas 22% did not give convincing reasons. This review suggests that improvements can be made in the presentation of stepped wedge diagrams and in the reporting of SW-CRTs. Researchers should clearly report the length of time periods and provide strong justifications for their design choice.
目的:阶梯形聚类随机试验(sw - crt)是一种有吸引力的研究设计,因为它们能够跨聚类连续推出干预措施,带来后勤优势。本综述旨在评估2020年至2023年在高影响力医学期刊上发表的sw - crt的设计原理、设计特点、阶梯楔形图和分析方法,特别关注CONSORT扩展到sw - crt的关键指南的遵守情况。研究设计和设置:我们在PubMed和Cochrane中央对照试验注册中心(Central)数据库中检索了2020年1月至2023年12月在8个高影响力期刊上发表的sw - crt。入选标准包括涉及人类参与者的随机sw - crt的同行评审出版物,以英文发表。结果:纳入本综述的23份sw - crt中,70%在标题中明确提及“楔形踏步”。大多数研究(96%)包括阶梯楔形图,但这些图中只有65%清楚地传达了每个时间段的持续时间。设计特征有相当大的可变性,包括序列数量(中位数为7,范围3-20)和聚类(中位数为15,范围9-19)。大多数试验(78%)为选择SW-CRT设计提供了强有力的理由,例如引用实际或后勤限制。然而,22%的研究提供了不那么令人信服的理由。广义线性混合模型(glmm)是最常用的分析方法。结论:我们的综述强调了在SW-CRT的展示方面需要改进的地方,特别是在图表中清楚地表明时间段的持续时间,并为选择SW-CRT设计提供了有力的理由。
{"title":"A systematic review of stepped wedge cluster randomized trials in high impact journals: assessing the design, rationale, and analysis","authors":"Elizabeth Varghese ,&nbsp;Anny Briola ,&nbsp;Titouan Kennel ,&nbsp;Abby Pooley ,&nbsp;Richard A. Parker","doi":"10.1016/j.jclinepi.2024.111622","DOIUrl":"10.1016/j.jclinepi.2024.111622","url":null,"abstract":"<div><h3>Objectives</h3><div>Stepped wedge cluster randomized trials (SW-CRTs) are an appealing study design because they enable sequential roll out of an intervention across clusters, bringing logistical advantages. This review aimed to evaluate the design rationale, design features, stepped wedge diagram, and analytical approaches of SW-CRTs published in high-impact medical journals from 2020 to 2023, focusing particularly on adherence to key guidelines from the Consolidated Standards of Reporting Trials extension to SW-CRTs.</div></div><div><h3>Study Design and Setting</h3><div>We conducted searches across PubMed and Cochrane Central Registry of Controlled Trials databases for SW-CRTs published between January 2020 and December 2023 in eight high-impact journals. Eligibility criteria included peer-reviewed publications of randomized SW-CRTs involving human participants, published in English.</div></div><div><h3>Results</h3><div>Of the 23 SW-CRTs included in the review, 70% had \"stepped wedge\" explicitly mentioned in their titles. Most studies (96%) included a stepped wedge diagram, but only 65% of these diagrams clearly communicated the duration of each time period. There was considerable variability in design features, including number of sequences (median of 7, range 3–20) and clusters (median of 15, range 9–19). The majority of trials (78%) provided robust justifications for selecting a SW-CRT design, for example, citing practical or logistical constraints. However, 22% of the studies offered less convincing rationales. Generalized linear mixed models were the most frequent analysis method employed.</div></div><div><h3>Conclusion</h3><div>Our review has highlighted areas for improvement in the presentation of SW-CRTs, particularly in clearly indicating the duration of time periods within diagrams and providing robust justifications for selecting a SW-CRT design.</div></div><div><h3>Plain Language Summary</h3><div>The stepped wedge cluster randomized trial (SW-CRT) is a type of study design that introduces interventions to different groups at different times. This review examined reports of SW-CRTs published in top medical journals from 2020 to 2023 to see if they followed certain guidelines such as including the word “stepped wedge” in their title. A total of 23 SW-CRTs were included in the review, with 70% mentioning \"stepped wedge\" in the title. Most (96%) included diagrams, but only 65% showed the duration of each time period clearly. There was variability in design, such as variations in the number of sequences and groups. 78% gave valid reasons for using SW-CRTs, citing practical benefits, whereas 22% did not give convincing reasons. This review suggests that improvements can be made in the presentation of stepped wedge diagrams and in the reporting of SW-CRTs. Researchers should clearly report the length of time periods and provide strong justifications for their design choice.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"178 ","pages":"Article 111622"},"PeriodicalIF":7.3,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142781874","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Clinical Epidemiology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1