首页 > 最新文献

Journal of Clinical Epidemiology最新文献

英文 中文
A protocol for the development of a core outcome set for adults with depression 制定成人抑郁症核心结局集(COS)的方案。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-29 DOI: 10.1016/j.jclinepi.2025.112119
C. Veal , K.R. Krause , E.I. Fried , A. Cipriani , P. Cuijpers , J. Downs , T.A. Furukawa , G. Gartlehner , S.D. Hollon , H. Levy-Soussan , G. Sahlem , A. Tomlinson , S. Touboul , P. Ravaud , V.-T. Tran , A. Chevance

Background and Objective

Heterogeneous outcome measurement limits the comparison and combination of results from randomized controlled trials and observational studies aimed at evaluating therapeutic interventions for depression. We report here the protocol for the development of a Core Outcome Set (COS) for adults with depression.

Methods

Development will follow a multistep approach with: (1) generating outcome domains that matter to people with lived experiences of depression, health care professionals, and carers through a large online international survey using open-ended questions; (2). selecting domains based on the preferences of key interest holders through an international online preference elicitation survey; and (3) identifying relevant outcome measures with measurement properties considered sufficient through several systematic reviews conducted according to COnsensus-based Standards for the selection of health Measurement INstruments standards.

Discussion

The protocol describes a proof-of-concept approach to include large numbers of individuals from all key interest holder groups in COS development, which could be replicated in other conditions and contexts.
背景:异质性结果测量限制了随机对照试验(rct)和观察性研究结果的比较和组合,这些研究旨在评估抑郁症的治疗干预措施。我们在此报告了成人抑郁症的核心结局集(COS)的发展方案。方法:开发将遵循多步骤方法,包括:1)通过使用开放式问题的大型在线国际调查,生成对有抑郁症生活经历的人、医疗保健专业人员和护理人员重要的结果域;2)通过国际在线偏好启发调查,根据关键利益相关者的偏好选择域;3)通过根据COSMIN标准进行的几次系统评价,确定具有足够测量特性的相关结果测量。讨论:该协议描述了一种概念验证方法,该方法包括COS开发中所有关键利益相关者群体的大量个人,这可以在其他条件和环境中复制。
{"title":"A protocol for the development of a core outcome set for adults with depression","authors":"C. Veal ,&nbsp;K.R. Krause ,&nbsp;E.I. Fried ,&nbsp;A. Cipriani ,&nbsp;P. Cuijpers ,&nbsp;J. Downs ,&nbsp;T.A. Furukawa ,&nbsp;G. Gartlehner ,&nbsp;S.D. Hollon ,&nbsp;H. Levy-Soussan ,&nbsp;G. Sahlem ,&nbsp;A. Tomlinson ,&nbsp;S. Touboul ,&nbsp;P. Ravaud ,&nbsp;V.-T. Tran ,&nbsp;A. Chevance","doi":"10.1016/j.jclinepi.2025.112119","DOIUrl":"10.1016/j.jclinepi.2025.112119","url":null,"abstract":"<div><h3>Background and Objective</h3><div>Heterogeneous outcome measurement limits the comparison and combination of results from randomized controlled trials and observational studies aimed at evaluating therapeutic interventions for depression. We report here the protocol for the development of a Core Outcome Set (COS) for adults with depression.</div></div><div><h3>Methods</h3><div>Development will follow a multistep approach with: (1) generating outcome domains that matter to people with lived experiences of depression, health care professionals, and carers through a large online international survey using open-ended questions; (2). selecting domains based on the preferences of key interest holders through an international online preference elicitation survey; and (3) identifying relevant outcome measures with measurement properties considered sufficient through several systematic reviews conducted according to COnsensus-based Standards for the selection of health Measurement INstruments standards.</div></div><div><h3>Discussion</h3><div>The protocol describes a proof-of-concept approach to include large numbers of individuals from all key interest holder groups in COS development, which could be replicated in other conditions and contexts.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112119"},"PeriodicalIF":5.2,"publicationDate":"2025-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An imputation study shows that missing outcome data can substantially bias pooled estimates in systematic reviews of patient-reported outcomes 一项归算研究表明,在对患者报告的结果进行系统评价时,缺失的结果数据可能会严重影响汇总估计。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-27 DOI: 10.1016/j.jclinepi.2025.112120
Yanjiao Shen , Zhengchi Li , Xianlin Gu , Yifan Yao , Sameer Parpia , Diane Heels-Ansdell , Yaping Chang , Ying Wang , Qingyang Shi , Qiukui Hao , Sepideh Mardani Jadid , Tachit Jiravichitchai , Akira Kuriyama , Zuojia Shang , Yuting Wang , Yunli Zhao , Ya Gao , Liang Du , Jin Huang , Gordon Guyatt
<div><h3>Background and Objectives</h3><div>Missing outcome data (hereafter referred to as “missing data,” typically due to loss to follow-up) is a major problem in randomized controlled trials (RCTs) and systematic reviews of RCTs. While prior work has examined the impact of missing binary outcomes, the influence of missing continuous patient-reported outcome measures (PROMs) on pooled effect estimates remains poorly understood. We therefore assessed the risk of bias introduced by missing data in systematic reviews of PROMs.</div></div><div><h3>Study Design and Setting</h3><div>We selected a representative sample of 100 systematic reviews that included meta-analyses reporting a statistically significant effect on a continuous patient-reported efficacy outcome. We applied four increasingly stringent imputation strategies based on the grading of recommendations assessment, development, and evaluation (GRADE) approach, along with three alternative approaches for handling studies in which investigators had already imputed results for missing data. We also conducted Firth logistic regression analyses to identify factors associated with crossing the null after imputation.</div></div><div><h3>Results</h3><div>Results from 100 systematic reviews that included 1298 RCTs proved similar across all three approaches to addressing imputed data. Using the least stringent strategy for imputing missing data, the percentage of meta-analyses in which the 95% CI crossed the null proved under 4%. Applying the next most stringent strategy, the percentage of CIs that crossed the null increased to 47.9%. Percentages crossing the null increased only marginally for the two most stringent approaches, crossing up to 53.1% in the next most stringent and 54.2% in the most stringent. Firth logistic regression identified two significant predictors of crossing the null after imputation: a higher average missing data (odds ratio [OR] 1.23, 95% CI: 1.11–1.43 per 1% increase in missing data) and a larger magnitude of the treatment effect, which was associated with lower odds of crossing the null (OR 0.70, 95% CI: 0.39–0.91 per 1 standardized mean difference increase). Neither database type (Cochrane vs. non-Cochrane) nor duration of follow-up proved associated with CI crossing the null.</div></div><div><h3>Conclusion</h3><div>A plausible imputation approach to test the potential risk of bias as a result of missing data in studies addressing treatment effects on PROMs resulted in 95% CIs in a high proportion of studies initially suggesting benefit crossing the null. The greater the proportion of missing data and the smaller the treatment effect, the more likely the CI crossed the null. Systematic review authors may consider formally testing the robustness of their results with respect to missing data.</div></div><div><h3>Plain Language Summary</h3><div>When studies included in a systematic review have missing outcome data, the study results may be biased and therefore misleading. I
目的:结局数据缺失(以下简称“数据缺失”,通常是由于随访丢失)是随机对照试验(RCTs)和随机对照试验的系统评价的主要问题。虽然先前的工作已经检查了缺失的二元结果的影响,但缺失的连续患者报告结果(PROMs)对汇总效应估计的影响仍然知之甚少。因此,我们评估了prom系统评价中缺失数据带来的偏倚风险。研究设计和设置:我们选择了100个系统评价的代表性样本,包括荟萃分析,这些荟萃分析报告了对患者报告的连续疗效结果的统计显着影响。我们在GRADE方法的基础上应用了四种越来越严格的归因策略,以及三种替代方法来处理研究者已经为缺失数据归因结果的研究。我们还进行了第二次逻辑回归分析,以确定与代入后跨越零相关的因素。结果:包括1298项随机对照试验在内的100项系统评价的结果证明,三种处理输入数据的方法相似。使用最不严格的策略来输入缺失数据,95%置信区间(CI)超过零值的元分析百分比证明低于4%。应用下一个最严格的策略,越过null的ci百分比增加到47.9%。在两种最严格的方法中,跨越零值的百分比仅略有增加,在第二严格的方法中跨越53.1%,在最严格的方法中跨越54.2%。第四,逻辑回归确定了两个重要的预测因子:较高的平均缺失数据(缺失数据每增加1%,OR为1.23,95% CI: 1.11-1.43)和较大的治疗效果,这与较低的跨越零值的几率相关(OR为0.70,95% CI: 0.39-0.91)。数据库类型(Cochrane与非Cochrane)和随访时间均未证明与CI跨越零相关。结论:一种合理的方法来测试潜在的偏倚风险,这是由于研究中关于PROMs治疗效果的数据缺失造成的,在高比例的研究中,95%的ci最初表明获益跨越零值。缺失数据的比例越大,治疗效果越小,CI越有可能越过零值。系统综述作者可以考虑对缺失数据进行正式的稳健性测试。简单的语言总结:当纳入系统评价的研究缺少结果数据时,研究结果可能有偏倚,因此具有误导性。如果没有太多丢失的数据,这不是一个问题。如果有很多丢失的数据,这可能是一个大问题。研究人员提出了一些方法来强调数据缺失所代表的问题的严重程度。本研究比较了在测量患者经历的连续结果(我们称之为患者报告的结果)中处理缺失数据的四种方法。我们发现,评估系统评价和荟萃分析中缺失数据可能造成的偏倚的合理方法往往会突出实质性问题,并表明在系统评价中可能需要更谨慎的结论。这些发现强调了在解释系统评价结果时充分考虑缺失数据量的重要性。
{"title":"An imputation study shows that missing outcome data can substantially bias pooled estimates in systematic reviews of patient-reported outcomes","authors":"Yanjiao Shen ,&nbsp;Zhengchi Li ,&nbsp;Xianlin Gu ,&nbsp;Yifan Yao ,&nbsp;Sameer Parpia ,&nbsp;Diane Heels-Ansdell ,&nbsp;Yaping Chang ,&nbsp;Ying Wang ,&nbsp;Qingyang Shi ,&nbsp;Qiukui Hao ,&nbsp;Sepideh Mardani Jadid ,&nbsp;Tachit Jiravichitchai ,&nbsp;Akira Kuriyama ,&nbsp;Zuojia Shang ,&nbsp;Yuting Wang ,&nbsp;Yunli Zhao ,&nbsp;Ya Gao ,&nbsp;Liang Du ,&nbsp;Jin Huang ,&nbsp;Gordon Guyatt","doi":"10.1016/j.jclinepi.2025.112120","DOIUrl":"10.1016/j.jclinepi.2025.112120","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Background and Objectives&lt;/h3&gt;&lt;div&gt;Missing outcome data (hereafter referred to as “missing data,” typically due to loss to follow-up) is a major problem in randomized controlled trials (RCTs) and systematic reviews of RCTs. While prior work has examined the impact of missing binary outcomes, the influence of missing continuous patient-reported outcome measures (PROMs) on pooled effect estimates remains poorly understood. We therefore assessed the risk of bias introduced by missing data in systematic reviews of PROMs.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;We selected a representative sample of 100 systematic reviews that included meta-analyses reporting a statistically significant effect on a continuous patient-reported efficacy outcome. We applied four increasingly stringent imputation strategies based on the grading of recommendations assessment, development, and evaluation (GRADE) approach, along with three alternative approaches for handling studies in which investigators had already imputed results for missing data. We also conducted Firth logistic regression analyses to identify factors associated with crossing the null after imputation.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;Results from 100 systematic reviews that included 1298 RCTs proved similar across all three approaches to addressing imputed data. Using the least stringent strategy for imputing missing data, the percentage of meta-analyses in which the 95% CI crossed the null proved under 4%. Applying the next most stringent strategy, the percentage of CIs that crossed the null increased to 47.9%. Percentages crossing the null increased only marginally for the two most stringent approaches, crossing up to 53.1% in the next most stringent and 54.2% in the most stringent. Firth logistic regression identified two significant predictors of crossing the null after imputation: a higher average missing data (odds ratio [OR] 1.23, 95% CI: 1.11–1.43 per 1% increase in missing data) and a larger magnitude of the treatment effect, which was associated with lower odds of crossing the null (OR 0.70, 95% CI: 0.39–0.91 per 1 standardized mean difference increase). Neither database type (Cochrane vs. non-Cochrane) nor duration of follow-up proved associated with CI crossing the null.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;A plausible imputation approach to test the potential risk of bias as a result of missing data in studies addressing treatment effects on PROMs resulted in 95% CIs in a high proportion of studies initially suggesting benefit crossing the null. The greater the proportion of missing data and the smaller the treatment effect, the more likely the CI crossed the null. Systematic review authors may consider formally testing the robustness of their results with respect to missing data.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Plain Language Summary&lt;/h3&gt;&lt;div&gt;When studies included in a systematic review have missing outcome data, the study results may be biased and therefore misleading. I","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112120"},"PeriodicalIF":5.2,"publicationDate":"2025-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145858961","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Defining survival epidemiology: postdiagnosis population science for people living with disease 定义生存流行病学:疾病患者的诊断后人口科学。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-27 DOI: 10.1016/j.jclinepi.2025.112122
Raphael E. Cuomo

Objectives

Epidemiology is largely organized to explain who becomes ill, yet many clinical and public health decisions occur after diagnosis. I introduce and formally define survival epidemiology as a new branch of science focused on assessing how people live longer and better with established disease, and I provide justification that prevention estimates should not be assumed to apply postdiagnosis.

Study Design and Setting

Conceptual and methodological commentary synthesizing evidence across cardiovascular, renal, oncologic, pulmonary, and hepatic conditions and integrating causal-inference and time-to-event principles for postdiagnosis questions.

Results

Across diseases, associations measured for incidence often fail to reproduce, and sometimes reverse, among patients with established disease. Diagnosis acts as a causal threshold that changes time scales and bias structures, including conditioning on disease (collider stratification), time-dependent confounding, immortal time bias, and reverse causation. Credible postdiagnosis inference requires designs that emulate randomized trials; explicit alignment of time zero with clinical decision points; strategies defined as used in practice; and handling of competing risks, multistate transitions, and longitudinal biomarkers (including joint models when appropriate). Essential postdiagnosis data include stage, molecular subtype, prior therapy lines, dose intensity and modifications, adverse events, performance status, and patient-reported outcomes. Recommended practice is parallel estimation of prevention and postdiagnosis survival effects for the same exposure–disease pairs and routine reporting of heterogeneity by stage, subtype, treatment pathway, and time since diagnosis.

Conclusion

Prevention and postdiagnosis survival are distinct inferential targets. Journals should require clarity on whether claims pertain to prevention or survival and report target-trial elements; guideline bodies should distinguish prevention from survival recommendations when evidence allows; and funders, training programs, and public communication should support survival-focused methods, data standards, and context-specific messaging for people living with disease.
流行病学在很大程度上是为了解释谁会生病,但许多临床和公共卫生决定是在诊断后做出的。这篇文章提出了一个以生存为重点的流行病学分支,作为一个概念和方法的保护伞,研究人们如何在疾病中活得更长、更好,并认为不应该假设对疾病预防的估计适用于诊断后状态。目的是定义这一分支的范围,确定可靠的诊断后推断的方法和数据要求,并概述对研究、指导和交流的实际影响。心血管、肾脏、肿瘤、肺部和肝脏疾病的证据表明,在已有疾病的患者中,测量发病率的关联往往无法重现,有时甚至可能逆转。诊断作为一个因果阈值,引入了不同的偏差和时间尺度,包括对疾病的选择(对撞机分层)、时间依赖的混淆、不朽的时间偏差和反向因果关系。因此,可信的分析需要模拟随机试验的设计,明确地将时间零点与临床决策保持一致,在实践中定义策略,并通过联合建模适当处理竞争风险、多状态转换和纵向生物标志物。在一般队列中很少获得的数据在诊断后是必不可少的,包括疾病分期、分子亚型、先前的治疗线、剂量强度、不良事件、表现状态和患者报告的结果。主要建议是对相同的暴露-疾病对并行估计预防和诊断后生存效果,报告分期、亚型、治疗途径和诊断后时间的效果异质性,并使报告与临床决策点保持一致。主要结论是,期刊应该期望作者明确声明是与预防有关还是与生存有关,并报告目标试验要素;在证据允许的情况下,指南机构应分别区分预防和生存问题,而不是跨州推断;资助者和培训项目应优先考虑针对诊断后推断的方法和数据标准,包括以生存为重点的课程和报告指导;公共沟通应该以精心设计的、由临床医生介导的信息来反映这种分歧,避免过度简化的叙述,以便疾病患者获得准确的、针对具体情况的建议。围绕诊断后现实调整方法、数据和指导可以提高治疗耐受性、功能结果和临床咨询的清晰度。
{"title":"Defining survival epidemiology: postdiagnosis population science for people living with disease","authors":"Raphael E. Cuomo","doi":"10.1016/j.jclinepi.2025.112122","DOIUrl":"10.1016/j.jclinepi.2025.112122","url":null,"abstract":"<div><h3>Objectives</h3><div>Epidemiology is largely organized to explain who becomes ill, yet many clinical and public health decisions occur after diagnosis. I introduce and formally define survival epidemiology as a new branch of science focused on assessing how people live longer and better with established disease, and I provide justification that prevention estimates should not be assumed to apply postdiagnosis.</div></div><div><h3>Study Design and Setting</h3><div>Conceptual and methodological commentary synthesizing evidence across cardiovascular, renal, oncologic, pulmonary, and hepatic conditions and integrating causal-inference and time-to-event principles for postdiagnosis questions.</div></div><div><h3>Results</h3><div>Across diseases, associations measured for incidence often fail to reproduce, and sometimes reverse, among patients with established disease. Diagnosis acts as a causal threshold that changes time scales and bias structures, including conditioning on disease (collider stratification), time-dependent confounding, immortal time bias, and reverse causation. Credible postdiagnosis inference requires designs that emulate randomized trials; explicit alignment of time zero with clinical decision points; strategies defined as used in practice; and handling of competing risks, multistate transitions, and longitudinal biomarkers (including joint models when appropriate). Essential postdiagnosis data include stage, molecular subtype, prior therapy lines, dose intensity and modifications, adverse events, performance status, and patient-reported outcomes. Recommended practice is parallel estimation of prevention and postdiagnosis survival effects for the same exposure–disease pairs and routine reporting of heterogeneity by stage, subtype, treatment pathway, and time since diagnosis.</div></div><div><h3>Conclusion</h3><div>Prevention and postdiagnosis survival are distinct inferential targets. Journals should require clarity on whether claims pertain to prevention or survival and report target-trial elements; guideline bodies should distinguish prevention from survival recommendations when evidence allows; and funders, training programs, and public communication should support survival-focused methods, data standards, and context-specific messaging for people living with disease.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112122"},"PeriodicalIF":5.2,"publicationDate":"2025-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145859002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Systematic reviews of quasi-experimental studies: challenges and considerations 准实验研究的系统回顾:挑战和考虑。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-27 DOI: 10.1016/j.jclinepi.2025.112121
Sarah B. Windle , Sam Harper , Jasleen Arneja , Peter Socha , Arijit Nandi

Background

In contrast to other observational study designs, quasi-experimental approaches (eg, difference-in-differences, interrupted time series, regression discontinuity, instrumental variable, synthetic control) account for some sources of unmeasured confounding and can estimate causal effects under weaker assumptions. Studies which apply quasi-experimental approaches have increased in popularity in recent decades, therefore investigators conducting systematic reviews of observational studies, particularly in biomedical, public health, or epidemiologic content areas, must be prepared to encounter and appropriately assess these approaches.

Objective

Our objective is to describe key methodological challenges and considerations for systematic reviews including quasi-experimental studies, with attention to current recommendations and approaches which have been applied in previous reviews.

Conclusion

Recommendations for authors of systematic reviews: We recommend that individuals conducting systematic reviews including quasi-experimental studies: (1) search a broad range of bibliographic databases and gray literature, including preprint repositories; (2) do not use search strategies which require specific terms for study design for identification, given inconsistent nomenclature and poor database indexing for quasi-experimental studies; (3) ensure that their review team includes several individuals with expertise in quasi-experimental designs for screening and risk of bias assessment in duplicate; (4) use an approach to risk of bias assessment which is sufficiently granular to identify studies most likely to report unbiased estimates of causal effects (eg, modified Risk Of Bias In Nonrandomized Studies - of Interventions); and (5) consider the implications of varied estimands when interpreting estimates from different quasi-experimental designs. Researchers may also consider restricting systematic review inclusion to quasi-experimental studies for feasibility when addressing research questions with large bodies of literature. However, a more inclusive approach is preferred, as well-designed studies using a variety of methodological approaches may be more credible than a quasi-experiment which violates causal assumptions.
Recommendations for the research community: Many of the challenges faced in conducting systematic reviews of quasi-experimental studies would be ameliorated by improved consistency in nomenclature, as well as greater transparency from authors in describing their research designs. The broader community (eg, research networks, journals) should consider the creation and implementation of reporting standards and protocol registration for quasi-experimental studies to improve study identification in systematic reviews.
背景:与其他观察性研究设计相比,准实验方法(如差中差、中断时间序列、回归不连续、工具变量、综合控制)解释了一些无法测量的混杂来源,并可以在较弱的假设下估计因果效应。近几十年来,应用准实验方法的研究越来越受欢迎,因此,对观察性研究进行系统评价的研究人员,特别是在生物医学、公共卫生或流行病学内容领域,必须准备好遇到并适当评估这些方法。目的:我们的目标是描述包括准实验研究在内的系统评价的关键方法挑战和考虑因素,并注意在以前的评价中应用的当前建议和方法。对系统评价作者的建议:我们建议个人进行包括准实验研究在内的系统评价:1)搜索广泛的书目数据库和灰色文献,包括预印本库;2)考虑到准实验研究的不一致的命名法和较差的数据库索引,不使用需要特定术语的研究设计来识别的搜索策略;3)确保其评审团队包括几名具有准实验设计筛选和风险偏倚评估专业知识的人员,一式两份;4)使用足够细粒度的偏倚风险评估方法,以确定最有可能报告因果效应无偏估计的研究(例如,修改的非随机研究中的偏倚风险-干预[ROBINS-I]);5)在解释来自不同准实验设计的估计时,考虑不同估计的含义。研究人员还可以考虑将系统评价纳入准实验研究,以解决大量文献的研究问题。然而,更包容的方法是首选,因为使用各种方法学方法的精心设计的研究可能比违反因果假设的准实验更可信。对研究界的建议:在对准实验研究进行系统评价时所面临的许多挑战将通过改进命名法的一致性以及作者在描述其研究设计时更大的透明度得到改善。更广泛的社区(如研究网络、期刊)应该考虑创建和实施准实验研究的报告标准和方案注册,以提高系统评价中的研究识别。
{"title":"Systematic reviews of quasi-experimental studies: challenges and considerations","authors":"Sarah B. Windle ,&nbsp;Sam Harper ,&nbsp;Jasleen Arneja ,&nbsp;Peter Socha ,&nbsp;Arijit Nandi","doi":"10.1016/j.jclinepi.2025.112121","DOIUrl":"10.1016/j.jclinepi.2025.112121","url":null,"abstract":"<div><h3>Background</h3><div>In contrast to other observational study designs, quasi-experimental approaches (eg, difference-in-differences, interrupted time series, regression discontinuity, instrumental variable, synthetic control) account for some sources of unmeasured confounding and can estimate causal effects under weaker assumptions. Studies which apply quasi-experimental approaches have increased in popularity in recent decades, therefore investigators conducting systematic reviews of observational studies, particularly in biomedical, public health, or epidemiologic content areas, must be prepared to encounter and appropriately assess these approaches.</div></div><div><h3>Objective</h3><div>Our objective is to describe key methodological challenges and considerations for systematic reviews including quasi-experimental studies, with attention to current recommendations and approaches which have been applied in previous reviews.</div></div><div><h3>Conclusion</h3><div><em>Recommendations for authors of systematic reviews:</em> We recommend that individuals conducting systematic reviews including quasi-experimental studies: (1) search a broad range of bibliographic databases and gray literature, including preprint repositories; (2) do not use search strategies which require specific terms for study design for identification, given inconsistent nomenclature and poor database indexing for quasi-experimental studies; (3) ensure that their review team includes several individuals with expertise in quasi-experimental designs for screening and risk of bias assessment in duplicate; (4) use an approach to risk of bias assessment which is sufficiently granular to identify studies most likely to report unbiased estimates of causal effects (eg, modified Risk Of Bias In Nonrandomized Studies - of Interventions); and (5) consider the implications of varied estimands when interpreting estimates from different quasi-experimental designs. Researchers may also consider restricting systematic review inclusion to quasi-experimental studies for feasibility when addressing research questions with large bodies of literature. However, a more inclusive approach is preferred, as well-designed studies using a variety of methodological approaches may be more credible than a quasi-experiment which violates causal assumptions.</div><div><em>Recommendations for the research community:</em> Many of the challenges faced in conducting systematic reviews of quasi-experimental studies would be ameliorated by improved consistency in nomenclature, as well as greater transparency from authors in describing their research designs. The broader community (eg, research networks, journals) should consider the creation and implementation of reporting standards and protocol registration for quasi-experimental studies to improve study identification in systematic reviews.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112121"},"PeriodicalIF":5.2,"publicationDate":"2025-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145858997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Corrigendum to "Impact of active placebo controls on estimated drug effects in randomized trials: a meta-epidemiological study" [Journal of Clinical Epidemiology 188 (2025) 111998]. “随机试验中有效安慰剂对照对估计药物效应的影响:一项荟萃流行病学研究”的更正[临床流行病学杂志188(2025)111998]。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-26 DOI: 10.1016/j.jclinepi.2025.112091
David Ruben Teindl Laursen, Mihaela Ivosevic Broager, Mathias Weis Damkjær, Andreas Halgreen Eiset, Mia Elkjær, Erlend Faltinsen, Ingrid Rose MacLean-Nyegaard, Camilla Hansen Nejstgaard, Asger Sand Paludan-Müller, Lasse Adrup Benné Petersen, Søren Viborg Vestergaard, Asbjørn Hróbjartsson
{"title":"Corrigendum to \"Impact of active placebo controls on estimated drug effects in randomized trials: a meta-epidemiological study\" [Journal of Clinical Epidemiology 188 (2025) 111998].","authors":"David Ruben Teindl Laursen, Mihaela Ivosevic Broager, Mathias Weis Damkjær, Andreas Halgreen Eiset, Mia Elkjær, Erlend Faltinsen, Ingrid Rose MacLean-Nyegaard, Camilla Hansen Nejstgaard, Asger Sand Paludan-Müller, Lasse Adrup Benné Petersen, Søren Viborg Vestergaard, Asbjørn Hróbjartsson","doi":"10.1016/j.jclinepi.2025.112091","DOIUrl":"https://doi.org/10.1016/j.jclinepi.2025.112091","url":null,"abstract":"","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":" ","pages":"112091"},"PeriodicalIF":5.2,"publicationDate":"2025-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145846980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adherence to TRIPOD+AI guideline: an updated reporting assessment tool 遵守TRIPOD+AI指南:更新的报告评估工具。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-23 DOI: 10.1016/j.jclinepi.2025.112118
Emilie de Kanter , Tabea Kaul , Pauline Heus , Tom M. de Groot , René Harmen Kuijten , Johannes B. Reitsma , Gary S. Collins , Lotty Hooft , Karel G.M. Moons , Johanna A.A. Damen
<div><h3>Objectives</h3><div>Incomplete reporting of research limits its usefulness and contributes to research waste. Numerous reporting guidelines have been developed to support complete and accurate reporting of health-care research studies. Completeness of reporting can be measured by evaluating the adherence to reporting guidelines. However, assessing adherence to a reporting guideline often lacks uniformity. In 2019, we developed a reporting adherence tool for the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement. With recent advances in regression and artificial intelligence (AI)/machine learning (ML)–based methods, TRIPOD + AI (<span><span>www.tripod-statment.org</span><svg><path></path></svg></span>) was developed to replace the TRIPOD statement. The aim of this study was to develop an updated adherence tool for TRIPOD + AI.</div></div><div><h3>Study Design and Setting</h3><div>Based on the TRIPOD + AI full reporting guideline, including the accompanying explanation and elaboration light, and TRIPOD + AI for abstracts, we updated and expanded the original TRIPOD adherence tool and refined the adherence elements and their scoring rules through discussions within the author team and a pilot test.</div></div><div><h3>Results</h3><div>The updated tool comprises of 37 main items and 136 adherence elements and includes several automated scoring rules. We developed separate TRIPOD + AI adherence tools for model development, model evaluation, and for studies describing both in a single paper.</div></div><div><h3>Conclusion</h3><div>A uniform approach to assessing reporting adherence of TRIPOD + AI allows for comparisons across various fields, monitor reporting over time, and incentivizes primary study authors to comply.</div></div><div><h3>Plain Language Summary</h3><div>Accurate and complete reporting is crucial in biomedical research to ensure findings can be effectively used. To support researchers in reporting their findings well, reporting guidelines have been developed for different study types. One such guideline is TRIPOD, which focuses on research studies about medical prediction tools. In 2024, TRIPOD was updated to TRIPOD + AI to address the increasing use of AI and ML in prediction model studies. In 2019, we developed a scoring system to evaluate how well research papers on prediction tools adhered to the TRIPOD guideline, resulting in a reporting completeness score. This score allows for easier comparison of reporting completeness across various medical fields, and to monitor improvement in reporting over time. With the introduction of TRIPOD + AI, an update of the scoring system was required to align with the new reporting recommendations. We achieved this by reviewing our previous scoring system and incorporating the new items from TRIPOD + AI to better suit studies involving AI. We believe that this system will facilitate comparisons of prediction model reporting co
目的:不完整的研究报告限制了研究的有效性,并造成研究浪费。已经制定了许多报告指南,以支持完整和准确的医疗保健研究报告。报告的完整性可以通过评估对报告准则的遵守来衡量。然而,评估对报告准则的遵守情况往往缺乏一致性。2019年,我们开发了一种报告依从性工具,用于透明报告个体预后或诊断的多变量预测模型(TRIPOD)声明。随着回归和基于人工智能(AI)/机器学习(ML)方法的最新进展,TRIPOD+AI (www.tripod-statment.org)被开发来取代TRIPOD声明。本研究的目的是为TRIPOD+AI开发一种更新的依从性工具。研究设计和设置:基于TRIPOD+AI完整报告指南,包括随附的解释和阐述灯,以及TRIPOD+AI摘要,我们更新和扩展了原始的TRIPOD依从性工具,并通过作者团队内部的讨论和试点测试完善了依从性元素及其评分规则。结果:更新后的工具包括37个主要项目和136个遵守要素,并包括几个自动评分规则。我们开发了独立的TRIPOD+AI粘附工具,用于模型开发、模型评估以及在一篇论文中描述两者的研究。结论:评估TRIPOD+AI报告依从性的统一方法允许在不同领域进行比较,长期监测报告,并激励主要研究作者遵守。简明扼要:简明扼要:准确和完整的报告在生物医学研究中是至关重要的,以确保研究结果可以有效地使用。为了支持研究人员很好地报告他们的发现,已经为不同的研究类型制定了报告指南。其中一个指南是TRIPOD(透明报告个体预后或诊断的多变量预测模型),它侧重于医学预测工具的研究。2024年,TRIPOD更新为TRIPOD+AI,以解决人工智能和机器学习在预测模型研究中的日益增长的应用。2019年,我们开发了一个评分系统来评估关于预测工具的研究论文遵守TRIPOD指南的程度,从而得出报告完整性评分。这个分数可以更容易地比较不同医疗领域的报告完整性,并监测报告在一段时间内的改进。随着TRIPOD+AI的引入,需要更新评分系统以与新的报告建议保持一致。我们通过审查之前的评分系统,并将TRIPOD+AI的新项目纳入其中,以更好地适应涉及AI的研究,从而实现了这一目标。我们相信该系统将促进不同领域预测模型报告完整性的比较,并鼓励改进报告实践。
{"title":"Adherence to TRIPOD+AI guideline: an updated reporting assessment tool","authors":"Emilie de Kanter ,&nbsp;Tabea Kaul ,&nbsp;Pauline Heus ,&nbsp;Tom M. de Groot ,&nbsp;René Harmen Kuijten ,&nbsp;Johannes B. Reitsma ,&nbsp;Gary S. Collins ,&nbsp;Lotty Hooft ,&nbsp;Karel G.M. Moons ,&nbsp;Johanna A.A. Damen","doi":"10.1016/j.jclinepi.2025.112118","DOIUrl":"10.1016/j.jclinepi.2025.112118","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Objectives&lt;/h3&gt;&lt;div&gt;Incomplete reporting of research limits its usefulness and contributes to research waste. Numerous reporting guidelines have been developed to support complete and accurate reporting of health-care research studies. Completeness of reporting can be measured by evaluating the adherence to reporting guidelines. However, assessing adherence to a reporting guideline often lacks uniformity. In 2019, we developed a reporting adherence tool for the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement. With recent advances in regression and artificial intelligence (AI)/machine learning (ML)–based methods, TRIPOD + AI (&lt;span&gt;&lt;span&gt;www.tripod-statment.org&lt;/span&gt;&lt;svg&gt;&lt;path&gt;&lt;/path&gt;&lt;/svg&gt;&lt;/span&gt;) was developed to replace the TRIPOD statement. The aim of this study was to develop an updated adherence tool for TRIPOD + AI.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;Based on the TRIPOD + AI full reporting guideline, including the accompanying explanation and elaboration light, and TRIPOD + AI for abstracts, we updated and expanded the original TRIPOD adherence tool and refined the adherence elements and their scoring rules through discussions within the author team and a pilot test.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;The updated tool comprises of 37 main items and 136 adherence elements and includes several automated scoring rules. We developed separate TRIPOD + AI adherence tools for model development, model evaluation, and for studies describing both in a single paper.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;A uniform approach to assessing reporting adherence of TRIPOD + AI allows for comparisons across various fields, monitor reporting over time, and incentivizes primary study authors to comply.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Plain Language Summary&lt;/h3&gt;&lt;div&gt;Accurate and complete reporting is crucial in biomedical research to ensure findings can be effectively used. To support researchers in reporting their findings well, reporting guidelines have been developed for different study types. One such guideline is TRIPOD, which focuses on research studies about medical prediction tools. In 2024, TRIPOD was updated to TRIPOD + AI to address the increasing use of AI and ML in prediction model studies. In 2019, we developed a scoring system to evaluate how well research papers on prediction tools adhered to the TRIPOD guideline, resulting in a reporting completeness score. This score allows for easier comparison of reporting completeness across various medical fields, and to monitor improvement in reporting over time. With the introduction of TRIPOD + AI, an update of the scoring system was required to align with the new reporting recommendations. We achieved this by reviewing our previous scoring system and incorporating the new items from TRIPOD + AI to better suit studies involving AI. We believe that this system will facilitate comparisons of prediction model reporting co","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112118"},"PeriodicalIF":5.2,"publicationDate":"2025-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145835262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The interplay between PROM score distributions and treatment effect detection likelihood in randomized controlled trials–a metaepidemiologic study 随机对照试验中PROM评分分布与治疗效果检测可能性的相互作用-一项荟萃流行病学研究。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-19 DOI: 10.1016/j.jclinepi.2025.112114
Valtteri Panula , Antti Saarinen , Matias Vaajala , Rasmus Liukkonen , Oskari Pakarinen , Juho Laaksonen , Ville Ponkilainen , Ilari Kuitunen , Mikko Uimonen

Objectives

We hypothesized that, in musculoskeletal randomized controlled trials (RCTs) using patient-reported outcome measures (PROMs), higher baseline scores and the clustering of follow-up scores near the upper bound (ie, ceiling effect) compress variability and attenuate measurable between-group differences, thereby lowering the likelihood of observing a statistically significant effect. We therefore examined how score distributions at pretreatment and follow-up influence the likelihood of detecting between-group differences.

Study Design and Setting

We conducted a metaepidemiologic study of RCTs, published between 2015 and 2024, that compared treatment effects on musculoskeletal disorders between two study groups using PROMs. The observed distributions of the PROM scores at baseline and follow-up were collected from the included studies. All PROM scores were rescaled to 0-100 with higher scores indicating better health. The likelihood of observing a statistically significant difference in PROM scores between the study groups was examined by calculating the score difference required to achieve a P value <.05.

Results

A total of 255 RCTs were included. PROM scores improved from baseline to follow-up in most studies (98%), with a mean change of +28 points. The correlation coefficient between the mean baseline score and mean score change was −0.66 (95% CI -0.72 to −0.59) indicating that higher baseline scores were associated with lower score change. In addition, there was a moderate correlation between the mean and SD of PROM scores at follow-up (−0.39; 95% CI -0.48 to −0.28). The mean likelihood of detecting a difference was 65% (SD 11%) at baseline and 65% (SD 11%) at follow-up. The likelihood reached the 80% benchmark in only 8.5% and 8.1% of the studies at baseline and follow-up, respectively.

Conclusion

The concentration of PROM score distributions toward the high end of the scale, especially when higher baseline scores are present, diminishes the likelihood of detecting significant differences between study groups, particularly at follow-up assessments in studies analyzing musculoskeletal complaints. This underscores the importance of critically evaluating the conclusions drawn from these studies.
目的:我们假设,在使用PROMs的肌肉骨骼随机对照试验中,较高的基线评分和接近上限的随访评分聚类(即天花板效应)压缩了可变性,减弱了可测量的组间差异,从而降低了观察到统计学显著效应的可能性。因此,我们研究了治疗前和随访时的评分分布如何影响检测组间差异的可能性。研究设计和背景:我们对2015年至2024年间发表的随机对照试验进行了荟萃流行病学研究,比较了两个使用PROMs的研究组对肌肉骨骼疾病的治疗效果。从纳入的研究中收集了基线和随访时观察到的PROM分数分布。所有PROM分数重新调整为0-100分,分数越高表示健康状况越好。通过计算达到p值< 0.05所需的评分差异来检验观察到研究组之间PROM评分有统计学意义差异的可能性。结果:共纳入255项rct。大多数研究(98%)的PROM评分从基线到随访有所改善,平均变化为+28分。平均基线评分与平均评分变化之间的相关系数为-0.66 (95% CI -0.72 - -0.59),表明较高的基线评分与较低的评分变化相关。此外,随访时PROM评分的平均值和SD之间存在中等相关性(-0.39;95% CI -0.48 - -0.28)。检测差异的平均可能性在基线时为65% (SD 11%),在随访时为65% (SD 11%)。在基线和随访时,分别只有8.5%和8.1%的研究的可能性达到80%的基准。结论:PROM分数向量表高端分布的浓度,特别是当较高的基线分数存在时,降低了发现研究组之间显著差异的可能性,特别是在分析肌肉骨骼疾病的研究的随访评估中。这强调了批判性地评估从这些研究中得出的结论的重要性。
{"title":"The interplay between PROM score distributions and treatment effect detection likelihood in randomized controlled trials–a metaepidemiologic study","authors":"Valtteri Panula ,&nbsp;Antti Saarinen ,&nbsp;Matias Vaajala ,&nbsp;Rasmus Liukkonen ,&nbsp;Oskari Pakarinen ,&nbsp;Juho Laaksonen ,&nbsp;Ville Ponkilainen ,&nbsp;Ilari Kuitunen ,&nbsp;Mikko Uimonen","doi":"10.1016/j.jclinepi.2025.112114","DOIUrl":"10.1016/j.jclinepi.2025.112114","url":null,"abstract":"<div><h3>Objectives</h3><div>We hypothesized that, in musculoskeletal randomized controlled trials (RCTs) using patient-reported outcome measures (PROMs), higher baseline scores and the clustering of follow-up scores near the upper bound (ie, ceiling effect) compress variability and attenuate measurable between-group differences, thereby lowering the likelihood of observing a statistically significant effect. We therefore examined how score distributions at pretreatment and follow-up influence the likelihood of detecting between-group differences.</div></div><div><h3>Study Design and Setting</h3><div>We conducted a metaepidemiologic study of RCTs, published between 2015 and 2024, that compared treatment effects on musculoskeletal disorders between two study groups using PROMs. The observed distributions of the PROM scores at baseline and follow-up were collected from the included studies. All PROM scores were rescaled to 0-100 with higher scores indicating better health. The likelihood of observing a statistically significant difference in PROM scores between the study groups was examined by calculating the score difference required to achieve a <em>P</em> value &lt;.05.</div></div><div><h3>Results</h3><div>A total of 255 RCTs were included. PROM scores improved from baseline to follow-up in most studies (98%), with a mean change of +28 points. The correlation coefficient between the mean baseline score and mean score change was −0.66 (95% CI -0.72 to −0.59) indicating that higher baseline scores were associated with lower score change. In addition, there was a moderate correlation between the mean and SD of PROM scores at follow-up (−0.39; 95% CI -0.48 to −0.28). The mean likelihood of detecting a difference was 65% (SD 11%) at baseline and 65% (SD 11%) at follow-up. The likelihood reached the 80% benchmark in only 8.5% and 8.1% of the studies at baseline and follow-up, respectively.</div></div><div><h3>Conclusion</h3><div>The concentration of PROM score distributions toward the high end of the scale, especially when higher baseline scores are present, diminishes the likelihood of detecting significant differences between study groups, particularly at follow-up assessments in studies analyzing musculoskeletal complaints. This underscores the importance of critically evaluating the conclusions drawn from these studies.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112114"},"PeriodicalIF":5.2,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145806149","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The use of guidelines in multimorbidity-related practice: an exploratory questionnaire survey 指南在多病相关实践中的应用:一项探索性问卷调查。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-19 DOI: 10.1016/j.jclinepi.2025.112115
Zijun Wang , Hongfeng He , Sergey K. Zyryanov , Liliya E. Ziganshina , Akihiko Ozaki , Natalia Dorofeeva , Myeong Soo Lee , Ivan D. Florez , Etienne Ngeh , Abhilasha Sharma , Ekaterina V. Yudina , Barbara C. van Munster , Jako S. Burgers , Opeyemi O. Babatunde , Yaolong Chen , Janne Estill

Objectives

The use of guidelines in multimorbidity-related practice has not yet been extensively investigated. We aimed to explore how health-care professionals use guidelines when managing individuals with multimorbidity.

Methods

We conducted an exploratory survey among a convenience sample of medical professionals with clinical experience. The questionnaire addressed whether and how different types of guidelines are used in multimorbidity-related practice, the reasons for not using specific types of guidelines, and other approaches to inform multimorbidity practice. It was distributed through the investigators’ contact networks. The results were presented descriptively.

Results

We received 311 valid responses: 136 from the World Health Organization European Region, 137 from the Western Pacific Region, and 38 from other regions. Most participants were familiar with the concept of multimorbidity (n = 245, 79%). Among the 269 respondents who reported using guidelines in multimorbidity practice, 124 (46%) used guidelines specifically focusing on combinations of diseases, and 148 (55%) multiple single-disease guidelines together. Lack of availability was the main reason for not using guidelines that address multimorbidity itself, and the high number of guidelines (n = 76, 40%) and possible interactions between conditions or treatments (n = 62, 38%) for not using single-disease guidelines. Respondents frequently consult experts or refer to systematic reviews and primary studies when existing guidelines do not meet their needs. The development of a tool or method to guide the use of multiple guidelines ranked highest among possible actions to improve multimorbidity practice.

Conclusion

Although the medical professionals in our sample were generally familiar with the use of guidelines, there are many unmet needs and tool gaps related to guideline-informed multimorbidity-related practice.
导论:指南在多发病相关实践中的应用尚未得到广泛调查。我们的目的是探讨医疗保健专业人员在管理多病个体时如何使用指南。方法:在方便抽样的具有临床经验的医学专业人员中进行探索性调查。该问卷调查了是否以及如何在多种疾病相关的实践中使用不同类型的指南,不使用特定类型指南的原因,以及为多种疾病实践提供信息的其他方法。它是通过调查人员的联系网络分发的。结果是描述性的。结果:我们收到311份有效答复:世卫组织欧洲区域136份,西太平洋区域137份,其他区域38份。大多数参与者熟悉多重发病的概念(n=245, 79%)。在报告在多病实践中使用指南的269名答复者中,124名(46%)使用了专门侧重于疾病组合的指南,148名(55%)同时使用了多种单一疾病指南。缺乏可得性是不使用针对多重发病本身的指南的主要原因;不使用单一疾病指南的高指南数量(n= 76,40%)和疾病或治疗之间可能的相互作用(n= 62,38%)。当现有指南不能满足其需求时,应答者经常咨询专家或参考系统评价和初步研究。在改善多病实践的可能行动中,开发一种工具或方法来指导多重指南的使用是最重要的。结论:虽然我们样本中的医疗专业人员普遍熟悉指南的使用,但在指南相关的多病相关实践中,仍有许多未满足的需求和工具差距。
{"title":"The use of guidelines in multimorbidity-related practice: an exploratory questionnaire survey","authors":"Zijun Wang ,&nbsp;Hongfeng He ,&nbsp;Sergey K. Zyryanov ,&nbsp;Liliya E. Ziganshina ,&nbsp;Akihiko Ozaki ,&nbsp;Natalia Dorofeeva ,&nbsp;Myeong Soo Lee ,&nbsp;Ivan D. Florez ,&nbsp;Etienne Ngeh ,&nbsp;Abhilasha Sharma ,&nbsp;Ekaterina V. Yudina ,&nbsp;Barbara C. van Munster ,&nbsp;Jako S. Burgers ,&nbsp;Opeyemi O. Babatunde ,&nbsp;Yaolong Chen ,&nbsp;Janne Estill","doi":"10.1016/j.jclinepi.2025.112115","DOIUrl":"10.1016/j.jclinepi.2025.112115","url":null,"abstract":"<div><h3>Objectives</h3><div>The use of guidelines in multimorbidity-related practice has not yet been extensively investigated. We aimed to explore how health-care professionals use guidelines when managing individuals with multimorbidity.</div></div><div><h3>Methods</h3><div>We conducted an exploratory survey among a convenience sample of medical professionals with clinical experience. The questionnaire addressed whether and how different types of guidelines are used in multimorbidity-related practice, the reasons for not using specific types of guidelines, and other approaches to inform multimorbidity practice. It was distributed through the investigators’ contact networks. The results were presented descriptively.</div></div><div><h3>Results</h3><div>We received 311 valid responses: 136 from the World Health Organization European Region, 137 from the Western Pacific Region, and 38 from other regions. Most participants were familiar with the concept of multimorbidity (<em>n</em> = 245, 79%). Among the 269 respondents who reported using guidelines in multimorbidity practice, 124 (46%) used guidelines specifically focusing on combinations of diseases, and 148 (55%) multiple single-disease guidelines together. Lack of availability was the main reason for not using guidelines that address multimorbidity itself, and the high number of guidelines (<em>n</em> = 76, 40%) and possible interactions between conditions or treatments (<em>n</em> = 62, 38%) for not using single-disease guidelines. Respondents frequently consult experts or refer to systematic reviews and primary studies when existing guidelines do not meet their needs. The development of a tool or method to guide the use of multiple guidelines ranked highest among possible actions to improve multimorbidity practice.</div></div><div><h3>Conclusion</h3><div>Although the medical professionals in our sample were generally familiar with the use of guidelines, there are many unmet needs and tool gaps related to guideline-informed multimorbidity-related practice.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112115"},"PeriodicalIF":5.2,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145806152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sequential sample size calculations and learning curves safeguard the robust development of a clinical prediction model for individuals 顺序样本量计算和学习曲线保障了个体临床预测模型的稳健发展。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-19 DOI: 10.1016/j.jclinepi.2025.112117
Amardeep Legha , Joie Ensor , Rebecca Whittle , Lucinda Archer , Ben Van Calster , Evangelia Christodoulou , Kym I.E. Snell , Mohsen Sadatsafavi , Gary S. Collins , Richard D. Riley

Background and Objectives

When recruiting participants to a new study developing a clinical prediction model (CPM), sample size calculations are typically conducted before data collection based on sensible assumptions. This leads to a fixed sample size, but if the assumptions are inaccurate, the actual sample size required to develop a reliable model may be higher or even lower. To safeguard against this, adaptive sample size approaches have been proposed, based on sequential evaluation of (changes in) a model's predictive performance. The objective of the study was to illustrate and extend sequential sample size calculations for CPM development by (i) proposing stopping rules for prospective data collection based on minimizing uncertainty (instability) and misclassification of individual-level predictions and (ii) showcasing how it safeguards against inaccurate fixed sample size calculations.

Methods

Using the sequential approach repeats the predefined model development strategy every time a chosen number (eg, 100) of participants are recruited and adequately followed up. At each stage, CPM performance is evaluated using bootstrapping, leading to prediction and classification stability statistics and plots, alongside optimism-adjusted measures of calibration and discrimination. Learning curves display the trend of results against sample size and recruitment is stopped when a chosen stopping rule is met.

Results

Our approach is illustrated for model development of acute kidney injury using (penalized) logistic regression CPMs. Before recruitment based on perceived sensible assumptions, the fixed sample size calculation suggests recruiting 342 patients to minimize overfitting; however, during data collection, the sequential approach reveals that a much larger sample size of 1100 is required to minimize overfitting (targeting a bootstrap-corrected calibration slope ≥0.9). If the stopping rule criteria also target small uncertainty and misclassification probability of individual predictions, the sequential approach suggests an even larger sample size of about 1800.

Conclusion

For CPM development studies involving prospective data collection, a sequential sample size approach allows users to dynamically monitor individual-level prediction and classification instability. This helps determine when enough participants have been recruited and safeguards against using inaccurate assumptions in a sample size calculation before data collection. Engagement with patients and other stakeholders is crucial to identify sensible context-specific stopping rules for robust individual predictions.
背景:在招募参与者参与一项开发临床预测模型(CPM)的新研究时,通常在基于合理假设的数据收集之前进行样本量计算。这导致固定的样本量,但如果假设不准确,则开发可靠模型所需的实际样本量可能会更高甚至更低。为了防止这种情况,已经提出了基于对模型预测性能(变化)的顺序评估的自适应样本量方法。目标:通过(i)提出基于最小化不确定性(不稳定性)和个人水平预测的错误分类的前瞻性数据收集的停止规则,以及(ii)展示它如何防止不准确的固定样本量计算,来说明和扩展CPM开发的顺序样本量计算。方法:使用顺序方法重复预先定义的模型开发策略,每次选定数量的参与者(例如,100)被招募并充分跟踪。在每个阶段,CPM的性能使用自举来评估,导致预测和分类稳定性统计和图,以及乐观调整的校准和判别措施。学习曲线显示结果对样本量的趋势,当选择的停止规则满足时,招募将停止。结果:我们的方法是用(惩罚)逻辑回归cpm来说明急性肾损伤的模型开发。在招募之前,基于感知到的合理假设,固定样本量计算建议招募342名患者,以尽量减少过拟合;然而,在数据收集过程中,顺序方法显示需要更大的1100个样本量来最小化过拟合(目标是引导校正的校准斜率≥0.9)。如果停止规则标准也针对单个预测的小不确定性和错误分类概率,则顺序方法建议更大的样本量,约为n=1800。结论:对于涉及前瞻性数据收集的CPM发展研究,顺序样本量方法允许用户动态监测个人水平的预测和分类不稳定性。这有助于确定何时招募了足够的参与者,并防止在数据招募之前在样本大小计算中使用不准确的假设。与患者和其他利益相关者的接触对于确定合理的针对具体情况的停止规则以进行稳健的个人预测至关重要。
{"title":"Sequential sample size calculations and learning curves safeguard the robust development of a clinical prediction model for individuals","authors":"Amardeep Legha ,&nbsp;Joie Ensor ,&nbsp;Rebecca Whittle ,&nbsp;Lucinda Archer ,&nbsp;Ben Van Calster ,&nbsp;Evangelia Christodoulou ,&nbsp;Kym I.E. Snell ,&nbsp;Mohsen Sadatsafavi ,&nbsp;Gary S. Collins ,&nbsp;Richard D. Riley","doi":"10.1016/j.jclinepi.2025.112117","DOIUrl":"10.1016/j.jclinepi.2025.112117","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>When recruiting participants to a new study developing a clinical prediction model (CPM), sample size calculations are typically conducted before data collection based on sensible assumptions. This leads to a fixed sample size, but if the assumptions are inaccurate, the actual sample size required to develop a reliable model may be higher or even lower. To safeguard against this, adaptive sample size approaches have been proposed, based on sequential evaluation of (changes in) a model's predictive performance. The objective of the study was to illustrate and extend sequential sample size calculations for CPM development by (i) proposing stopping rules for prospective data collection based on minimizing uncertainty (instability) and misclassification of individual-level predictions and (ii) showcasing how it safeguards against inaccurate fixed sample size calculations.</div></div><div><h3>Methods</h3><div>Using the sequential approach repeats the predefined model development strategy every time a chosen number (eg, 100) of participants are recruited and adequately followed up. At each stage, CPM performance is evaluated using bootstrapping, leading to prediction and classification stability statistics and plots, alongside optimism-adjusted measures of calibration and discrimination. Learning curves display the trend of results against sample size and recruitment is stopped when a chosen stopping rule is met.</div></div><div><h3>Results</h3><div>Our approach is illustrated for model development of acute kidney injury using (penalized) logistic regression CPMs. Before recruitment based on perceived sensible assumptions, the fixed sample size calculation suggests recruiting 342 patients to minimize overfitting; however, during data collection, the sequential approach reveals that a much larger sample size of 1100 is required to minimize overfitting (targeting a bootstrap-corrected calibration slope ≥0.9). If the stopping rule criteria also target small uncertainty and misclassification probability of individual predictions, the sequential approach suggests an even larger sample size of about 1800.</div></div><div><h3>Conclusion</h3><div>For CPM development studies involving prospective data collection, a sequential sample size approach allows users to dynamically monitor individual-level prediction and classification instability. This helps determine when enough participants have been recruited and safeguards against using inaccurate assumptions in a sample size calculation before data collection. Engagement with patients and other stakeholders is crucial to identify sensible context-specific stopping rules for robust individual predictions.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112117"},"PeriodicalIF":5.2,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145806008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Text message incentives increased patient-reported outcomes survey response in emergency care: SWAT findings 短信激励在急诊护理中增加了患者报告结果调查的反应:SWAT的发现。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-12-19 DOI: 10.1016/j.jclinepi.2025.112116
Gemma Altinger , Sweekriti Sharma , Qiang Li , Anthony Devaux , Samantha Darby , Aidan van Wyk , Caitlin M.P. Jones , Chris G. Maher , Adrian C. Traeger
<div><h3>Objectives</h3><div>To determine if text message–based behavioral interventions could increase response rates to a patient-reported outcomes survey in the emergency department (ED).</div></div><div><h3>Study Design and Setting</h3><div>We conducted a study within a trial (SWAT), within the NUDG-ED trial. The NUDG-ED trial aimed to reduce low-value care for patients with back pain presenting to eight EDs in Sydney, Australia. This SWAT was a 3-arm randomized controlled trial (RCT) nested within the NUDG-ED trial. After discharge from the ED, patients were randomized to receive one of the three text message invitations to complete a follow-up patient-reported outcome survey: a standard control message, or one of two behaviorally informed messages including either a prize draw incentive or prosocial framing. Our primary outcome measure was the response rate in each study group. We performed a linear mixed-effects model controlling for hospital heterogeneity and patient characteristics to estimate the mean difference (MD) in proportions with 95% CI, to determine the effectiveness of the behavioral interventions.</div></div><div><h3>Results</h3><div>A total of 1494 patients were randomized between May 15, 2024 and January 29, 2025. Of these, 52% were women, the median age was 46 years (IQR 35, 62), 43% were from disadvantaged areas and 51% were triaged with a clinically urgent condition. Baseline characteristics were balanced across all groups. Our primary analysis found that compared to the control, the prize draw incentive increased response rates (<em>n</em> = 997 patients, MD = 6.9%, 95% CI: 1.8% to 11.9%, <em>P</em> = .007). Our adjusted mixed-effects model also found a significant increase in response rates (<em>n</em> = 979 patients, MD = 6.4%, 95% CI 1.3% to 11.4%, <em>P</em> = .013). Compared to the control, the prosocial framing message may have slightly increased response rates, but the results were not statistically significant (<em>n</em> = 996 patients, 17.2% vs 21.1%, MD = 3.9%, 95% CI: −1.1% to 8.9%).</div></div><div><h3>Conclusion</h3><div>In this randomized trial, a prize draw incentive modestly improved response rates to a patient-reported outcomes survey in routine emergency care settings. Prosocial framing may have slightly increased response rates, but the effect was uncertain. Both behavioral approaches warrant further testing in routine care settings.</div></div><div><h3>Plain Language Summary</h3><div>Patient-reported outcomes, such as surveys about how people feel and recover after care, are important for understanding what matters most to patients. However, response rates to these surveys are often very low, especially in real clinical settings. This makes it difficult to draw strong conclusions about whether treatments are helping patients. So, researchers and health services need to find ways to improve response rates. This study looked at whether simple text message strategies could encourage more patients to com
目的:确定基于短信的行为干预是否可以提高对急诊科(ED)患者报告结果调查的反应率。研究设计和设置:我们在NUDG-ED试验中进行了一项试验(SWAT)中的研究。NUDG-ED试验旨在减少澳大利亚悉尼8家急诊科对背痛患者的低价值护理。SWAT是一项嵌套在NUDG-ED试验中的三组随机对照试验。从急症室出院后,患者被随机分配收到三条短信邀请中的一条,以完成后续的患者报告结果调查:一条标准控制信息,或两条行为告知信息中的一条,其中包括抽奖激励或亲社会框架。我们的主要结局指标是每个研究组的反应率。我们采用线性混合效应模型,控制医院异质性和患者特征,以95%置信区间(CI)估计比例的平均差异(MD),以确定行为干预的有效性。结果:在2024年5月15日至2025年1月29日期间,共有1494名患者被随机分组。其中52%为女性,中位年龄为46岁(IQR 35,62), 43%来自贫困地区,51%为临床急症患者。所有组的基线特征都是平衡的。我们的初步分析发现,与对照组相比,抽奖激励提高了反应率(n = 997例患者,MD = 6.9%, 95% CI: 1.8%至11.9%,p = 0.007)。我们调整后的混合效应模型也发现缓解率显著增加(n = 979例患者,MD = 6.4%, 95% CI 1.3%至11.4%,p = 0.013)。与对照组相比,亲社会框架信息的反应率无统计学意义差异(n = 996例患者,17.2% vs. 21.1%, MD = 3.9%, 95% CI: -1.1% ~ 8.9%)。结论:在这项随机试验中,抽奖激励适度提高了常规急诊环境中患者报告结果调查的反应率。亲社会框架可能会略微提高反应率,但效果尚不确定。这两种行为方法都值得在常规护理环境中进一步测试。
{"title":"Text message incentives increased patient-reported outcomes survey response in emergency care: SWAT findings","authors":"Gemma Altinger ,&nbsp;Sweekriti Sharma ,&nbsp;Qiang Li ,&nbsp;Anthony Devaux ,&nbsp;Samantha Darby ,&nbsp;Aidan van Wyk ,&nbsp;Caitlin M.P. Jones ,&nbsp;Chris G. Maher ,&nbsp;Adrian C. Traeger","doi":"10.1016/j.jclinepi.2025.112116","DOIUrl":"10.1016/j.jclinepi.2025.112116","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Objectives&lt;/h3&gt;&lt;div&gt;To determine if text message–based behavioral interventions could increase response rates to a patient-reported outcomes survey in the emergency department (ED).&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;We conducted a study within a trial (SWAT), within the NUDG-ED trial. The NUDG-ED trial aimed to reduce low-value care for patients with back pain presenting to eight EDs in Sydney, Australia. This SWAT was a 3-arm randomized controlled trial (RCT) nested within the NUDG-ED trial. After discharge from the ED, patients were randomized to receive one of the three text message invitations to complete a follow-up patient-reported outcome survey: a standard control message, or one of two behaviorally informed messages including either a prize draw incentive or prosocial framing. Our primary outcome measure was the response rate in each study group. We performed a linear mixed-effects model controlling for hospital heterogeneity and patient characteristics to estimate the mean difference (MD) in proportions with 95% CI, to determine the effectiveness of the behavioral interventions.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;A total of 1494 patients were randomized between May 15, 2024 and January 29, 2025. Of these, 52% were women, the median age was 46 years (IQR 35, 62), 43% were from disadvantaged areas and 51% were triaged with a clinically urgent condition. Baseline characteristics were balanced across all groups. Our primary analysis found that compared to the control, the prize draw incentive increased response rates (&lt;em&gt;n&lt;/em&gt; = 997 patients, MD = 6.9%, 95% CI: 1.8% to 11.9%, &lt;em&gt;P&lt;/em&gt; = .007). Our adjusted mixed-effects model also found a significant increase in response rates (&lt;em&gt;n&lt;/em&gt; = 979 patients, MD = 6.4%, 95% CI 1.3% to 11.4%, &lt;em&gt;P&lt;/em&gt; = .013). Compared to the control, the prosocial framing message may have slightly increased response rates, but the results were not statistically significant (&lt;em&gt;n&lt;/em&gt; = 996 patients, 17.2% vs 21.1%, MD = 3.9%, 95% CI: −1.1% to 8.9%).&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;In this randomized trial, a prize draw incentive modestly improved response rates to a patient-reported outcomes survey in routine emergency care settings. Prosocial framing may have slightly increased response rates, but the effect was uncertain. Both behavioral approaches warrant further testing in routine care settings.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Plain Language Summary&lt;/h3&gt;&lt;div&gt;Patient-reported outcomes, such as surveys about how people feel and recover after care, are important for understanding what matters most to patients. However, response rates to these surveys are often very low, especially in real clinical settings. This makes it difficult to draw strong conclusions about whether treatments are helping patients. So, researchers and health services need to find ways to improve response rates. This study looked at whether simple text message strategies could encourage more patients to com","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"191 ","pages":"Article 112116"},"PeriodicalIF":5.2,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145806204","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Clinical Epidemiology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1