首页 > 最新文献

Journal of Clinical Epidemiology最新文献

英文 中文
Associations of hypothetical early intensive in-hospital rehabilitation with activities of daily living after hip fracture surgery in patients with and without dementia: emulating a randomized controlled trial using medical claims data 髋部骨折术后痴呆症患者和非痴呆症患者的假定早期院内强化康复与日常生活活动的关联:利用医疗索赔数据模拟随机对照试验。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-05 DOI: 10.1016/j.jclinepi.2024.111550
Takaaki Ikeda , Upul Cooray , Ryutaro Matsugaki , Yuta Suzuki , Michiaki Takagi , Keiji Muramatsu , Kiyohide Fushimi , Masayasu Murakami , Ken Osaka , Shinya Matsuda

Objectives

To investigate the impact of early intensive in-hospital rehabilitation, initiated within 2 days of surgery and lasting up to 7 days, on the recovery of activities of daily living in patients with and without dementia.

Study Design and Setting

Medical claims data from 925 hospitals in Japan were analyzed. We enrolled patients aged ≥50 years who underwent hip fracture surgery within 2 days of admission between April 1, 2018, and December 31, 2019. Low- (20 minutes per day starting on day 2), highest- (60 minutes per day starting on day 1), and gradually increasing (20 minutes on day 1, 40 minutes on days 2–4, and 60 minutes per day thereafter) intensity regimens were used as exposures. The outcomes were Barthel Index (BI) scores at 14 and 30 days postoperatively. For per-protocol analysis, a target trial emulation framework with the sequential doubly robust estimator was used.

Results

Among patients without dementia (N = 11,461), no significant differences in BI scores were observed at 14 days postoperatively across regimens. At 30 days postoperatively, significant differences in BI scores were noted between highest- and low-intensity regimens and between gradually increasing intensity and low-intensity regimens, with additive BI scores of 15.2 (95% CI, 10.7–19.7) and 14.7 (95% CI, 9.2–20.2), respectively. In patients with dementia (N = 14,302), significant differences in BI scores were noted at 14 days postoperatively between highest- and low-intensity regimens and between gradually increasing intensity and low-intensity regimens, with additive BI scores of 8.7 (95% CI, 5.2–12.2) and 10.7 (95% CI, 5.8–15.6), respectively. At 30 days postoperatively, a significant difference in BI scores was observed between gradually increasing intensity and low-intensity regimens, with an additive BI score of 17.9 (95% CI, 11.3–24.5).

Conclusion

Early intensive in-hospital rehabilitation is highly relevant and beneficial for dementia patients.
研究目的研究设计与环境:分析来自日本925家医院的医疗索赔数据:研究设计与背景:我们分析了来自日本 925 家医院的医疗报销数据。我们招募了 2018 年 4 月 1 日至 2019 年 12 月 31 日期间入院 2 天内接受髋部骨折手术的年龄≥50 岁的患者。低强度(从第 2 天开始每天 20 分钟)、高强度(从第 1 天开始每天 60 分钟)和逐渐增加强度(第 1 天 20 分钟,第 2-4 天 40 分钟,之后每天 60 分钟)的治疗方案被用作暴露。结果为术后 14 天和 30 天的巴特尔指数 (BI) 评分。在进行每方案分析时,采用了目标试验仿真框架和连续双稳健估计器:在没有痴呆症的患者中(N = 11,461),不同治疗方案在术后 14 天的 BI 评分无明显差异。术后 30 天,最高强度和低强度治疗方案之间以及强度逐渐增加和低强度治疗方案之间的 BI 评分存在显著差异,加和 BI 评分分别为 15.2(95% 置信区间 [CI],10.7-19.7)和 14.7(95% CI,9.2-20.2)。在痴呆症患者中(N = 14,302),术后14天时,最高强度和低强度治疗方案之间以及逐渐增加强度和低强度治疗方案之间的BI评分存在显著差异,加和BI评分分别为8.7(95% CI,5.2-12.2)和10.7(95% CI,5.8-15.6)。术后30天,逐步增加康复强度和低强度康复方案的BI评分有显著差异,加和BI评分为17.9(95% CI,11.3-24.5):结论:早期强化院内康复对痴呆症患者非常重要且有益。
{"title":"Associations of hypothetical early intensive in-hospital rehabilitation with activities of daily living after hip fracture surgery in patients with and without dementia: emulating a randomized controlled trial using medical claims data","authors":"Takaaki Ikeda ,&nbsp;Upul Cooray ,&nbsp;Ryutaro Matsugaki ,&nbsp;Yuta Suzuki ,&nbsp;Michiaki Takagi ,&nbsp;Keiji Muramatsu ,&nbsp;Kiyohide Fushimi ,&nbsp;Masayasu Murakami ,&nbsp;Ken Osaka ,&nbsp;Shinya Matsuda","doi":"10.1016/j.jclinepi.2024.111550","DOIUrl":"10.1016/j.jclinepi.2024.111550","url":null,"abstract":"<div><h3>Objectives</h3><div>To investigate the impact of early intensive in-hospital rehabilitation, initiated within 2 days of surgery and lasting up to 7 days, on the recovery of activities of daily living in patients with and without dementia.</div></div><div><h3>Study Design and Setting</h3><div>Medical claims data from 925 hospitals in Japan were analyzed. We enrolled patients aged ≥50 years who underwent hip fracture surgery within 2 days of admission between April 1, 2018, and December 31, 2019. Low- (20 minutes per day starting on day 2), highest- (60 minutes per day starting on day 1), and gradually increasing (20 minutes on day 1, 40 minutes on days 2–4, and 60 minutes per day thereafter) intensity regimens were used as exposures. The outcomes were Barthel Index (BI) scores at 14 and 30 days postoperatively. For per-protocol analysis, a target trial emulation framework with the sequential doubly robust estimator was used.</div></div><div><h3>Results</h3><div>Among patients without dementia (<em>N</em> = 11,461), no significant differences in BI scores were observed at 14 days postoperatively across regimens. At 30 days postoperatively, significant differences in BI scores were noted between highest- and low-intensity regimens and between gradually increasing intensity and low-intensity regimens, with additive BI scores of 15.2 (95% CI, 10.7–19.7) and 14.7 (95% CI, 9.2–20.2), respectively. In patients with dementia (<em>N</em> = 14,302), significant differences in BI scores were noted at 14 days postoperatively between highest- and low-intensity regimens and between gradually increasing intensity and low-intensity regimens, with additive BI scores of 8.7 (95% CI, 5.2–12.2) and 10.7 (95% CI, 5.8–15.6), respectively. At 30 days postoperatively, a significant difference in BI scores was observed between gradually increasing intensity and low-intensity regimens, with an additive BI score of 17.9 (95% CI, 11.3–24.5).</div></div><div><h3>Conclusion</h3><div>Early intensive in-hospital rehabilitation is highly relevant and beneficial for dementia patients.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"176 ","pages":"Article 111550"},"PeriodicalIF":7.3,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142395027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What should journals do to prevent the publication of methodologically flawed systematic reviews? 期刊应如何防止发表方法上有缺陷的系统综述?
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-01 DOI: 10.1016/j.jclinepi.2024.111493
KM Saif-Ur-Rahman
{"title":"What should journals do to prevent the publication of methodologically flawed systematic reviews?","authors":"KM Saif-Ur-Rahman","doi":"10.1016/j.jclinepi.2024.111493","DOIUrl":"10.1016/j.jclinepi.2024.111493","url":null,"abstract":"","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"174 ","pages":"Article 111493"},"PeriodicalIF":7.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141890820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long list of conflicts of interest in industry-funded drug trials are counterproductive and opaque for readers 由企业资助的药物试验中存在的一长串利益冲突会适得其反,而且对读者来说也不透明。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-01 DOI: 10.1016/j.jclinepi.2024.111491
Sophie Leducq, Richard Barlow, Arabella Baker, Mikolaj Swiderski, Hywel C. Williams
{"title":"Long list of conflicts of interest in industry-funded drug trials are counterproductive and opaque for readers","authors":"Sophie Leducq,&nbsp;Richard Barlow,&nbsp;Arabella Baker,&nbsp;Mikolaj Swiderski,&nbsp;Hywel C. Williams","doi":"10.1016/j.jclinepi.2024.111491","DOIUrl":"10.1016/j.jclinepi.2024.111491","url":null,"abstract":"","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"174 ","pages":"Article 111491"},"PeriodicalIF":7.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141890818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis of risk of bias assessments in a sample of intervention systematic reviews, Part II: focus on risk of bias tools reveals few meet current appraisal standards 干预性系统综述样本的偏倚风险评估分析,第二部分:偏倚风险工具的重点显示,符合当前评估标准的工具寥寥无几。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-01 DOI: 10.1016/j.jclinepi.2024.111460
Kat Kolaski , Mike Clarke , Lynne Romeiser Logan
<div><h3>Objectives</h3><div>Risk of bias (RoB) assessment is a critical part of any systematic review (SR). There are multiple tools available for assessing RoB of the studies included in a SR. The conduct of these assessments in intervention SRs are addressed by three items in AMSTAR-2, considered the preferred tool for critically appraising an intervention SR. This study focuses attention on item 9, which assesses the ability of a RoB tool to adequately address sources of bias, particularly in randomized trials (RCTs) and nonrandomized studies of interventions (NRSI). Our main objective is to report the detailed results of our examination of both Cochrane and non-Cochrane RoB tools and distinguish those that meet AMSTAR-2 item 9 appraisal standards.</div></div><div><h3>Study Design and Setting</h3><div>We identified critical appraisal tools reported in a sample of 126 SRs reporting on interventions for persons with cerebral palsy published from 2014 to 2021. Eligible tools were those that had been used to assess the primary studies included in these SRs and for which assessment results were reported in enough detail to allow appraisal of the tool. We identified the version of the tool applied as original, modified, or novel and established the applicable study designs as intended by the tools’ developers. We then evaluated the potential ability of these tools to assess the four sources of bias specified in AMSTAR-2 item 9 for RCTs and NRSI. We adapted item 9 to appraise tools applied to single-case experimental designs, which we also encountered in this sample of SRs.</div></div><div><h3>Results</h3><div>Most of the eligible tools are recognized by name in the published literature and were applied in the original or modified form. Modifications were applied with considerable variability across the sample. Of the 37 tools we examined, those judged to fully meet the appraisal standards for RCTs included all the Cochrane tools, the original and modified Downs and Black Checklist, and the quality assessment standard for a cross-over study by Ding et al; for NRSI, these included all the Cochrane tools, the original and modified Downs and Black Checklist, and the Research Triangle Institute item bank on Risk of Bias and Precision of Observational Studies for NRSI. In general, tools developed for a specific study design were judged to meet the appraisal standards fully or partially for that design. These results suggest it is unlikely that a single tool will be adequate by AMSTAR-2 item 9 appraisal standards for an intervention SR that includes studies of various designs.</div></div><div><h3>Conclusion</h3><div>To our knowledge, this is the first resource providing SR authors with practical information about the appropriateness and adequacy of RoB tools by the appraisal standards specified in AMSTAR-2 item 9 for RCTs and NRSI. We propose similar methods for appraisal of tools applied to single-case experimental design. We encourage authors to seek co
目的:偏倚风险(RoB)评估是任何系统综述(SR)的关键部分。有多种工具可用于评估纳入系统综述的研究的偏倚风险。AMSTAR-2 被认为是对干预性系统综述进行批判性评估的首选工具,其中有三个项目涉及干预性系统综述中进行这些评估的问题。本研究重点关注项目 9,该项目评估 RoB 工具充分解决偏倚来源的能力,尤其是随机试验 (RCT) 和非随机干预研究 (NRSI) 中的偏倚来源。我们的主要目的是报告对 Cochrane 和非 Cochrane RoB 工具的详细检查结果,并区分那些符合 AMSTAR-2 第 9 项评估标准的工具:我们在2014年至2021年发表的126篇报告中抽样调查了对脑瘫患者干预措施的关键评估工具。符合条件的工具是那些用于评估这些SR中包含的主要研究的工具,并且评估结果有足够详细的报告,以便对工具进行评估。我们确定了所应用工具的原始版本、修改版本或新型版本,并按照工具开发者的意图确定了适用的研究设计。然后,我们评估了这些工具评估 AMSTAR-2 第 9 项针对 RCT 和 NRSI 规定的四种偏倚来源的潜在能力。我们对第 9 项进行了调整,以评估适用于单例实验设计的工具,我们在 SR 样本中也遇到了这种情况:结果:大多数符合条件的工具在已发表的文献中都有名称,并以原始或修改后的形式应用。修改后的工具在样本中的应用具有相当大的差异性。在我们检查的 37 种工具中,被判定完全符合 RCT 评估标准的工具包括所有 Cochrane 工具、原始和修改后的 Downs 和 Black 检查表,以及 Ding 等人的交叉研究质量评估标准;对于 NRSI,这些工具包括所有 Cochrane 工具、原始和修改后的 Downs 和 Black 检查表,以及三角研究所的 NRSI 观察性研究偏倚风险和精确性项目库。一般来说,为特定研究设计开发的工具被判定为完全或部分符合该设计的鉴定标准。这些结果表明,根据 AMSTAR-2 第 9 项评估标准,单一工具不太可能满足包括各种设计研究在内的干预 SR 的要求:据我们所知,这是第一份为SR作者提供实用信息的资料,介绍了RoB工具在AMSTAR-2第9项规定的RCT和NRSI评估标准下的适宜性和充分性。我们建议采用类似的方法来评估适用于单例实验设计的工具。我们鼓励作者寻找为医疗相关干预性研究开发的、旨在评估相关研究设计特征的当代 RoB 工具。这些工具应针对综述主题和研究问题的独特属性,但不应进行不合理的过度修改。我们提倡认识到 Cochrane 和非 Cochrane RoB 工具的潜在缺陷,即使是那些在 AMSTAR-2 第 9 项评估标准中表现良好的工具。
{"title":"Analysis of risk of bias assessments in a sample of intervention systematic reviews, Part II: focus on risk of bias tools reveals few meet current appraisal standards","authors":"Kat Kolaski ,&nbsp;Mike Clarke ,&nbsp;Lynne Romeiser Logan","doi":"10.1016/j.jclinepi.2024.111460","DOIUrl":"10.1016/j.jclinepi.2024.111460","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Objectives&lt;/h3&gt;&lt;div&gt;Risk of bias (RoB) assessment is a critical part of any systematic review (SR). There are multiple tools available for assessing RoB of the studies included in a SR. The conduct of these assessments in intervention SRs are addressed by three items in AMSTAR-2, considered the preferred tool for critically appraising an intervention SR. This study focuses attention on item 9, which assesses the ability of a RoB tool to adequately address sources of bias, particularly in randomized trials (RCTs) and nonrandomized studies of interventions (NRSI). Our main objective is to report the detailed results of our examination of both Cochrane and non-Cochrane RoB tools and distinguish those that meet AMSTAR-2 item 9 appraisal standards.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;We identified critical appraisal tools reported in a sample of 126 SRs reporting on interventions for persons with cerebral palsy published from 2014 to 2021. Eligible tools were those that had been used to assess the primary studies included in these SRs and for which assessment results were reported in enough detail to allow appraisal of the tool. We identified the version of the tool applied as original, modified, or novel and established the applicable study designs as intended by the tools’ developers. We then evaluated the potential ability of these tools to assess the four sources of bias specified in AMSTAR-2 item 9 for RCTs and NRSI. We adapted item 9 to appraise tools applied to single-case experimental designs, which we also encountered in this sample of SRs.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;Most of the eligible tools are recognized by name in the published literature and were applied in the original or modified form. Modifications were applied with considerable variability across the sample. Of the 37 tools we examined, those judged to fully meet the appraisal standards for RCTs included all the Cochrane tools, the original and modified Downs and Black Checklist, and the quality assessment standard for a cross-over study by Ding et al; for NRSI, these included all the Cochrane tools, the original and modified Downs and Black Checklist, and the Research Triangle Institute item bank on Risk of Bias and Precision of Observational Studies for NRSI. In general, tools developed for a specific study design were judged to meet the appraisal standards fully or partially for that design. These results suggest it is unlikely that a single tool will be adequate by AMSTAR-2 item 9 appraisal standards for an intervention SR that includes studies of various designs.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;To our knowledge, this is the first resource providing SR authors with practical information about the appropriateness and adequacy of RoB tools by the appraisal standards specified in AMSTAR-2 item 9 for RCTs and NRSI. We propose similar methods for appraisal of tools applied to single-case experimental design. We encourage authors to seek co","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"174 ","pages":"Article 111460"},"PeriodicalIF":7.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141724954","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editors’ Choice: October 2024 编辑推荐2024 年 10 月
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-01 DOI: 10.1016/j.jclinepi.2024.111554
Andrea C. Tricco, David Tovey
{"title":"Editors’ Choice: October 2024","authors":"Andrea C. Tricco,&nbsp;David Tovey","doi":"10.1016/j.jclinepi.2024.111554","DOIUrl":"10.1016/j.jclinepi.2024.111554","url":null,"abstract":"","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"174 ","pages":"Article 111554"},"PeriodicalIF":7.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimates for diagnostic accuracy of rapid antigen tests for SARS-CoV-2 in systematic reviews are consistently similar despite poor methodological rigor: a methodological overview 尽管方法不够严谨,但系统综述中对 SARS-CoV-2 快速抗原检测诊断准确性的估计始终相似:方法概述。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-01 DOI: 10.1016/j.jclinepi.2024.111547
Vivienne C. Bachelet , Francisca J. Lizana , Catalina O. Andrades , Belén Carroza , Leandro R.A. González , Paula Munita , Luana Wosiack , Nicolás Meza

Objectives

To evaluate the design, conduct, and analysis of systematic reviews on the diagnostic accuracy of rapid antigen tests for SARS-CoV-2 during the COVID-19 pandemic.

Study Design and Setting

We did a methodological overview of systematic reviews on diagnostic test accuracy, exploring methodological rigor, risk of bias and potential factors of between-review variability.

Results

Of the 31 included reviews, 30 provided summary statistics for sensitivity and 29 for specificity. Summary sensitivities ranged from 56.2% to 91.1%, with a median of 71.5% (IQR 68.3%–76.6%) and a mean of 72.7% with a 7.2 SD. Reported summary specificity estimates were consistently high: median 99.5% (IQR 99%–99.9%) and a mean of 99.3% with a 0.9 SD. We found methodological shortcomings in the systematic reviews, with a majority showing critically low confidence in quality and a high risk of bias.

Conclusion

Despite significant methodological flaws in the reviews, the diagnostic accuracy estimates for rapid antigen tests were characterized by a strong central tendency, highlighting the importance of large sample sizes and broad participant representation. This study suggests the need for further research in diagnostic test accuracy assessments of rigor and risk of bias in systematic reviews.
研究目的评估COVID-19大流行期间SARS-CoV-2快速抗原检测诊断准确性的系统综述的设计、实施和分析:我们对诊断测试准确性的系统综述进行了方法学概述,探讨了方法的严谨性、偏倚风险和综述间差异的潜在因素:在纳入的 31 篇综述中,有 30 篇提供了灵敏度的简要统计数据,29 篇提供了特异性的简要统计数据。灵敏度汇总范围从 56.2% 到 91.1%,中位数为 71.5%(IQR 68.3%-76.6%),平均值为 72.7%,标差为 7.2。报告的简要特异性估计值一直很高:中位数为 99.5%(IQR 为 99%-99.9%),平均值为 99.3%,标差为 0.9。我们发现系统性综述在方法上存在缺陷,大多数综述的质量可信度极低,偏倚风险较高:尽管综述在方法上存在重大缺陷,但快速抗原检测的诊断准确性估计值具有较强的中心倾向性,这凸显了大样本量和广泛的参与者代表性的重要性。本研究表明,有必要进一步研究系统综述中诊断测试准确性评估的严谨性和偏倚风险。
{"title":"Estimates for diagnostic accuracy of rapid antigen tests for SARS-CoV-2 in systematic reviews are consistently similar despite poor methodological rigor: a methodological overview","authors":"Vivienne C. Bachelet ,&nbsp;Francisca J. Lizana ,&nbsp;Catalina O. Andrades ,&nbsp;Belén Carroza ,&nbsp;Leandro R.A. González ,&nbsp;Paula Munita ,&nbsp;Luana Wosiack ,&nbsp;Nicolás Meza","doi":"10.1016/j.jclinepi.2024.111547","DOIUrl":"10.1016/j.jclinepi.2024.111547","url":null,"abstract":"<div><h3>Objectives</h3><div>To evaluate the design, conduct, and analysis of systematic reviews on the diagnostic accuracy of rapid antigen tests for SARS-CoV-2 during the COVID-19 pandemic.</div></div><div><h3>Study Design and Setting</h3><div>We did a methodological overview of systematic reviews on diagnostic test accuracy, exploring methodological rigor, risk of bias and potential factors of between-review variability.</div></div><div><h3>Results</h3><div>Of the 31 included reviews, 30 provided summary statistics for sensitivity and 29 for specificity. Summary sensitivities ranged from 56.2% to 91.1%, with a median of 71.5% (IQR 68.3%–76.6%) and a mean of 72.7% with a 7.2 SD. Reported summary specificity estimates were consistently high: median 99.5% (IQR 99%–99.9%) and a mean of 99.3% with a 0.9 SD. We found methodological shortcomings in the systematic reviews, with a majority showing critically low confidence in quality and a high risk of bias.</div></div><div><h3>Conclusion</h3><div>Despite significant methodological flaws in the reviews, the diagnostic accuracy estimates for rapid antigen tests were characterized by a strong central tendency, highlighting the importance of large sample sizes and broad participant representation. This study suggests the need for further research in diagnostic test accuracy assessments of rigor and risk of bias in systematic reviews.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"176 ","pages":"Article 111547"},"PeriodicalIF":7.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142367241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A review of health equity considerations in cochrane reviews of lifestyle interventions for cardiovascular health in adults 科克伦成人心血管健康生活方式干预综述中的健康公平考虑因素综述。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-27 DOI: 10.1016/j.jclinepi.2024.111546
Moriasi Nyanchoka , Omolola Titilayo Alade , Jennifer Petkovic , Tiffany Duque , L. Susan Wieland

Objectives

Cardiovascular disease (CVD) is the leading cause of global disease burden and rising health-care costs. Systematic reviews (SRs) rigorously evaluate evidence on health interventions' effects and guide personal, clinical, and policy decision-making. Health equity is the absence of avoidable and unfair differences in health between groups within a population. Assessing equity in lifestyle interventions for cardiovascular health is important due to persisting health inequities in CVD burden and access to interventions. We aim to explore how health equity considerations are addressed in Cochrane SRs of lifestyle interventions for cardiovascular health.

Study Design and Setting

This is a methodological review of Cochrane SRs of lifestyle interventions for cardiovascular health using the PROGRESS-Plus framework. PROGRESS-Plus stands for Place of residence, Race/ethnicity/culture/language, Occupation, Gender/sex, Religion, Education, Socioeconomic status, and Social capital, while “Plus” stands for additional factors associated with discrimination and exclusion such as age, disability, and comorbidity. Using predefined selection criteria, two authors independently screened all Cochrane reviews published in the Cochrane Database of Systematic Reviews (CDSR) between August 2017 and December 2022. PROGRESS-Plus factors in the SRs were sought in the Summary of Findings (SoF) table, Methods/Inclusion criteria, Methods/Subgroup analyses, Results/Included studies, Results/Subgroup analyses, and Discussion/Overall completeness and applicability of evidence.

Results

We included 36 SRs published by 10 Cochrane groups, addressing 11 health conditions with mostly dietary and exercise interventions. The most common PROGRESS-Plus factors assessed were gender/sex, age, and comorbidity. PROGRESS-Plus factors were most addressed in the inclusion criteria (64%), the discussion (75%), and the included studies (92%) sections of the SRs. Only 33% of SoF tables referenced PROGRESS-Plus. Sixty-nine percent of the included SRs planned for subgroup analyses across one or more PROGRESS-Plus factors, but only 43% of SRs conducted subgroup analyses, suggesting limited reporting of PROGRESS-Plus factors in primary studies.

Conclusion

Equity factors are not sufficiently addressed in Cochrane reviews of lifestyle interventions for cardiovascular health. Low reporting of PROGRESS-Plus factors in implications for practice and research sections of Cochrane SRs limit equity-focused guidance for current clinical practice, public health interventions, and future research.
目的:心血管疾病(CVD)是造成全球疾病负担和医疗成本上升的主要原因。系统综述(SR)对健康干预措施效果的证据进行严格评估,为个人、临床和政策决策提供指导。健康公平是指人口中不同群体之间不存在可避免的、不公平的健康差异。由于在心血管疾病负担和获得干预措施方面长期存在健康不公平现象,因此评估心血管健康生活方式干预措施的公平性非常重要。我们旨在探索科克伦研究报告中对心血管健康生活方式干预措施的健康公平性的考虑:本研究采用 PROGRESS-Plus 框架,对针对心血管健康的生活方式干预措施的 Cochrane SR 进行了方法学回顾。PROGRESS-Plus代表居住地、种族/民族/文化/语言、职业、性别/性别、宗教、教育、社会经济地位和社会资本,而 "Plus "则代表与歧视和排斥有关的其他因素,如年龄、残疾和合并症。利用预定义的筛选标准,两位作者独立筛选了2017年8月至2022年12月期间发表在科克伦系统性综述数据库中的所有科克伦综述。在研究结果摘要(SoF)表、方法/纳入标准、方法/分组分析、结果/纳入研究、结果/分组分析和讨论/证据的整体完整性和适用性中寻找SR中的PROGRESS-Plus因素:结果:我们纳入了 10 个 Cochrane 小组发表的 36 项 SR,涉及 11 种健康状况,主要是饮食和运动干预。最常见的 PROGRESS-Plus 评估因素是性别、年龄和合并症。纳入标准(64%)、讨论(75%)和纳入研究(92%)部分最常涉及 PROGRESS-Plus 因素。只有33%的SoF表格提到了PROGRESS-Plus。69%的纳入SR计划对一个或多个PROGRESS-Plus因素进行亚组分析,但只有43%的SR进行了亚组分析,这表明主要研究对PROGRESS-Plus因素的报告有限:结论:针对心血管健康的生活方式干预的 Cochrane 综述未充分考虑公平因素。Cochrane 文献综述的实践和研究意义部分对 PROGRESS-Plus 因素的报告较少,这限制了对当前临床实践、公共卫生干预措施和未来研究提供以公平为重点的指导。
{"title":"A review of health equity considerations in cochrane reviews of lifestyle interventions for cardiovascular health in adults","authors":"Moriasi Nyanchoka ,&nbsp;Omolola Titilayo Alade ,&nbsp;Jennifer Petkovic ,&nbsp;Tiffany Duque ,&nbsp;L. Susan Wieland","doi":"10.1016/j.jclinepi.2024.111546","DOIUrl":"10.1016/j.jclinepi.2024.111546","url":null,"abstract":"<div><h3>Objectives</h3><div>Cardiovascular disease (CVD) is the leading cause of global disease burden and rising health-care costs. Systematic reviews (SRs) rigorously evaluate evidence on health interventions' effects and guide personal, clinical, and policy decision-making. Health equity is the absence of avoidable and unfair differences in health between groups within a population. Assessing equity in lifestyle interventions for cardiovascular health is important due to persisting health inequities in CVD burden and access to interventions. We aim to explore how health equity considerations are addressed in Cochrane SRs of lifestyle interventions for cardiovascular health.</div></div><div><h3>Study Design and Setting</h3><div>This is a methodological review of Cochrane SRs of lifestyle interventions for cardiovascular health using the PROGRESS-Plus framework. PROGRESS-Plus stands for Place of residence, Race/ethnicity/culture/language, Occupation, Gender/sex, Religion, Education, Socioeconomic status, and Social capital, while “Plus” stands for additional factors associated with discrimination and exclusion such as age, disability, and comorbidity. Using predefined selection criteria, two authors independently screened all Cochrane reviews published in the Cochrane Database of Systematic Reviews (CDSR) between August 2017 and December 2022. PROGRESS-Plus factors in the SRs were sought in the Summary of Findings (SoF) table, Methods/Inclusion criteria, Methods/Subgroup analyses, Results/Included studies, Results/Subgroup analyses, and Discussion/Overall completeness and applicability of evidence.</div></div><div><h3>Results</h3><div>We included 36 SRs published by 10 Cochrane groups, addressing 11 health conditions with mostly dietary and exercise interventions. The most common PROGRESS-Plus factors assessed were gender/sex, age, and comorbidity. PROGRESS-Plus factors were most addressed in the inclusion criteria (64%), the discussion (75%), and the included studies (92%) sections of the SRs. Only 33% of SoF tables referenced PROGRESS-Plus. Sixty-nine percent of the included SRs planned for subgroup analyses across one or more PROGRESS-Plus factors, but only 43% of SRs conducted subgroup analyses, suggesting limited reporting of PROGRESS-Plus factors in primary studies.</div></div><div><h3>Conclusion</h3><div>Equity factors are not sufficiently addressed in Cochrane reviews of lifestyle interventions for cardiovascular health. Low reporting of PROGRESS-Plus factors in implications for practice and research sections of Cochrane SRs limit equity-focused guidance for current clinical practice, public health interventions, and future research.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"176 ","pages":"Article 111546"},"PeriodicalIF":7.3,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142331897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The performance of prognostic models depended on the choice of missing value imputation algorithm: a simulation study 预后模型的性能取决于缺失值估算算法的选择:一项模拟研究。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-24 DOI: 10.1016/j.jclinepi.2024.111539
Manja Deforth , Georg Heinze , Ulrike Held
<div><h3>Objectives</h3><div>The development of clinical prediction models is often impeded by the occurrence of missing values in the predictors. Various methods for imputing missing values before modeling have been proposed. Some of them are based on variants of multiple imputations by chained equations, while others are based on single imputation. These methods may include elements of flexible modeling or machine learning algorithms, and for some of them user-friendly software packages are available. The aim of this study was to investigate by simulation if some of these methods consistently outperform others in performance measures of clinical prediction models.</div></div><div><h3>Study Design and Setting</h3><div>We simulated development and validation cohorts by mimicking observed distributions of predictors and outcome variable of a real data set. In the development cohorts, missing predictor values were created in 36 scenarios defined by the missingness mechanism and proportion of noncomplete cases. We applied three imputation algorithms that were available in R software (R Foundation for Statistical Computing, Vienna, Austria): mice, aregImpute, and missForest. These algorithms differed in their use of linear or flexible models, or random forests, the way of sampling from the predictive posterior distribution, and the generation of a single or multiple imputed data set. For multiple imputation, we also investigated the impact of the number of imputations. Logistic regression models were fitted with the simulated development cohorts before (full data analysis) and after missing value generation (complete case analysis), and with the imputed data. Prognostic model performance was measured by the scaled Brier score, <em>c</em>-statistic, calibration intercept and slope, and by the mean absolute prediction error evaluated in validation cohorts without missing values. Performance of full data analysis was considered as ideal.</div></div><div><h3>Results</h3><div>None of the imputation methods achieved the model's predictive accuracy that would be obtained in case of no missingness. In general, complete case analysis yielded the worst performance, and deviation from ideal performance increased with increasing percentage of missingness and decreasing sample size. Across all scenarios and performance measures, aregImpute and mice, both with 100 imputations, resulted in highest predictive accuracy. Surprisingly, aregImpute outperformed full data analysis in achieving calibration slopes very close to one across all scenarios and outcome models. The increase of mice's performance with 100 compared to five imputations was only marginal. The differences between the imputation methods decreased with increasing sample sizes and decreasing proportion of noncomplete cases.</div></div><div><h3>Conclusion</h3><div>In our simulation study, model calibration was more affected by the choice of the imputation method than model discrimination. While difference
目的临床预测模型的开发通常会受到预测因子缺失值的影响。目前已提出了多种在建模前对缺失值进行归因的方法。其中一些方法基于链式方程的多重归因变体,而另一些方法则基于单项归因。这些方法可能包含灵活建模或机器学习算法的元素,其中一些方法还提供了用户友好型软件包。本研究的目的是通过模拟研究这些方法中的某些方法在临床预测模型的性能指标方面是否始终优于其他方法:研究设计和环境:我们模拟了真实数据集的预测因子和结果变量的观察分布,从而模拟了开发队列和验证队列。在开发队列中,根据缺失机制和非完整病例比例定义的 36 种情况创建了缺失预测值。我们使用了 R 软件中的三种估算算法:mice、aregImpute 和 missForest。这些算法在使用线性或灵活模型或随机森林、从预测后验分布中采样的方式以及生成单个或多个归因数据集方面存在差异。对于多重归因,我们还研究了归因次数的影响。我们利用缺失值生成前(完整数据分析)和缺失值生成后(完整病例分析)的模拟发展队列以及估算数据对逻辑回归模型进行了拟合。预后模型的性能通过标度 Brier 评分、c 统计量、校准截距和斜率以及在无缺失值的验证队列中评估的平均绝对预测误差来衡量。全部数据分析结果被视为理想结果:结果:没有一种估算方法能达到无缺失情况下的模型预测准确性。一般来说,完整病例分析的性能最差,而且随着缺失百分比的增加和样本量的减少,与理想性能的偏差也在增加。在所有情况和性能指标中,aregImpute 和小鼠的预测准确率最高,两者都有 100 次归因。令人惊讶的是,aregImpute 在所有情景和结果模型中的校准斜率都非常接近 1,超过了全数据分析。与 5 次归因相比,小鼠在 100 次归因时的性能仅略有提高。随着样本量的增加和非完整病例比例的降低,估算方法之间的差异也在缩小:结论:在我们的模拟研究中,模型校准受估算方法选择的影响要大于模型判别。虽然使用归因方法后模型性能的差异一般较小,但小鼠和 aregImpute 等可处理预测因子与结果之间线性或非线性关联的多重归因方法在大多数情况下都是有吸引力的可靠选择。
{"title":"The performance of prognostic models depended on the choice of missing value imputation algorithm: a simulation study","authors":"Manja Deforth ,&nbsp;Georg Heinze ,&nbsp;Ulrike Held","doi":"10.1016/j.jclinepi.2024.111539","DOIUrl":"10.1016/j.jclinepi.2024.111539","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Objectives&lt;/h3&gt;&lt;div&gt;The development of clinical prediction models is often impeded by the occurrence of missing values in the predictors. Various methods for imputing missing values before modeling have been proposed. Some of them are based on variants of multiple imputations by chained equations, while others are based on single imputation. These methods may include elements of flexible modeling or machine learning algorithms, and for some of them user-friendly software packages are available. The aim of this study was to investigate by simulation if some of these methods consistently outperform others in performance measures of clinical prediction models.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;We simulated development and validation cohorts by mimicking observed distributions of predictors and outcome variable of a real data set. In the development cohorts, missing predictor values were created in 36 scenarios defined by the missingness mechanism and proportion of noncomplete cases. We applied three imputation algorithms that were available in R software (R Foundation for Statistical Computing, Vienna, Austria): mice, aregImpute, and missForest. These algorithms differed in their use of linear or flexible models, or random forests, the way of sampling from the predictive posterior distribution, and the generation of a single or multiple imputed data set. For multiple imputation, we also investigated the impact of the number of imputations. Logistic regression models were fitted with the simulated development cohorts before (full data analysis) and after missing value generation (complete case analysis), and with the imputed data. Prognostic model performance was measured by the scaled Brier score, &lt;em&gt;c&lt;/em&gt;-statistic, calibration intercept and slope, and by the mean absolute prediction error evaluated in validation cohorts without missing values. Performance of full data analysis was considered as ideal.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;None of the imputation methods achieved the model's predictive accuracy that would be obtained in case of no missingness. In general, complete case analysis yielded the worst performance, and deviation from ideal performance increased with increasing percentage of missingness and decreasing sample size. Across all scenarios and performance measures, aregImpute and mice, both with 100 imputations, resulted in highest predictive accuracy. Surprisingly, aregImpute outperformed full data analysis in achieving calibration slopes very close to one across all scenarios and outcome models. The increase of mice's performance with 100 compared to five imputations was only marginal. The differences between the imputation methods decreased with increasing sample sizes and decreasing proportion of noncomplete cases.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;In our simulation study, model calibration was more affected by the choice of the imputation method than model discrimination. While difference","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"176 ","pages":"Article 111539"},"PeriodicalIF":7.3,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142331900","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Simultaneous evaluation of the imprecision and inconsistency domains of GRADE can be performed using prediction intervals 使用预测区间可同时评估 GRADE 的不精确性和不一致性领域。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-24 DOI: 10.1016/j.jclinepi.2024.111543
M. Hassan Murad , Rebecca L. Morgan , Yngve Falck-Ytter , Reem A. Mustafa , Shahnaz Sultan , Philipp Dahm , Madelin R. Siedler , Osama Altayar , Perica Davitkov , Syed Arsalan Ahmed Naqvi , Irbaz Bin Riaz , Zhen Wang , Lifeng Lin

Objectives

To explore the use of prediction interval (PI) for the simultaneous evaluation of the imprecision and inconsistency domains of Grading of Recommendations, Assessment, and Evaluation using stakeholder-provided decision thresholds.

Study Design and Setting

We propose transforming the PI of a meta-analysis from a relative risk scale to an absolute risk difference using an appropriate baseline risk. The transformed PI is compared to stakeholder-provided thresholds on an absolute scale. We applied this approach to a large convenience sample of meta-analyses extracted from the Cochrane Database of Systematic Reviews and compared it against the traditional approach of rating imprecision and inconsistency separately using confidence intervals and statistical measures of heterogeneity, respectively. We used empirically derived thresholds following Grading of Recommendations, Assessment, and Evaluation guidance.

Results

The convenience sample consisted of 2516 meta-analyses (median of 7 studies per meta-analysis; interquartile range: 5–11). The main analysis showed the percentage of meta-analyses in which both approaches had the same number of certainty levels rated down was 59%. The PI approach led to more levels of rating down (lower certainty) in 27% and to fewer levels of rating down (higher certainty) in 14%. Multiple sensitivity analyses using different thresholds showed similar results, but the PI approach had particularly increased width with a larger number of included studies and higher I2 values.

Conclusion

Using the PI for simultaneous evaluation of imprecision and inconsistency seems feasible and logical but can lead to lower certainty ratings. The PI-based approach requires further testing in future systematic reviews and guidelines using context-specific thresholds and evidence-to-decision criteria.

Plain Language Summary

The prediction interval (PI) addresses both the imprecision and inconsistency domains of certainty. In this study, we applied this PI approach to simultaneously judge both domains and compared this to the traditional approach of making these separate judgments. The 2 approaches had moderate agreement. The PI-based approach requires further testing in future systematic reviews and guidelines using context-specific thresholds and evidence-to-decision criteria.
目的:探索使用预测区间(PI)同时评估 GRADE 的不精确性和不一致性:利用利益相关者提供的决策阈值,探索如何使用预测区间(PI)同时评估 GRADE 的不精确性和不一致性:我们建议使用适当的基线风险将荟萃分析的预测区间从相对风险表转换为绝对风险差。将转换后的 PI 与利益相关者提供的绝对阈值进行比较。我们将这种方法应用于从 Cochrane 系统性综述数据库中提取的大量荟萃分析样本,并将其与分别使用置信区间和异质性统计量对不精确性和不一致性进行评级的传统方法进行了比较。我们按照 GRADE 指南使用了根据经验得出的阈值:方便样本包括 2,516 项元分析(每项元分析的中位数为 7 项研究,四分位数区间为 5-11 项)。主要分析结果表明,在两种方法中,确定性等级下调数量相同的荟萃分析占 59%。PI 方法导致更多等级下调(确定性较低)的占 27%,而导致更少等级下调(确定性较高)的占 14%。使用不同阈值进行的多重敏感性分析显示了相似的结果,但如果纳入的研究数量较多,I2 值较高,PI 方法的宽度尤其会增加:结论:使用 PI 同时评估不精确性和不一致性似乎可行且合乎逻辑,但会导致确定性评级降低。基于 PI 的方法需要在未来的系统综述和指南中使用特定的阈值和证据决定标准进行进一步测试。
{"title":"Simultaneous evaluation of the imprecision and inconsistency domains of GRADE can be performed using prediction intervals","authors":"M. Hassan Murad ,&nbsp;Rebecca L. Morgan ,&nbsp;Yngve Falck-Ytter ,&nbsp;Reem A. Mustafa ,&nbsp;Shahnaz Sultan ,&nbsp;Philipp Dahm ,&nbsp;Madelin R. Siedler ,&nbsp;Osama Altayar ,&nbsp;Perica Davitkov ,&nbsp;Syed Arsalan Ahmed Naqvi ,&nbsp;Irbaz Bin Riaz ,&nbsp;Zhen Wang ,&nbsp;Lifeng Lin","doi":"10.1016/j.jclinepi.2024.111543","DOIUrl":"10.1016/j.jclinepi.2024.111543","url":null,"abstract":"<div><h3>Objectives</h3><div>To explore the use of prediction interval (PI) for the simultaneous evaluation of the imprecision and inconsistency domains of Grading of Recommendations, Assessment, and Evaluation using stakeholder-provided decision thresholds.</div></div><div><h3>Study Design and Setting</h3><div>We propose transforming the PI of a meta-analysis from a relative risk scale to an absolute risk difference using an appropriate baseline risk. The transformed PI is compared to stakeholder-provided thresholds on an absolute scale. We applied this approach to a large convenience sample of meta-analyses extracted from the Cochrane Database of Systematic Reviews and compared it against the traditional approach of rating imprecision and inconsistency separately using confidence intervals and statistical measures of heterogeneity, respectively. We used empirically derived thresholds following Grading of Recommendations, Assessment, and Evaluation guidance.</div></div><div><h3>Results</h3><div>The convenience sample consisted of 2516 meta-analyses (median of 7 studies per meta-analysis; interquartile range: 5–11). The main analysis showed the percentage of meta-analyses in which both approaches had the same number of certainty levels rated down was 59%. The PI approach led to more levels of rating down (lower certainty) in 27% and to fewer levels of rating down (higher certainty) in 14%. Multiple sensitivity analyses using different thresholds showed similar results, but the PI approach had particularly increased width with a larger number of included studies and higher I<sup>2</sup> values.</div></div><div><h3>Conclusion</h3><div>Using the PI for simultaneous evaluation of imprecision and inconsistency seems feasible and logical but can lead to lower certainty ratings. The PI-based approach requires further testing in future systematic reviews and guidelines using context-specific thresholds and evidence-to-decision criteria.</div></div><div><h3>Plain Language Summary</h3><div>The prediction interval (PI) addresses both the imprecision and inconsistency domains of certainty. In this study, we applied this PI approach to simultaneously judge both domains and compared this to the traditional approach of making these separate judgments. The 2 approaches had moderate agreement. The PI-based approach requires further testing in future systematic reviews and guidelines using context-specific thresholds and evidence-to-decision criteria.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"175 ","pages":"Article 111543"},"PeriodicalIF":7.3,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142331899","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A cross-sectional study assessing visual abstracts of randomized trials revealed inadequate reporting and high prevalence of spin 一项对随机试验视觉摘要进行评估的横断面研究显示,报告不充分,自旋现象十分普遍。
IF 7.3 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-24 DOI: 10.1016/j.jclinepi.2024.111544
Melissa Duran , Isabelle Boutron , Sally Hopewell , Hillary Bonnet , Stephanie Sidorkiewicz

Objectives

Visual abstracts (VAs) lack study-specific reporting guidelines and are increasingly used as stand-alone sources in medical research dissemination although not designed for this purpose. Therefore, our objectives were to describe 1) completeness of reporting in VAs and corresponding written abstracts (WAs) of randomized controlled trials (RCTs), and 2) the extent and type of spin (ie, any reporting pattern that could distort result interpretation and mislead readers) in VAs and WAs of RCTs with a statistically nonsignificant primary outcome.

Study Design and Setting

We conducted a cross-sectional study evaluating VAs and WAs of RCTs published between January 1, 2021, and March 3, 2023. We searched MEDLINE via PubMed for reports of RCTs published in the 15 highest impact factor journals from six medical fields (among which 34 journals producing VAs of RCTs were identified). One reviewer identified primary reports of RCTs published with a VA and randomly selected a maximum of 10 reports from each journal to avoid overrepresentation. The completeness of reporting assessment was based on the Consolidated Standards of Reporting Trials extension for abstracts. Spin was explored using a standardized spin classification for RCTs with statistically nonsignificant primary outcome results. Both assessments were conducted in duplicate, with discussion until consensus in case of discrepancy.

Results

A random sample of 253 reports from 34 journals was identified. The information provided in VAs was frequently incomplete: primary outcome identification, primary outcome results, and harms were respectively described or displayed in only 47% (n = 116/247), 30% (n = 75/247), and 35% (n = 88/253). Reporting was slightly better for some items in WAs, although still unsatisfactory. Among trials with nonsignificant primary outcome results (n = 101), 57% (n = 58) of the VAs and 55% (n = 56) of the WAs exhibited at least 1 type of spin. Posthoc analyses showed VAs produced by journal editors of high-impact general medical journals were more complete and more accurate than those produced by specialty journals or authors.

Conclusion

The information conveyed in VAs was frequently incomplete and inaccurate, highlighting the urgent need to refer to appropriate specific reporting guidelines to avoid misinterpretation by readers.
目的:可视化摘要(VAs)缺乏针对特定研究的报告指南,在医学研究传播中被越来越多地用作独立来源,尽管并非为此目的而设计。因此,我们的目标是描述:1)随机对照试验(RCT)的可视化摘要和相应的书面摘要(WAs)中报告的完整性;2)主要结果无统计学意义的 RCT 的可视化摘要和书面摘要中旋转的程度和类型(即任何可能扭曲结果解释和误导读者的报告模式):我们进行了一项横断面研究,评估了 2021 年 1 月 1 日至 2023 年 3 月 31 日期间发表的 RCT 的 VAs 和 WAs。我们通过 PubMed 在 MEDLINE 上检索了六个医学领域中影响因子最高的 15 种期刊上发表的 RCT 报告(其中有 34 种期刊发表了 RCT 的 VAs)。一位审稿人确定了发表了VA的RCT的主要报告,并从每份期刊中随机抽取了最多10份报告,以避免代表性过强。报告完整性评估基于 CONSORT 的摘要扩展。对于主要结果无统计学意义的 RCT,则采用标准化的自旋分类法对自旋进行探讨。两项评估均一式两份,如有差异,则进行讨论直至达成共识:随机抽取了 34 种期刊中的 253 篇报告。VAs中提供的信息经常不完整:分别只有47%(n=116/247)、30%(n=75/247)和35%(n=88/253)的VAs描述或显示了主要结果识别、主要结果结果和危害。WA中某些项目的报告情况略有改善,但仍不能令人满意。在主要结果不显著的试验中(n=101),57%(n=58)的自愿者协会和 55%(n=56)的自愿者工作组至少表现出一种类型的旋转。事后分析表明,与专业期刊或作者相比,影响力大的普通医学期刊编辑所撰写的VAs更完整、更准确:自愿性声明中传达的信息经常不完整、不准确,因此迫切需要参考适当的具体报告指南,以避免读者误读。
{"title":"A cross-sectional study assessing visual abstracts of randomized trials revealed inadequate reporting and high prevalence of spin","authors":"Melissa Duran ,&nbsp;Isabelle Boutron ,&nbsp;Sally Hopewell ,&nbsp;Hillary Bonnet ,&nbsp;Stephanie Sidorkiewicz","doi":"10.1016/j.jclinepi.2024.111544","DOIUrl":"10.1016/j.jclinepi.2024.111544","url":null,"abstract":"<div><h3>Objectives</h3><div>Visual abstracts (VAs) lack study-specific reporting guidelines and are increasingly used as stand-alone sources in medical research dissemination although not designed for this purpose. Therefore, our objectives were to describe 1) completeness of reporting in VAs and corresponding written abstracts (WAs) of randomized controlled trials (RCTs), and 2) the extent and type of spin (ie, any reporting pattern that could distort result interpretation and mislead readers) in VAs and WAs of RCTs with a statistically nonsignificant primary outcome.</div></div><div><h3>Study Design and Setting</h3><div>We conducted a cross-sectional study evaluating VAs and WAs of RCTs published between January 1, 2021, and March 3, 2023. We searched MEDLINE via PubMed for reports of RCTs published in the 15 highest impact factor journals from six medical fields (among which 34 journals producing VAs of RCTs were identified). One reviewer identified primary reports of RCTs published with a VA and randomly selected a maximum of 10 reports from each journal to avoid overrepresentation. The completeness of reporting assessment was based on the Consolidated Standards of Reporting Trials extension for abstracts. Spin was explored using a standardized spin classification for RCTs with statistically nonsignificant primary outcome results. Both assessments were conducted in duplicate, with discussion until consensus in case of discrepancy.</div></div><div><h3>Results</h3><div>A random sample of 253 reports from 34 journals was identified. The information provided in VAs was frequently incomplete: primary outcome identification, primary outcome results, and harms were respectively described or displayed in only 47% (<em>n</em> = 116/247), 30% (<em>n</em> = 75/247), and 35% (<em>n</em> = 88/253). Reporting was slightly better for some items in WAs, although still unsatisfactory. Among trials with nonsignificant primary outcome results (<em>n</em> = 101), 57% (<em>n</em> = 58) of the VAs and 55% (<em>n</em> = 56) of the WAs exhibited at least 1 type of spin. Posthoc analyses showed VAs produced by journal editors of high-impact general medical journals were more complete and more accurate than those produced by specialty journals or authors.</div></div><div><h3>Conclusion</h3><div>The information conveyed in VAs was frequently incomplete and inaccurate, highlighting the urgent need to refer to appropriate specific reporting guidelines to avoid misinterpretation by readers.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"176 ","pages":"Article 111544"},"PeriodicalIF":7.3,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142331896","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Clinical Epidemiology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1