首页 > 最新文献

Cochrane Evidence Synthesis and Methods最新文献

英文 中文
A scoping review: Screening questionnaires for identifying tanning addiction 范围审查:识别日晒成瘾的筛查问卷
Pub Date : 2024-06-27 DOI: 10.1002/cesm.12092
John Meisenheimer, Michelle Sobotka, Ronald Yang, Robert P. Dellavalle

Introduction

There is a growing body of evidence that ultraviolet (UV) tanning, whether practiced in indoor tanning salons or outdoors in the sun, is not only linked to detrimental health outcomes but is also addictive through both psychological and physiological mechanisms. In clinical practice, it can be challenging to determine which patients will continue tanning despite being at high risk for developing skin cancer. Our study seeks to identify all available screening questionnaires for tanning addiction that could be used in clinical practice and report on published measures of validity for each screening questionnaire.

Methods

An exhaustive literature search of EMBASE, PubMed, PsycINFO, and Scopus was performed using search criteria including the concepts “UV” and “Addiction.” The most recent search was performed in March 2024 and included all articles from database inception to the time of the search. Studies were included if they reported on screening questionnaires for UV addiction. Articles were excluded from the study if they did not report primary data or did not report on measures of questionnaire validity. Methodology was created using best practices for scoping reviews.

Results

After identifying 171 articles, 106 articles underwent full-text review, and 26 were included in data extraction. We identified nine questionnaires for tanning addiction, with the modified Cut-down, Annoyed, Guilty, Eye-opener (mCAGE), and modified Diagnostic and Statistical Manual of Mental Disorders (mDSM) being most frequently reported on, and the Behavioral Addiction Indoor Tanning Screener (BAITS) being the most promising for future use.

Conclusions

This information should be used to choose questionnaires to be studied against a “gold-standard” of a panel of psychologists. After defining accuracy of diagnostic tests, studies can be designed to examine interventions for treating tanning addiction, so at-risk patients can receive specialized therapy, reducing the overall burden of skin cancers.

导言:越来越多的证据表明,无论是在室内日光浴沙龙还是在户外阳光下进行的紫外线(UV)晒黑,不仅与有害健康的结果有关,而且还会通过心理和生理机制使人上瘾。在临床实践中,要确定哪些患者在有罹患皮肤癌高风险的情况下仍会继续晒黑是一项挑战。我们的研究旨在找出所有可用于临床实践的日晒成瘾筛查问卷,并报告已发表的每份筛查问卷的有效性测量结果。 方法 对 EMBASE、PubMed、PsycINFO 和 Scopus 进行了详尽的文献检索,检索标准包括 "紫外线 "和 "成瘾 "两个概念。最近一次检索是在 2024 年 3 月进行的,包括从数据库建立到检索期间的所有文章。如果研究报告对紫外线成瘾的筛查问卷进行了报告,则将其纳入研究。未报告原始数据或未报告问卷有效性测量方法的文章将被排除在研究之外。研究方法采用了范围界定综述的最佳实践。 结果 在确定了 171 篇文章后,对 106 篇文章进行了全文审阅,其中 26 篇文章被纳入数据提取范围。我们确定了九种关于日晒成瘾的问卷,其中改良的 "沮丧、恼怒、内疚、睁眼"(mCAGE)和改良的《精神障碍诊断与统计手册》(mDSM)最常被报道,而 "行为成瘾室内日晒筛选器"(BAITS)最有希望在未来使用。 结论 应利用这些信息来选择问卷,并根据心理学家小组的 "黄金标准 "进行研究。在确定诊断测试的准确性后,就可以设计研究来检查治疗日光浴成瘾的干预措施,这样高危患者就可以接受专门的治疗,从而减轻皮肤癌的总体负担。
{"title":"A scoping review: Screening questionnaires for identifying tanning addiction","authors":"John Meisenheimer,&nbsp;Michelle Sobotka,&nbsp;Ronald Yang,&nbsp;Robert P. Dellavalle","doi":"10.1002/cesm.12092","DOIUrl":"https://doi.org/10.1002/cesm.12092","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>There is a growing body of evidence that ultraviolet (UV) tanning, whether practiced in indoor tanning salons or outdoors in the sun, is not only linked to detrimental health outcomes but is also addictive through both psychological and physiological mechanisms. In clinical practice, it can be challenging to determine which patients will continue tanning despite being at high risk for developing skin cancer. Our study seeks to identify all available screening questionnaires for tanning addiction that could be used in clinical practice and report on published measures of validity for each screening questionnaire.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>An exhaustive literature search of EMBASE, PubMed, PsycINFO, and Scopus was performed using search criteria including the concepts “UV” and “Addiction.” The most recent search was performed in March 2024 and included all articles from database inception to the time of the search. Studies were included if they reported on screening questionnaires for UV addiction. Articles were excluded from the study if they did not report primary data or did not report on measures of questionnaire validity. Methodology was created using best practices for scoping reviews.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>After identifying 171 articles, 106 articles underwent full-text review, and 26 were included in data extraction. We identified nine questionnaires for tanning addiction, with the modified Cut-down, Annoyed, Guilty, Eye-opener (mCAGE), and modified Diagnostic and Statistical Manual of Mental Disorders (mDSM) being most frequently reported on, and the Behavioral Addiction Indoor Tanning Screener (BAITS) being the most promising for future use.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>This information should be used to choose questionnaires to be studied against a “gold-standard” of a panel of psychologists. After defining accuracy of diagnostic tests, studies can be designed to examine interventions for treating tanning addiction, so at-risk patients can receive specialized therapy, reducing the overall burden of skin cancers.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12092","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141488519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-world evaluation of interconsensus agreement of risk of bias tools: A case study using risk of bias in nonrandomized studies-of interventions (ROBINS-I) 对偏倚风险工具达成共识的真实世界评估:使用非随机干预研究中的偏倚风险(ROBINS-I)进行案例研究
Pub Date : 2024-06-26 DOI: 10.1002/cesm.12094
Samer Saadi, Bashar Hasan, Adel Kanaan, Mohamed Abusalih, Zin Tarakji, Mustafa Sadek, Ayla Shamsi Basha, Mohammed Firwana, Zhen Wang, M. Hassan Murad

Background

Risk of bias (RoB) tools are critical in systematic reviews and affect subsequent decision-making. RoB tools should have adequate interrater reliability and interconsensus agreement. We present an approach of post hoc evaluation of RoB tools using duplicated studies that overlap systematic reviews.

Methods

Using a back-citation approach, we identified systematic reviews that used the Risk Of Bias In Nonrandomized Studies-of Interventions (ROBINS-I) tool and retrieved all the included primary studies. We selected studies that were appraised by more than one systematic review and calculated observed agreement and unweighted kappa comparing the different systematic reviews' assessments.

Results

We identified 903 systematic reviews that used the tool with 51,676 cited references, from which we eventually analyzed 171 duplicated studies assessed using ROBINS-I by different systematic reviewers. The observed agreement on ROBINS-I domains ranged from 54.9% (missing data domain) to 70.3% (deviations from intended interventions domain), and was 63.0% for overall RoB assessment of the study. Kappa coefficient ranged from 0.131 (measurement of outcome domain) to 0.396 (domains of confounding and deviations from intended interventions), and was 0.404 for overall RoB assessment of the study.

Conclusion

A post hoc evaluation of RoB tools is feasible by focusing on duplicated studies that overlap systematic review. ROBINS-I assessments demonstrated considerable variation in interconsensus agreement among various systematic reviewes that assessed the same study and outcome, suggesting the need for more intensive upfront work to calibrate systematic reviewers on how to identify context-specific information and agree on how to judge it.

背景偏倚风险(RoB)工具在系统综述中至关重要,并影响后续决策。RoB工具应具有足够的研究者间可靠性和共识性。我们提出了一种利用与系统综述重叠的重复研究对 RoB 工具进行事后评估的方法。 方法 采用反向引用法,我们确定了使用非随机干预研究中的偏倚风险(ROBINS-I)工具的系统综述,并检索了所有纳入的主要研究。我们选择了由一篇以上系统综述评估的研究,并计算了比较不同系统综述评估的观察一致度和非加权卡帕值。 结果 我们确定了 903 篇使用该工具的系统综述,共引用了 51676 篇参考文献,最终从中分析出 171 篇由不同系统综述作者使用 ROBINS-I 评估的重复研究。观察到的 ROBINS-I 领域的一致性从 54.9%(数据缺失领域)到 70.3%(偏离预期干预领域)不等,对研究的整体 RoB 评估的一致性为 63.0%。Kappa 系数从 0.131(结果测量域)到 0.396(混杂域和偏离预期干预域)不等,研究的整体 RoB 评估为 0.404。 结论 通过关注与系统审查重叠的重复研究,对 RoB 工具进行事后评估是可行的。ROBINS-I 评估表明,在评估同一研究和结果的不同系统综述中,共识之间的一致性存在很大差异,这表明需要开展更深入的前期工作,以校准系统综述者如何识别特定背景信息并就如何判断这些信息达成一致。
{"title":"Real-world evaluation of interconsensus agreement of risk of bias tools: A case study using risk of bias in nonrandomized studies-of interventions (ROBINS-I)","authors":"Samer Saadi,&nbsp;Bashar Hasan,&nbsp;Adel Kanaan,&nbsp;Mohamed Abusalih,&nbsp;Zin Tarakji,&nbsp;Mustafa Sadek,&nbsp;Ayla Shamsi Basha,&nbsp;Mohammed Firwana,&nbsp;Zhen Wang,&nbsp;M. Hassan Murad","doi":"10.1002/cesm.12094","DOIUrl":"https://doi.org/10.1002/cesm.12094","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Risk of bias (RoB) tools are critical in systematic reviews and affect subsequent decision-making. RoB tools should have adequate interrater reliability and interconsensus agreement. We present an approach of post hoc evaluation of RoB tools using duplicated studies that overlap systematic reviews.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Using a back-citation approach, we identified systematic reviews that used the Risk Of Bias In Nonrandomized Studies-of Interventions (ROBINS-I) tool and retrieved all the included primary studies. We selected studies that were appraised by more than one systematic review and calculated observed agreement and unweighted kappa comparing the different systematic reviews' assessments.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We identified 903 systematic reviews that used the tool with 51,676 cited references, from which we eventually analyzed 171 duplicated studies assessed using ROBINS-I by different systematic reviewers. The observed agreement on ROBINS-I domains ranged from 54.9% (missing data domain) to 70.3% (deviations from intended interventions domain), and was 63.0% for overall RoB assessment of the study. Kappa coefficient ranged from 0.131 (measurement of outcome domain) to 0.396 (domains of confounding and deviations from intended interventions), and was 0.404 for overall RoB assessment of the study.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>A post hoc evaluation of RoB tools is feasible by focusing on duplicated studies that overlap systematic review. ROBINS-I assessments demonstrated considerable variation in interconsensus agreement among various systematic reviewes that assessed the same study and outcome, suggesting the need for more intensive upfront work to calibrate systematic reviewers on how to identify context-specific information and agree on how to judge it.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12094","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141488174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How to present an informative summary of findings table for systematic reviews of interventions: A tutorial 如何为干预措施的系统性综述提供翔实的研究结果摘要表:教程
Pub Date : 2024-06-19 DOI: 10.1002/cesm.12093
Jennifer Hilgart, Clare Miles, Jo-Ana Chase

This tutorial provides guidance on creating clear and informative summary of findings tables for systematic reviews of interventions.

本教程指导如何为干预措施的系统综述创建清晰翔实的研究结果摘要表。
{"title":"How to present an informative summary of findings table for systematic reviews of interventions: A tutorial","authors":"Jennifer Hilgart,&nbsp;Clare Miles,&nbsp;Jo-Ana Chase","doi":"10.1002/cesm.12093","DOIUrl":"https://doi.org/10.1002/cesm.12093","url":null,"abstract":"<p>This tutorial provides guidance on creating clear and informative summary of findings tables for systematic reviews of interventions.</p>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12093","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141435607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Equity in evidence synthesis: You can't play on broken strings 证据合成中的公平:断弦不能弹
Pub Date : 2024-06-18 DOI: 10.1002/cesm.12091
Tamara Lotfi, Vivian Welch, Jordi P. Pardo, Jennifer Petkovic, Shaun Treweek, Andrea J. Darzi, Rebecca Glover, Declan Devane, Meera Viswanathan, Lawrence Mbuagbaw, Kevin Pottie, Elizabeth Kristjansson, Shahab Sayfi, Lara Maxwell, Olivia Magwood, Damian Francis, Dru Riddle, Beverly Shea, Peter Tugwell

In the 2022 Cochrane Lecture [1], Jimmy Volmink, recognized as a pioneer of evidence-based medicine in Africa, challenged Cochrane to enhance its equity efforts and suggested five ways to do so. We, as members of the Campbell and Cochrane Health Equity Thematic group*, fully agree with his suggestions and have developed an actionable plan, described below. We invite the global community to join us in our efforts to meet the equity gaps in research and practice.

Population health and healthcare delivery should be equitable and the research that guides it equity sensitive. By this, we mean that we need to focus on the distribution of health outcomes in the population not just overall health. That is, people should have equal opportunities for health and are not subjected to systemic discrimination or structural barriers to health. It is an ambitious goal and one that many of us who work in healthcare delivery and health research are striving for.

This includes those of us who work in evidence synthesis. Synthesizers of other researchers' evidence may think that our handling of equity cannot be better than the handling of equity in the research we synthesize. We, as members of the Campbell and Cochrane Health Equity Thematic Group, disagree. To truly address inequity, evidence synthesis must take into account equity considerations in a systematic and explicit manner, regardless of how equity was addressed in the original research. We believe that evidence synthesis should lead the way in promoting equity, rather than simply reflecting the approaches taken in the primary research that is included in our reviews (Box 1).

We fully agree that Cochrane cannot succeed in better addressing health equity in systematic reviews without also addressing inequities in its own organization and governance. As members of the Campbell and Cochrane Health Equity Thematic group, we commit to the following actions.

Tamara Lotfi: Conceptualization, writing—original draft, reviewing and editing. Vivian Welch: Conceptualization, writing—original draft, review & editing. Jordi P. Pardo: Conceptualization, writing—original draft, review & editing. Jennifer Petkovic: Conceptualization, writing—original draft, review & editing. Shaun Treweek: Writing—review & editing. Andrea Darzi: Writing—review & editing. Rebecca Glover: Writing—review & editing. Declan Devane: Writing—review & editing. Meera Viswanathan: Writing—review & editing. Lawrence Mbuagbaw: Writing—review & editing. Kevin Pottie: Writing—review & editing. Elizabeth Kristjansson: Writing—review & editing. Shahab Sayfi: Writing—review & editing. Lara Maxwell: Writing—review & editing. Olivia Magwood: Writing—review & editing. Damian Francis: Writing—review & editing. Dru Riddle: Writing—review & ed

在 2022 年的科克伦讲座[1]中,被公认为非洲循证医学先驱的吉米-沃尔明克(Jimmy Volmink)向科克伦提出挑战,要求其加强公平工作,并提出了五种方法。作为坎贝尔和科克伦健康公平专题小组*的成员,我们完全同意他的建议,并制定了如下可行计划。我们邀请全球社会与我们一起努力,弥补研究与实践中的公平差距。我们的意思是,我们需要关注健康结果在人口中的分布,而不仅仅是整体健康。也就是说,人们应享有平等的健康机会,不受系统性歧视或结构性健康障碍的影响。这是一个雄心勃勃的目标,也是我们中许多从事医疗保健服务和健康研究的人正在努力实现的目标。综合其他研究人员证据的人可能会认为,我们对公平的处理不可能比我们综合的研究对公平的处理更好。作为坎贝尔与科克伦健康公平专题小组的成员,我们对此不敢苟同。要真正解决不公平问题,无论原始研究中如何处理公平问题,证据综述都必须以系统、明确的方式考虑公平因素。我们完全同意,如果不解决自身组织和管理中的不公平问题,科克伦就无法在系统性综述中更好地解决健康公平问题。作为 Campbell 和 Cochrane 健康公平专题小组的成员,我们承诺采取以下行动:构思、撰写初稿、审阅和编辑。薇薇安-韦尔奇构思、撰写初稿、审阅和编辑。Jordi P. Pardo:概念化、撰写-原稿、审阅和编辑。Jennifer Petkovic:构思、撰写-原稿、审阅和编辑。肖恩-特鲁维克撰写、审阅和编辑安德烈娅-达尔齐写作-审阅和编辑丽贝卡-格洛弗撰稿-审核-编辑迪克兰-德文撰稿-审核-编辑梅拉-维斯瓦纳坦撰稿-审核-编辑劳伦斯-姆布阿格巴乌撰稿-审核-编辑凯文-波蒂撰写-审核-编辑伊丽莎白-克里斯詹森(Elizabeth Kristjansson):撰稿-审稿和编辑。沙哈布-赛菲撰写-审核-编辑劳拉-麦克斯韦尔撰写-审核-编辑奥利维亚-麦格伍德撰稿-审核-编辑达米安-弗朗西斯撰稿-审核-编辑德鲁-里德尔撰写-审核-编辑贝弗利-谢:撰稿-审核-编辑彼得-塔格韦尔JPP 是 Cochrane 理事会成员。其余作者声明无利益冲突。
{"title":"Equity in evidence synthesis: You can't play on broken strings","authors":"Tamara Lotfi,&nbsp;Vivian Welch,&nbsp;Jordi P. Pardo,&nbsp;Jennifer Petkovic,&nbsp;Shaun Treweek,&nbsp;Andrea J. Darzi,&nbsp;Rebecca Glover,&nbsp;Declan Devane,&nbsp;Meera Viswanathan,&nbsp;Lawrence Mbuagbaw,&nbsp;Kevin Pottie,&nbsp;Elizabeth Kristjansson,&nbsp;Shahab Sayfi,&nbsp;Lara Maxwell,&nbsp;Olivia Magwood,&nbsp;Damian Francis,&nbsp;Dru Riddle,&nbsp;Beverly Shea,&nbsp;Peter Tugwell","doi":"10.1002/cesm.12091","DOIUrl":"https://doi.org/10.1002/cesm.12091","url":null,"abstract":"<p>In the 2022 Cochrane Lecture [<span>1</span>], Jimmy Volmink, recognized as a pioneer of evidence-based medicine in Africa, challenged Cochrane to enhance its equity efforts and suggested five ways to do so. We, as members of the Campbell and Cochrane Health Equity Thematic group*, fully agree with his suggestions and have developed an actionable plan, described below. We invite the global community to join us in our efforts to meet the equity gaps in research and practice.</p><p>Population health and healthcare delivery should be equitable and the research that guides it equity sensitive. By this, we mean that we need to focus on the distribution of health outcomes in the population not just overall health. That is, people should have equal opportunities for health and are not subjected to systemic discrimination or structural barriers to health. It is an ambitious goal and one that many of us who work in healthcare delivery and health research are striving for.</p><p>This includes those of us who work in evidence synthesis. Synthesizers of other researchers' evidence may think that our handling of equity cannot be better than the handling of equity in the research we synthesize. We, as members of the Campbell and Cochrane Health Equity Thematic Group, disagree. To truly address inequity, evidence synthesis must take into account equity considerations in a systematic and explicit manner, regardless of how equity was addressed in the original research. We believe that evidence synthesis should lead the way in promoting equity, rather than simply reflecting the approaches taken in the primary research that is included in our reviews (Box 1).</p><p>We fully agree that Cochrane cannot succeed in better addressing health equity in systematic reviews without also addressing inequities in its own organization and governance. As members of the Campbell and Cochrane Health Equity Thematic group, we commit to the following actions.</p><p><b>Tamara Lotfi</b>: Conceptualization, writing—original draft, reviewing and editing. <b>Vivian Welch</b>: Conceptualization, writing—original draft, review &amp; editing. <b>Jordi P. Pardo</b>: Conceptualization, writing—original draft, review &amp; editing. <b>Jennifer Petkovic</b>: Conceptualization, writing—original draft, review &amp; editing. <b>Shaun Treweek</b>: Writing—review &amp; editing. <b>Andrea Darzi</b>: Writing—review &amp; editing. <b>Rebecca Glover</b>: Writing—review &amp; editing. <b>Declan Devane</b>: Writing—review &amp; editing. <b>Meera Viswanathan</b>: Writing—review &amp; editing. <b>Lawrence Mbuagbaw</b>: Writing—review &amp; editing. <b>Kevin Pottie</b>: Writing—review &amp; editing. <b>Elizabeth Kristjansson</b>: Writing—review &amp; editing. <b>Shahab Sayfi</b>: Writing—review &amp; editing. <b>Lara Maxwell</b>: Writing—review &amp; editing. <b>Olivia Magwood</b>: Writing—review &amp; editing. <b>Damian Francis</b>: Writing—review &amp; editing. <b>Dru Riddle</b>: Writing—review &amp; ed","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12091","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141425124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advisory groups in realist reviews: Systematically mapping current research and recommendations for practice 现实主义审查中的咨询小组:系统规划当前的研究和实践建议
Pub Date : 2024-06-11 DOI: 10.1002/cesm.12073
Jessica Power, Sara Dada, Andrew Booth, Aoife De Brún, Brynne Gilmore

Introduction

Realist reviews may involve groups or panels external to the research team who provide external and independent perspectives informing the review based on their experience of the topic area. These panels or groups are termed in this study as an “advisory group.” This study aims to map current practice of advisory groups in realist reviews and provide guidance for planning and reporting.

Methods

A “best-fit” framework synthesis methodology was used by first searching for a best-fit framework and then conducting a systematic search to identify a sample of realist reviews and rapid realist reviews (RRRs) from the most recent year, 2021. Nine databases were searched: CINAHL Complete, Cochrane, Embase, ERIC, MEDLINE, PsycInfo, Social Services Abstracts, Sociological Abstracts, and Web of Science Core Collection. Screening and data extraction was conducted by two researchers. The chosen best-fit framework (ACTIVE framework) informed the data extraction tool.

Results

One hundred and seven reviews (93 realist reviews, 14 RRRs) were identified for inclusion. Of these, 40% (n = 37) of realist reviews and 71.5% (n = 10) of RRRs mentioned use of an advisory group, though there was considerable variation in terminology used. Individuals in advisory groups were involved at varying stages of the review and tended to bring experience in the topic area from the perspective of (i) a lived experience, that is, patients, carers, family members (n = 15 realist reviews; n = 4 RRRs); (ii) professional experience, such as healthcare professionals (n = 20 realist reviews; n = 6 RRRs); or (iii) policy or research experience in the topic area (n = 19 realist reviews; n = 7 RRRs).

Conclusions

This study proposes a  definition of advisory groups, considerations for advisory group use, and suggested items for reporting. The purpose of the advisory group should be carefully considered when deciding on their use in a realist review.

引言 现实主义审查可能会涉及研究团队以外的小组或专家团,他们根据自己在专题领域的经验为审查提供外部和独立的观点。本研究将这些小组称为 "顾问小组"。本研究旨在描绘现实主义研究中咨询小组的当前实践,并为规划和报告提供指导。 方法 采用 "最合适 "框架综合法,首先搜索最合适的框架,然后进行系统搜索,以确定最近一年(2021 年)的现实主义研究综述和快速现实主义研究综述 (RRR) 的样本。共检索了九个数据库:CINAHL Complete、Cochrane、Embase、ERIC、MEDLINE、PsycInfo、Social Services Abstracts、Sociological Abstracts 和 Web of Science Core Collection。筛选和数据提取由两名研究人员进行。所选的最合适框架(ACTIVE 框架)为数据提取工具提供了参考。 结果 有 107 篇综述(93 篇现实主义综述,14 篇研究报告)被确定纳入。其中,40%(n = 37)的现实主义研究综述和 71.5%(n = 10)的研究报告提到了咨询小组的使用情况,但使用的术语存在很大差异。咨询小组的成员参与了不同阶段的综述,并倾向于从以下角度提供专题领域的经验:(i) 生活经验,即患者、护理人员、家庭成员(n = 15 项现实主义综述;n = 4 项研究报告);(ii) 专业经验,如医疗保健专业人员(n = 20 项现实主义综述;n = 6 项研究报告);或 (iii) 专题领域的政策或研究经验(n = 19 项现实主义综述;n = 7 项研究报告)。 结论 本研究提出了咨询小组的定义、使用咨询小组的注意事项以及建议的报告项目。在决定是否在现实主义研究中使用咨询小组时,应仔细考虑其目的。
{"title":"Advisory groups in realist reviews: Systematically mapping current research and recommendations for practice","authors":"Jessica Power,&nbsp;Sara Dada,&nbsp;Andrew Booth,&nbsp;Aoife De Brún,&nbsp;Brynne Gilmore","doi":"10.1002/cesm.12073","DOIUrl":"https://doi.org/10.1002/cesm.12073","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Realist reviews may involve groups or panels external to the research team who provide external and independent perspectives informing the review based on their experience of the topic area. These panels or groups are termed in this study as an “advisory group.” This study aims to map current practice of advisory groups in realist reviews and provide guidance for planning and reporting.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A “best-fit” framework synthesis methodology was used by first searching for a best-fit framework and then conducting a systematic search to identify a sample of realist reviews and rapid realist reviews (RRRs) from the most recent year, 2021. Nine databases were searched: CINAHL Complete, Cochrane, Embase, ERIC, MEDLINE, PsycInfo, Social Services Abstracts, Sociological Abstracts, and Web of Science Core Collection. Screening and data extraction was conducted by two researchers. The chosen best-fit framework (ACTIVE framework) informed the data extraction tool.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>One hundred and seven reviews (93 realist reviews, 14 RRRs) were identified for inclusion. Of these, 40% (<i>n</i> = 37) of realist reviews and 71.5% (<i>n</i> = 10) of RRRs mentioned use of an advisory group, though there was considerable variation in terminology used. Individuals in advisory groups were involved at varying stages of the review and tended to bring experience in the topic area from the perspective of (i) a lived experience, that is, patients, carers, family members (<i>n</i> = 15 realist reviews; <i>n</i> = 4 RRRs); (ii) professional experience, such as healthcare professionals (<i>n</i> = 20 realist reviews; <i>n</i> = 6 RRRs); or (iii) policy or research experience in the topic area (<i>n</i> = 19 realist reviews; <i>n</i> = 7 RRRs).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>This study proposes a  definition of advisory groups, considerations for advisory group use, and suggested items for reporting. The purpose of the advisory group should be carefully considered when deciding on their use in a realist review.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12073","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141304224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The searchbuildR shiny app: A new implementation of the objective approach for search strategy development in systematic reviews searchbuildR闪亮应用程序:系统综述检索策略开发目标方法的新实施方案
Pub Date : 2024-06-11 DOI: 10.1002/cesm.12078
Claudia Kapp, Naomi Fujita-Rohwerder, Jona Lilienthal, Wiebke Sieben, Siw Waffenschmidt, Elke Hausner

Introduction

One of the main tasks in information retrieval is the development of Boolean search strategies for systematic searches in bibliographic databases. This includes the identification of free-text terms and controlled vocabulary. IQWiG has previously implemented its objective approach for search strategy development using a fee-based text analysis software. However, this implementation is not fully automated, due to a lack of technical options. The aim of our project was to develop a text analysis tool for the development of Boolean search strategies using R.

Methods

We adopt an incremental approach to software development, with the first goal being to develop a minimum viable product for the previously defined use cases. To create an interactive user interface, we use the shiny framework.

Results

Our newly developed shiny app searchbuildR is a text analysis tool with a point-and-click user interface, that automatically extracts and ranks terms from titles, abstracts, and MeSH terms of a given test set of PubMed records. It returns searchable, interactive tables of free-text and MeSH terms. Each free-text term can also be viewed within its original context in the full titles and abstracts or in a user-defined word window. In addition, 2-word combinations are extracted and also provided as an interactive table to help the user identify free-text term combinations, that can be searched with proximity operators in Boolean searches. The results can be exported to a CSV file. The new implementation with searchbuildR was evaluated by validating the text analysis results against the results of the previously used fee-based software.

Conclusions

QWiG has developed the shiny app searchbuildR to support the development of search strategies in systematic reviews. It is open source and can be used by researchers and other information specialists without extensive R or programming skills. The package code is openly available on GitHub at www.github.com/IQWiG/searchbuildR.

引言 信息检索的主要任务之一是为书目数据库的系统检索制定布尔检索策略。这包括识别自由文本术语和控制词汇。IQWiG 以前曾使用收费的文本分析软件来实施制定检索策略的目标方法。然而,由于缺乏技术选择,这种实施方法并非完全自动化。我们项目的目的是开发一个文本分析工具,用于使用 R 开发布尔搜索策略。方法 我们采用渐进式方法进行软件开发,第一个目标是为之前定义的用例开发一个最小可行产品。为了创建交互式用户界面,我们使用了 shiny 框架。 结果 我们新开发的shiny应用程序searchbuildR是一款具有点击式用户界面的文本分析工具,可自动从给定的PubMed记录测试集中的标题、摘要和MeSH术语中提取术语并对其进行排序。它可返回可搜索的自由文本和 MeSH 术语交互式表格。每个自由文本术语还可以在完整标题和摘要的原始上下文中或在用户定义的单词窗口中查看。此外,还可提取 2 个词的组合,并以交互式表格的形式提供,以帮助用户识别自由文本术语组合,这些组合可在布尔搜索中使用邻近操作符进行搜索。搜索结果可导出为 CSV 文件。通过将文本分析结果与以前使用的收费软件的结果进行对比,对 searchbuildR 的新实施方案进行了评估。 结论 QWiG 开发了一款闪亮的应用程序 searchbuildR,以支持系统综述中检索策略的开发。它是开源软件,研究人员和其他信息专家无需具备丰富的 R 语言或编程技能即可使用。软件包代码可在 GitHub 上公开获取:www.github.com/IQWiG/searchbuildR。
{"title":"The searchbuildR shiny app: A new implementation of the objective approach for search strategy development in systematic reviews","authors":"Claudia Kapp,&nbsp;Naomi Fujita-Rohwerder,&nbsp;Jona Lilienthal,&nbsp;Wiebke Sieben,&nbsp;Siw Waffenschmidt,&nbsp;Elke Hausner","doi":"10.1002/cesm.12078","DOIUrl":"https://doi.org/10.1002/cesm.12078","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>One of the main tasks in information retrieval is the development of Boolean search strategies for systematic searches in bibliographic databases. This includes the identification of free-text terms and controlled vocabulary. IQWiG has previously implemented its objective approach for search strategy development using a fee-based text analysis software. However, this implementation is not fully automated, due to a lack of technical options. The aim of our project was to develop a text analysis tool for the development of Boolean search strategies using R.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We adopt an incremental approach to software development, with the first goal being to develop a minimum viable product for the previously defined use cases. To create an interactive user interface, we use the shiny framework.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>Our newly developed shiny app searchbuildR is a text analysis tool with a point-and-click user interface, that automatically extracts and ranks terms from titles, abstracts, and MeSH terms of a given test set of PubMed records. It returns searchable, interactive tables of free-text and MeSH terms. Each free-text term can also be viewed within its original context in the full titles and abstracts or in a user-defined word window. In addition, 2-word combinations are extracted and also provided as an interactive table to help the user identify free-text term combinations, that can be searched with proximity operators in Boolean searches. The results can be exported to a CSV file. The new implementation with searchbuildR was evaluated by validating the text analysis results against the results of the previously used fee-based software.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>QWiG has developed the shiny app searchbuildR to support the development of search strategies in systematic reviews. It is open source and can be used by researchers and other information specialists without extensive R or programming skills. The package code is openly available on GitHub at www.github.com/IQWiG/searchbuildR.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12078","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141304225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing CAMELOT for assessing methodological limitations of qualitative research for inclusion in qualitative evidence syntheses 开发 CAMELOT,用于评估定性研究的方法论局限性,以便纳入定性证据综述
Pub Date : 2024-06-08 DOI: 10.1002/cesm.12058
Heather M. Munthe-Kaas, Andrew Booth, Isolde Sommer, Sara Cooper, Ruth Garside, Karin Hannes, Jane Noyes, The CAMELOT Development Group

Introduction

Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.

Methods

We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.

Results

CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four Meta domains that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight Method domains which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the Meta and Method domains.

Conclusion

CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between Meta and Method domains. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.

引言 定性证据越来越多地被纳入决策过程。评估主要研究的方法学局限性对于使用 GRADE-CERQual 对定性证据综述(QES)结果的可信度进行整体评估至关重要。目前的批判性评估工具并不是专门为 Cochrane 综述或 GRADE-CERQual 而开发的,也很少有以证据为基础的工具。CochrAne定性方法学限制工具(CAMELOT)旨在弥补这一不足。 方法 我们分四个阶段开展了该项目:(1)系统性文献检索,以确定现有工具;(2)确定证据,以支持纳入潜在的 CAMELOT 领域;(3)共识调查,以就 CAMELOT 领域的纳入和定义达成一致;(4)以人为本的设计方法,通过探索用户体验来开发和完善 CAMELOT。 结果 CAMELOT 是一种新的循证工具,用于评估 QES 中主要定性研究的方法优势和局限性。CAMELOT 由 12 个领域组成:4 个元领域鼓励综述作者考虑主要研究的那些特征,这些特征超出了研究如何进行的范围,但为研究的进行和设计提供了信息;8 个方法领域鼓励综述作者考虑研究如何设计、规划和/或进行,以及研究的进行和设计如何与 4 个元领域提供的信息相匹配。综述作者在进行评估时,要确定研究中使用的方法是否存在任何问题,并考虑元域和方法域之间是否合适。 结论 CAMELOT 为综述作者提供了一种透明、系统的方法来评估主要定性研究的方法限制。CAMELOT 融合了定性原则,重点关注 "元 "域和 "方法 "域之间的契合度。根据迭代工具开发方法,CAMELOT 将在广泛的用户测试和试点之后不断进行修订。
{"title":"Developing CAMELOT for assessing methodological limitations of qualitative research for inclusion in qualitative evidence syntheses","authors":"Heather M. Munthe-Kaas,&nbsp;Andrew Booth,&nbsp;Isolde Sommer,&nbsp;Sara Cooper,&nbsp;Ruth Garside,&nbsp;Karin Hannes,&nbsp;Jane Noyes,&nbsp;The CAMELOT Development Group","doi":"10.1002/cesm.12058","DOIUrl":"https://doi.org/10.1002/cesm.12058","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>Qualitative evidence is increasingly incorporated into decision-making processes. Assessing the methodological limitations of primary studies is critical to making an overall assessment of confidence in findings from qualitative evidence syntheses (QES) using GRADE-CERQual. Current critical appraisal tools were not developed specifically for use in Cochrane reviews or GRADE-CERQual, and few are evidence-based. The aim of CochrAne qualitative Methodological LimitatiOns Tool (CAMELOT) was to address this gap.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We undertook this project in four stages: (1) systematic literature search to identify existing tools, (2) identification of evidence to support inclusion of potential CAMELOT domains (3) consensus survey to agree on the inclusion and definition of CAMELOT domains, and (4) human-centered design approach to develop and refine CAMELOT by exploring user experience.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>CAMELOT is a new evidence-based tool for assessing the methodological strengths and limitations of primary qualitative research studies in a QES. CAMELOT is comprised of 12 domains: four <i>Meta domains</i> that encourage review authors to consider those characteristics of the primary study that are beyond how the study was carried out, but which inform the conduct and design of the study, and eight <i>Method domains</i> which encourage review authors to consider how the study was designed, planned and/or conducted, and how study conduct and design fits with the information provided in the four meta domains. Review authors make an assessment by identifying any concerns regarding the methods used in the study and considering the appropriateness of fit between the <i>Meta</i> and <i>Method domains</i>.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>CAMELOT provides review authors with a transparent and systematic method to assess methodological limitations of primary qualitative studies. CAMELOT incorporates qualitative principles and focuses on appropriateness of fit between <i>Meta</i> and <i>Method domains</i>. In line with iterative tool development approach, CAMELOT will continue to be revised over time following extensive user testing and piloting.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12058","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141294962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction to “Standardized mean differences in meta-analysis: A tutorial” 对 "荟萃分析中的标准化均值差异 "的更正:教程"
Pub Date : 2024-06-02 DOI: 10.1002/cesm.12076

In Equation 4 (computation of the standard error [SE] of the mean difference [MD] at posttreatment time point), we wrote SD instead of SE, which is the correct one (see attached figure below).

We apologize for this error.

在公式 4(计算治疗后时间点平均差 [MD] 的标准误差 [SE])中,我们写的是 SD 而不是 SE,后者才是正确的(见下附图)。
{"title":"Correction to “Standardized mean differences in meta-analysis: A tutorial”","authors":"","doi":"10.1002/cesm.12076","DOIUrl":"https://doi.org/10.1002/cesm.12076","url":null,"abstract":"<p>In Equation 4 (computation of the standard error [SE] of the mean difference [MD] at posttreatment time point), we wrote SD instead of SE, which is the correct one (see attached figure below).</p><p></p><p>We apologize for this error.</p>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12076","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141245517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adherence to PRISMA 2020 statement assessed through the expanded checklist in systematic reviews of interventions: A meta-epidemiological study 通过干预措施系统综述中的扩展核对表评估 PRISMA 2020 声明的遵守情况:荟萃流行病学研究
Pub Date : 2024-05-23 DOI: 10.1002/cesm.12074
Diego Ivaldi, Mariana Burgos, Gisela Oltra, Camila E. Liquitay, Luis Garegnani

Introduction

The preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement was developed to improve the reporting of systematic reviews (SRs) and meta-analyses. Due to the suboptimal reporting of the 2009 version, an update was performed and published in 2021. Despite having been evaluated in studies published before its publication, its adherence in SRs of interventions published after 2021 remains unclear.

Objective

To assess PRISMA 2020 statement adherence and its uptake in SRs of interventions.

Methods

We conducted a prospective cross-sectional study searching MEDLINE (PubMed), including a 10% random sample of all SRs involving human interventions published since January 2022 retrieved by our search process. We did not apply any restrictions. We assessed PRISMA 2020 statement uptake and its adherence using its expanded checklist.

Results

We included 222 out of 945 studies. 67 (30.18%) used PRISMA 2020 statement. None adhered completely, with an average adherence of 42.64% (Min–Max: 14.29%–76.19%). Results and Methods sections had low adherence, with 40.57% (Min–Max: 10.45%–98.51%) and 25.55% (Min–Max: 7.46%–55.22%) respectively. The items with the least adherence were: certainty and reporting bias assessment, excluded studies characteristics and search strategy with 7.46% (5/67), 8.96% (6/67), 10.45% (7/67), and 11.94% (8/67) respectively.

Discussion

As in previous studies, our study showed low adherence, mainly to the methods and results sections. However, our study showed a lower adherence, probably due to the use of the expanded checklist to assessed the tools adherence.

Conclusion

We found a low adherence rate to the PRISMA 2020 expanded checklist. Further PRISMA dissemination and targeted audience training are needed to improve SR reporting and quality.

导言 系统综述和荟萃分析的首选报告项目(PRISMA)声明是为了改进系统综述(SR)和荟萃分析的报告而制定的。由于 2009 年版本的报告效果不佳,我们对其进行了更新,并于 2021 年出版。尽管在该版本发布前已对发表的研究进行了评估,但在 2021 年后发表的干预措施 SR 中,该版本的遵守情况仍不明确。 目的 评估 PRISMA 2020 声明的遵守情况及其在干预SR中的应用情况。 方法 我们进行了一项前瞻性横断面研究,搜索了 MEDLINE (PubMed),包括搜索过程中检索到的自 2022 年 1 月以来发表的所有涉及人类干预的 SR,随机抽样 10%。我们没有施加任何限制。我们使用扩展检查表评估了 PRISMA 2020 声明的采纳情况及其遵守情况。 结果 我们纳入了 945 项研究中的 222 项。67项(30.18%)使用了PRISMA 2020声明。没有一项完全遵守,平均遵守率为 42.64%(最小值-最大值:14.29%-76.19%)。结果和方法部分的遵守率较低,分别为 40.57%(最小值-最大值:10.45%-98.51%)和 25.55%(最小值-最大值:7.46%-55.22%)。坚持率最低的项目是:确定性和报告偏倚评估、排除研究特征和检索策略,分别为 7.46%(5/67)、8.96%(6/67)、10.45%(7/67)和 11.94%(8/67)。 讨论 与之前的研究一样,我们的研究也显示出较低的依从性,主要是对方法和结果部分的依从性较低。然而,我们的研究显示出较低的依从性,这可能是由于使用了扩展核对表来评估工具的依从性。 结论 我们发现 PRISMA 2020 扩展核对表的遵循率较低。需要进一步推广 PRISMA 并对受众进行有针对性的培训,以提高 SR 报告的质量。
{"title":"Adherence to PRISMA 2020 statement assessed through the expanded checklist in systematic reviews of interventions: A meta-epidemiological study","authors":"Diego Ivaldi,&nbsp;Mariana Burgos,&nbsp;Gisela Oltra,&nbsp;Camila E. Liquitay,&nbsp;Luis Garegnani","doi":"10.1002/cesm.12074","DOIUrl":"https://doi.org/10.1002/cesm.12074","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Introduction</h3>\u0000 \u0000 <p>The preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement was developed to improve the reporting of systematic reviews (SRs) and meta-analyses. Due to the suboptimal reporting of the 2009 version, an update was performed and published in 2021. Despite having been evaluated in studies published before its publication, its adherence in SRs of interventions published after 2021 remains unclear.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objective</h3>\u0000 \u0000 <p>To assess PRISMA 2020 statement adherence and its uptake in SRs of interventions.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We conducted a prospective cross-sectional study searching MEDLINE (PubMed), including a 10% random sample of all SRs involving human interventions published since January 2022 retrieved by our search process. We did not apply any restrictions. We assessed PRISMA 2020 statement uptake and its adherence using its expanded checklist.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We included 222 out of 945 studies. 67 (30.18%) used PRISMA 2020 statement. None adhered completely, with an average adherence of 42.64% (Min–Max: 14.29%–76.19%). Results and Methods sections had low adherence, with 40.57% (Min–Max: 10.45%–98.51%) and 25.55% (Min–Max: 7.46%–55.22%) respectively. The items with the least adherence were: certainty and reporting bias assessment, excluded studies characteristics and search strategy with 7.46% (5/67), 8.96% (6/67), 10.45% (7/67), and 11.94% (8/67) respectively.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Discussion</h3>\u0000 \u0000 <p>As in previous studies, our study showed low adherence, mainly to the methods and results sections. However, our study showed a lower adherence, probably due to the use of the expanded checklist to assessed the tools adherence.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusion</h3>\u0000 \u0000 <p>We found a low adherence rate to the PRISMA 2020 expanded checklist. Further PRISMA dissemination and targeted audience training are needed to improve SR reporting and quality.</p>\u0000 </section>\u0000 </div>","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12074","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141085071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Intention-to-treat analyses and missing outcome data: A tutorial 意向治疗分析和缺失结果数据:教程
Pub Date : 2024-05-21 DOI: 10.1002/cesm.12075
Marty Chaplin, Kerry Dwan

This tutorial focuses on “intention-to-treat” analyses and missing outcome data in systematic reviews. There is a lack of consensus on the definition of the ITT approach. We will explain the principles of an intention-to-treat analysis, and outline the key issues you need to consider when planning, conducting and writing up your systematic review.

The authors of studies included in systematic reviews may use the term “intention-to-treat” or “intent-to-treat” (ITT) to describe the approach taken when reporting and analyzing outcome data. The ITT approach has two principles.

Principle A: Outcome data are reported and/or analysed according to the participant's assigned intervention, regardless of the intervention they actually received or their adherence to their assigned intervention. For randomised controlled trials, this approach is sometimes referred to as an “as-randomised” analysis.

Study authors make decisions about which approach to take based on whether they are interested in determining the effect of allocation to an intervention (regardless of whether the intervention was received as intended), the effect of receiving an intervention, or the effect of adhering to an intervention (as specified in the trial protocol).

Principle B: Outcome data are measured for all randomised participants.

If some participants do not contribute data for the outcome of interest at the required follow-up time (i.e., there are missing outcome data), data may be imputed. Various imputation methods are available, from simply assuming that all participants with missing data had a particular outcome (e.g., study authors may assume that all participants with missing data experienced a poor outcome, such as treatment failure), to more complex methods such as multiple imputation.

This principle is not met if study authors report and/or analyze outcome data only for participants with nonmissing outcome data (this approach is sometimes referred to as a “complete-case analysis”).

When choosing whether to ignore or impute missing data, and when selecting an imputation method, study authors should consider whether missing data are likely to be “missing at random” or not. Data are “missing at random” if the fact that the data are missing is unrelated to the true data values. Complete-case analyses, and some imputation methods, may lead to biased results if the missing data is “missing not at random.” Table 1 provides examples of data that are “missing at random” and data that are “missing not at random.”

There is no consensus on the definition of the ITT approach [1, 2]. Some study authors use the term ITT when applying both principles; others use the term when applying just one principle. Study authors may use the term “modified ITT” approach, which also has no consistent definition. The estimated intervention effect in a study may be impacted by the study author's choice of ITT approach. If this

本教程的重点是系统综述中的 "意向治疗 "分析和结果数据缺失。目前对 ITT 方法的定义还缺乏共识。我们将解释意向治疗分析的原则,并概述您在计划、开展和撰写系统综述时需要考虑的关键问题。纳入系统综述的研究的作者可能会使用 "意向治疗 "或 "意向治疗"(ITT)来描述报告和分析结果数据时所采用的方法。ITT 方法有两个原则:原则 A:结果数据的报告和/或分析是根据受试者指定的干预措施进行的,与受试者实际接受的干预措施或对指定干预措施的依从性无关。对于随机对照试验,这种方法有时也被称为 "随机 "分析。研究作者在决定采取哪种方法时,会根据他们是否有兴趣确定分配到干预措施的效果(无论是否按计划接受了干预措施)、接受干预措施的效果或坚持干预措施的效果(如试验方案中规定的那样)、原则 B:对所有随机参与者的结果数据进行测量。有多种估算方法可供选择,包括简单地假设所有数据缺失的参与者都有特定的结果(例如,研究作者可以假设所有参与者都有特定的结果)、如果研究作者只报告和/或分析未缺失结果数据的参与者的结果数据(这种方法有时被称为 "完整病例分析"),则不符合这一原则。在选择忽略还是估算缺失数据以及选择估算方法时,研究作者应考虑缺失数据是否可能是 "随机缺失"。如果数据缺失的事实与真实数据值无关,那么数据就是 "随机缺失 "的。如果缺失数据是 "非随机缺失",则完整案例分析和某些估算方法可能会导致结果偏差。表 1 举例说明了 "随机缺失 "数据和 "非随机缺失 "数据。"ITT 方法 "的定义尚未达成共识[1, 2]。一些研究作者在应用这两项原则时使用 ITT 一词,而另一些作者在只应用一项原则时则使用 ITT 一词。研究作者可能会使用 "改良 ITT "方法,该方法也没有统一的定义。一项研究中估计的干预效果可能会受到研究作者选择的 ITT 方法的影响。如果将该研究纳入系统综述,汇总结果和综述结论也可能受到影响。理想情况下,研究作者在提及 ITT 或修改后的 ITT 方法时,会明确说明这些术语的含义。如果您在研究方案中使用了 "ITT "一词,请明确定义该词的含义。首先,请说明您是想确定分配的效果还是对特定干预措施的依从性。如果您对确定干预分配的效果感兴趣,那么您应该说明,在可能的情况下,您打算提取根据参与者分配的干预进行报告和/或分析的结果数据,而不管他们实际接受了哪种干预,也不管他们是否坚持干预。如果您想确定坚持干预的效果,则应说明您打算从估计每方案效果的分析中提取结果数据(参见《Cochrane 手册》[1] 第 8.2.2 节,讨论估计每方案效果的不同方法以及与这些方法相关的偏差)。适当的方法可能取决于替代分析集所包含的参与者人数与您首选分析集所包含的参与者人数是否存在差异,以至于可能对研究结果产生重大影响。适当的方法可能取决于多种因素,包括缺失数据的程度、研究作者的估算方法(如适用),以及完整病例分析结果(如可用)是否可能因结果数据缺失而存在高偏倚风险。 尽管在撰写综述方案时考虑上述问题非常重要,但在确定研究、提取数据和评估偏倚风险之后,再就综述方法做出一些决定可能会比较合适。您可以在完成综述撰写时概述所选方法并说明理由。仔细检查纳入研究的出版物(包括统计方法部分、参与者流程图和结果表),以确定分析采用了哪些 ITT 原则(如果有的话)。如果论文中提供的信息没有明确说明采用的方法,您可以联系研究的作者。如果您无法与作者澄清分析方法,则应决定是将数据纳入分析(并进行敏感性分析,探讨纳入数据对结果的影响),还是将数据排除在分析之外(并以表格或叙述的方式呈现数据)。ROB2[3](针对 RCT)和 ROBINS-I[4](针对干预措施的非随机研究)对一个领域("偏离预期干预措施导致的偏倚")的评估根据您是否有兴趣确定分配或坚持干预措施的效果(如您的综述方案中所述)而有所不同。这些工具还可以解决因结果数据缺失而导致的偏倚风险。回答 ROB2 和 ROBINS-I 中的信号问题很可能会指导您决定在综述中采用何种适当的分析方法。有关这两种工具的详细指南(www.riskofbias.info)。如果您在综述中使用 "ITT "一词,请明确定义该词的含义。如果您在综述中使用了 "ITT "一词,请明确定义该术语的含义。读者应清楚地了解,所纳入研究的数据是采用 "随机 "方法还是 "按治疗/按方案 "方法进行分析的,以及如何处理缺失的结果数据。如果您自己对任何缺失数据进行了估算,请指明您对哪些研究进行了估算,并提供所用估算方法的详细信息。如果您在综述过程中决定是否在分析中纳入或排除数据,或者是否进行了估算,请提供这些决定的理由。方法部分、结果部分和分析脚注都可以用来确保方法的透明度。您还应在 "方案与综述之间的差异 "标题下概述对方案中指定方法的任何更新。Altman 教授和 Bland 教授在 BMJ "统计说明 "系列中讨论了缺失数据[5]。Cochrane Training制作了一个微型学习模块[6],演示了缺失二分法结果数据的一种简单估算方法[7]和缺失连续法结果数据的一种简单估算方法[8](图1):构思;写作-原稿;写作-审阅和编辑。Kerry Dwan:作者声明无利益冲突。
{"title":"Intention-to-treat analyses and missing outcome data: A tutorial","authors":"Marty Chaplin,&nbsp;Kerry Dwan","doi":"10.1002/cesm.12075","DOIUrl":"https://doi.org/10.1002/cesm.12075","url":null,"abstract":"<p>This tutorial focuses on “intention-to-treat” analyses and missing outcome data in systematic reviews. There is a lack of consensus on the definition of the ITT approach. We will explain the principles of an intention-to-treat analysis, and outline the key issues you need to consider when planning, conducting and writing up your systematic review.</p><p>The authors of studies included in systematic reviews may use the term “intention-to-treat” or “intent-to-treat” (ITT) to describe the approach taken when reporting and analyzing outcome data. The ITT approach has two principles.</p><p><i>Principle A: Outcome data are reported and/or analysed according to the participant's assigned intervention, regardless of the intervention they actually received or their adherence to their assigned intervention. For randomised controlled trials, this approach is sometimes referred to as an “as-randomised” analysis</i>.</p><p>Study authors make decisions about which approach to take based on whether they are interested in determining the effect of allocation to an intervention (regardless of whether the intervention was received as intended), the effect of receiving an intervention, or the effect of adhering to an intervention (as specified in the trial protocol).</p><p><i>Principle B: Outcome data are measured for all randomised participants</i>.</p><p>If some participants do not contribute data for the outcome of interest at the required follow-up time (i.e., there are missing outcome data), data may be imputed. Various imputation methods are available, from simply assuming that all participants with missing data had a particular outcome (e.g., study authors may assume that all participants with missing data experienced a poor outcome, such as treatment failure), to more complex methods such as multiple imputation.</p><p>This principle is not met if study authors report and/or analyze outcome data only for participants with nonmissing outcome data (this approach is sometimes referred to as a “complete-case analysis”).</p><p>When choosing whether to ignore or impute missing data, and when selecting an imputation method, study authors should consider whether missing data are likely to be “missing at random” or not. Data are “missing at random” if the fact that the data are missing is unrelated to the true data values. Complete-case analyses, and some imputation methods, may lead to biased results if the missing data is “missing not at random.” Table 1 provides examples of data that are “missing at random” and data that are “missing not at random.”</p><p>There is no consensus on the definition of the ITT approach [<span>1, 2</span>]. Some study authors use the term ITT when applying both principles; others use the term when applying just one principle. Study authors may use the term “modified ITT” approach, which also has no consistent definition. The estimated intervention effect in a study may be impacted by the study author's choice of ITT approach. If this","PeriodicalId":100286,"journal":{"name":"Cochrane Evidence Synthesis and Methods","volume":"2 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/cesm.12075","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141078933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Cochrane Evidence Synthesis and Methods
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1