首页 > 最新文献

Journal of Clinical Epidemiology最新文献

英文 中文
Guideline organizations’ guidance documents paper 6: adaptation of practice guidelines 指引机构指引文件第6号文件:实务指引的改编
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-19 DOI: 10.1016/j.jclinepi.2025.112064
Rayane El-Khoury , Mariam Nour Eldine , Walid Abboud , Joanne Khabsa , Holger J. Schünemann , Elie A. Akl

Background and Objectives

Developing high-quality practice guidelines is resource-intensive, leading many guideline-producing organizations to adapt existing recommendations. The objective of this paper is to describe processes for adapting practice guidelines of guideline-producing organizations as described in their guidance documents on guideline development.

Methods

We conducted a descriptive summary. Using multiple sources, we compiled a list of guideline-producing organizations and then searched for their publicly available guidance documents on guideline development (eg, handbooks). We included organizations addressing adaptation in their guidance documents. Teams of two authors assessed eligibility and abstracted data in duplicate and independently. We synthesized data in both textual and tabular formats.

Results

Of 133 identified guideline-producing organizations with guidance documents on guideline development, 23 (17%) addressed adaptation. The most frequently addressed aspects of the adaptation process were (1) developing an adaptation plan (91%); (2) the factors considered for modifying source recommendations (91%), including acceptability of the intervention (52%), resource considerations (48%), values and preferences (43%), and applicability of the intervention (40%); (3) assessing the source guidelines (83%), with the three main criteria used being quality (65%), currency (65%), and relevance (39%); and (4) using source recommendations (78%). None of the organizations described a detailed approach for how to explain discordance of recommendations between different source guidelines, and which one to use.

Conclusion

Although this study provides insight into different aspects of the adaptation process, most organizations do not address these aspects in a comprehensive or detailed way. Clearer guidance and checklists are needed to support organizations in conducting efficient and context-specific adaptation efforts.
背景:开发高质量的实践指南是资源密集型的,导致许多指南生产组织适应现有的建议。本文的目的是描述在指南制定的指导文件中描述的指南生产组织的适应实践指南的过程。方法:进行描述性总结。使用多种来源,我们编制了一个指南生产组织的列表,然后搜索他们关于指南开发的公开可用的指导文件(例如,手册)。我们将处理适应问题的组织纳入其指导文件。由两名审稿人组成的小组评估合格性,并独立地提取两份数据。我们以文本和表格两种格式合成数据。结果:在133个具有指南制定指导文件的确定指南制定组织中,23个(17%)涉及适应问题。适应过程中最常被提及的方面是:(1)制定适应计划(91%);(2)修改来源建议时考虑的因素(91%),包括干预的可接受性(52%)、资源考虑(48%)、价值观和偏好(43%)以及干预的适用性(40%);(3)评估来源指南(83%),使用的三个主要标准是质量(65%),货币(65%)和相关性(39%);(4)使用源推荐(78%)。没有一个组织详细描述了如何解释不同来源指南之间建议的不一致,以及使用哪一个。讨论:虽然这项研究提供了对适应过程的不同方面的见解,但大多数组织并没有以全面或详细的方式解决这些方面。需要更清晰的指导和清单,以支持各组织开展有效和具体情况的适应工作。
{"title":"Guideline organizations’ guidance documents paper 6: adaptation of practice guidelines","authors":"Rayane El-Khoury ,&nbsp;Mariam Nour Eldine ,&nbsp;Walid Abboud ,&nbsp;Joanne Khabsa ,&nbsp;Holger J. Schünemann ,&nbsp;Elie A. Akl","doi":"10.1016/j.jclinepi.2025.112064","DOIUrl":"10.1016/j.jclinepi.2025.112064","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>Developing high-quality practice guidelines is resource-intensive, leading many guideline-producing organizations to adapt existing recommendations. The objective of this paper is to describe processes for adapting practice guidelines of guideline-producing organizations as described in their guidance documents on guideline development.</div></div><div><h3>Methods</h3><div>We conducted a descriptive summary. Using multiple sources, we compiled a list of guideline-producing organizations and then searched for their publicly available guidance documents on guideline development (eg, handbooks). We included organizations addressing adaptation in their guidance documents. Teams of two authors assessed eligibility and abstracted data in duplicate and independently. We synthesized data in both textual and tabular formats.</div></div><div><h3>Results</h3><div>Of 133 identified guideline-producing organizations with guidance documents on guideline development, 23 (17%) addressed adaptation. The most frequently addressed aspects of the adaptation process were (1) developing an adaptation plan (91%); (2) the factors considered for modifying source recommendations (91%), including acceptability of the intervention (52%), resource considerations (48%), values and preferences (43%), and applicability of the intervention (40%); (3) assessing the source guidelines (83%), with the three main criteria used being quality (65%), currency (65%), and relevance (39%); and (4) using source recommendations (78%). None of the organizations described a detailed approach for how to explain discordance of recommendations between different source guidelines, and which one to use.</div></div><div><h3>Conclusion</h3><div>Although this study provides insight into different aspects of the adaptation process, most organizations do not address these aspects in a comprehensive or detailed way. Clearer guidance and checklists are needed to support organizations in conducting efficient and context-specific adaptation efforts.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"189 ","pages":"Article 112064"},"PeriodicalIF":5.2,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145574905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guideline organizations' guidance documents paper 2: priority setting 指导组织的指导文件文件2:优先级设置。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-19 DOI: 10.1016/j.jclinepi.2025.112070
May Mohamad , Joanne Khabsa , Mariam Nour Eldine , Sally Yaacoub , Fatimah Chamseddine , Zeina Itani , Rayane El-Khoury , Elie A. Akl

Background and Objectives

In the development of practice guidelines, priority setting of topics, questions, and outcomes ensures relevance and resource efficiency. The objective of this study was to describe priority setting processes as described in guidance documents by guideline-producing organizations.

Methods

We conducted a descriptive summary of guideline-producing organizations' publicly available guidance documents on practice guideline development (eg, guideline handbooks). We screened guideline-producing organizations' documents and abstracted data in duplicate and independently. We abstracted data on the elements of the priority setting process, including generation of initial list, method or tool used in the priority setting process, use of priority setting criteria, and refinement.

Results

Of the 133 identified organizations with publicly available guidance documents, 94 (71%) reported on a priority setting process for guideline development, with 16 also reporting on a priority setting process for guideline updating (12%). Most of the organizations addressed, in their guidance documents, topic priority setting (94%), whereas a minority addressed priority setting of questions (36%), outcomes (29%), implementation (12%), quality measures (15%), and future research (5%). In the guidance documents, generation of the initial list was the most addressed element for topics (88%), questions (65%) and outcomes (59%), followed by the use of criteria for topics (89%) and questions (59%), and refinement for outcomes (52%). A minority of organizations provided guidance to a published priority setting method or tool, which was only for topics (24%). The top used criteria for priority setting of topics were the impact of intervention on health outcomes (74%), variation/gaps in practice (69%), availability of evidence (69%), and disease health burden (68%); whereas for questions, top criteria were availability of evidence (60%), followed by interest at health professional/organization level (50%), uncertainty or controversy about best practice (40%), and variation/gaps in practice (40%).

Conclusion

This analysis of guideline-producing organizations revealed that a majority reported a priority-setting process, which primarily focused on topic selection and less on aspects like questions and outcomes. Although generating an initial list and using priority-setting criteria are common, few organizations report in their guidance documents using formal priority-setting tools, addressing refinement, or providing guidance for guideline updating or adaptation. A standardized priority setting process for all aspects of guideline development is needed.
导言:在实践指南的制定中,主题、问题和结果的优先设置确保了相关性和资源效率。本研究的目的是描述指导方针编制组织在指导文件中所描述的优先事项确定过程。方法:我们对制定指南的组织在实践指南发展方面公开可用的指导文件(例如,指南手册)进行了描述性总结。我们筛选了制定指南的组织的文件,并独立地提取了两份数据。我们提取了优先级设置过程要素的数据,包括初始列表的生成、优先级设置过程中使用的方法或工具、优先级设置标准的使用以及细化。结果:在133个拥有公开指导文件的确定组织中,94个(71%)报告了指南制定的优先级设置过程,16个还报告了指南更新的优先级设置过程(12%)。大多数组织在其指导文件中解决了主题优先级设置(94%),而少数组织解决了问题优先级设置(36%),结果(29%),实施(12%),质量措施(14%)和未来研究(5%)。在指导文件中,生成初始列表是主题(88%)、问题(65%)和结果(59%)的最重要元素,其次是使用主题(89%)和问题(59%)的标准,以及结果的细化(52%)。少数组织为发布的优先级设置方法或工具提供指导,这仅针对主题(24%)。优先确定主题的最常用标准是干预对健康结果的影响(74%)、实践中的差异/差距(69%)、证据的可获得性(69%)和疾病健康负担(68%);而对于问题,最高标准是证据的可获得性(60%),其次是卫生专业人员/组织层面的兴趣(50%),最佳实践的不确定性或争议(40%)以及实践中的差异/差距(40%)。讨论:对制定指导方针的组织的分析表明,大多数组织报告了优先级设置过程,主要关注主题选择,较少关注问题和结果等方面。虽然生成初始列表和使用优先级设置标准是常见的,但很少有组织在其指导文件中使用正式的优先级设置工具,解决改进问题,或为指南更新或适应提供指导。需要为指南制定的各个方面制定标准化的优先顺序。
{"title":"Guideline organizations' guidance documents paper 2: priority setting","authors":"May Mohamad ,&nbsp;Joanne Khabsa ,&nbsp;Mariam Nour Eldine ,&nbsp;Sally Yaacoub ,&nbsp;Fatimah Chamseddine ,&nbsp;Zeina Itani ,&nbsp;Rayane El-Khoury ,&nbsp;Elie A. Akl","doi":"10.1016/j.jclinepi.2025.112070","DOIUrl":"10.1016/j.jclinepi.2025.112070","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>In the development of practice guidelines, priority setting of topics, questions, and outcomes ensures relevance and resource efficiency. The objective of this study was to describe priority setting processes as described in guidance documents by guideline-producing organizations.</div></div><div><h3>Methods</h3><div>We conducted a descriptive summary of guideline-producing organizations' publicly available guidance documents on practice guideline development (eg, guideline handbooks). We screened guideline-producing organizations' documents and abstracted data in duplicate and independently. We abstracted data on the elements of the priority setting process, including generation of initial list, method or tool used in the priority setting process, use of priority setting criteria, and refinement.</div></div><div><h3>Results</h3><div>Of the 133 identified organizations with publicly available guidance documents, 94 (71%) reported on a priority setting process for guideline development, with 16 also reporting on a priority setting process for guideline updating (12%). Most of the organizations addressed, in their guidance documents, topic priority setting (94%), whereas a minority addressed priority setting of questions (36%), outcomes (29%), implementation (12%), quality measures (15%), and future research (5%). In the guidance documents, generation of the initial list was the most addressed element for topics (88%), questions (65%) and outcomes (59%), followed by the use of criteria for topics (89%) and questions (59%), and refinement for outcomes (52%). A minority of organizations provided guidance to a published priority setting method or tool, which was only for topics (24%). The top used criteria for priority setting of topics were the impact of intervention on health outcomes (74%), variation/gaps in practice (69%), availability of evidence (69%), and disease health burden (68%); whereas for questions, top criteria were availability of evidence (60%), followed by interest at health professional/organization level (50%), uncertainty or controversy about best practice (40%), and variation/gaps in practice (40%).</div></div><div><h3>Conclusion</h3><div>This analysis of guideline-producing organizations revealed that a majority reported a priority-setting process, which primarily focused on topic selection and less on aspects like questions and outcomes. Although generating an initial list and using priority-setting criteria are common, few organizations report in their guidance documents using formal priority-setting tools, addressing refinement, or providing guidance for guideline updating or adaptation. A standardized priority setting process for all aspects of guideline development is needed.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"189 ","pages":"Article 112070"},"PeriodicalIF":5.2,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145565552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guideline organizations' guidance documents paper 5: conflict of interest and funding 指导组织的指导文件文件5:利益冲突和资金。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-19 DOI: 10.1016/j.jclinepi.2025.112061
Joanne Khabsa , Zeina Itani , Hussein A. Noureldine , Francesco Nonino , Mohamed M. Khamis , Jose F. Meneses-Echavez , Joseph Bejjani , Sally Yaacoub , Holger J. Schünemann , Elie A. Akl

Background and Objectives

Bias in the development process of practice guidelines can be introduced through contributors' conflicts of interest (COIs) and the funding sources. The objective of this study was to describe policies of guideline-producing organizations on COIs of contributors and funding of practice guideline projects.

Methods

We conducted a descriptive summary of publicly available guidance documents of guideline-producing organizations. Two authors assessed eligibility and abstracted data on the organizations' characteristics, COI policies (declaration, verification, assessment of whether an interest qualifies as a COI, management, and reporting), and funding policies.

Results

Out of 133 identified guideline-producing organizations, 110 reported a COI and/or a funding policy. Most COI policies required the declaration of relevant interests only (60%). A minority of policies described a process to verify declarations (10%). Most policies mentioned the assessment of whether an interest qualifies as a COI (55%), but few provided specific criteria. Policies mostly specified discussions (43%) and voting (43%) as parts of the process from which conflicted individuals should be excluded. A minority of policies reported on the process by which COIs were evaluated and managed (25%). Most organizations accept external funding (70%), either any external funding (44%) or any external funding except for industry funding (26%), with 72% mentioning mitigation strategies.

Conclusion

Some, but not all, aspects of COI and funding were commonly addressed by policies of guideline-producing organizations. There were also inconsistencies across policies.
导言:在实践指南的制定过程中,通过贡献者的利益冲突和资金来源,可以引入偏见。本研究的目的是描述指南制定组织在贡献者利益冲突和实践指南项目资助方面的政策。方法:我们对指导方针制定组织的公开可用的指导文件进行了描述性总结。两位作者评估了资格,并提取了有关组织特征、利益冲突政策(声明、验证、利益是否符合利益冲突的评估、管理和报告)和资助政策的数据。结果:在133个指南制定组织中,110个报告了利益冲突和/或资助政策。大多数利益冲突政策只要求申报相关利益(60%)。少数政策描述了验证声明的过程(10%)。大多数政策提到了对利益是否符合利益冲突的评估(55%),但很少提供具体标准。政策大多指定讨论(43%)和投票(43%)作为过程的一部分,冲突的个人应该被排除在外。少数政策报告了评估和管理利益冲突的过程(25%)。大多数组织接受外部资助(70%),要么接受任何外部资助(44%),要么接受除行业资助以外的任何外部资助(26%);72%的人提到了缓解策略。讨论:制定指导方针的组织的政策通常处理利益冲突和资金的某些方面,但不是所有方面。政策之间也存在不一致之处。
{"title":"Guideline organizations' guidance documents paper 5: conflict of interest and funding","authors":"Joanne Khabsa ,&nbsp;Zeina Itani ,&nbsp;Hussein A. Noureldine ,&nbsp;Francesco Nonino ,&nbsp;Mohamed M. Khamis ,&nbsp;Jose F. Meneses-Echavez ,&nbsp;Joseph Bejjani ,&nbsp;Sally Yaacoub ,&nbsp;Holger J. Schünemann ,&nbsp;Elie A. Akl","doi":"10.1016/j.jclinepi.2025.112061","DOIUrl":"10.1016/j.jclinepi.2025.112061","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>Bias in the development process of practice guidelines can be introduced through contributors' conflicts of interest (COIs) and the funding sources. The objective of this study was to describe policies of guideline-producing organizations on COIs of contributors and funding of practice guideline projects.</div></div><div><h3>Methods</h3><div>We conducted a descriptive summary of publicly available guidance documents of guideline-producing organizations. Two authors assessed eligibility and abstracted data on the organizations' characteristics, COI policies (declaration, verification, assessment of whether an interest qualifies as a COI, management, and reporting), and funding policies.</div></div><div><h3>Results</h3><div>Out of 133 identified guideline-producing organizations, 110 reported a COI and/or a funding policy. Most COI policies required the declaration of relevant interests only (60%). A minority of policies described a process to verify declarations (10%). Most policies mentioned the assessment of whether an interest qualifies as a COI (55%), but few provided specific criteria. Policies mostly specified discussions (43%) and voting (43%) as parts of the process from which conflicted individuals should be excluded. A minority of policies reported on the process by which COIs were evaluated and managed (25%). Most organizations accept external funding (70%), either any external funding (44%) or any external funding except for industry funding (26%), with 72% mentioning mitigation strategies.</div></div><div><h3>Conclusion</h3><div>Some, but not all, aspects of COI and funding were commonly addressed by policies of guideline-producing organizations. There were also inconsistencies across policies.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"189 ","pages":"Article 112061"},"PeriodicalIF":5.2,"publicationDate":"2025-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145574841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Methods for developing diagnostic criteria for conditions without objective tests, biomarkers, or reference standards: a scoping review 无客观试验、生物标记物或参考标准的病症诊断标准的制定方法:范围综述
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-18 DOI: 10.1016/j.jclinepi.2025.112052
Samuel J. White , Timothy H. Barker , Tracy Merlin , Grace Holland , Sharon Sanders , Aoife O'Mahony , Thanya Pathirana , Rebecca Theiss , Danielle Pollock , Natasha Reid , Zachary Munn
<div><h3>Background and Objectives</h3><div>Diagnostic criteria play an important role in informing clinical decision-making, particularly for conditions lacking objective tests, biomarkers, or reference standards. Despite their importance, there is no established methodological guidance for developing diagnostic criteria. This scoping review aimed to identify and describe the methodological approaches used to develop diagnostic criteria in the absence of objective tests, biomarkers, or reference standards.</div></div><div><h3>Study Design and Setting</h3><div>We conducted a scoping review in accordance with JBI methodology and the PRISMA-ScR reporting guideline. Studies published between 2000 and 2024 that described methods used to develop diagnostic criteria for conditions without objective tests, biomarkers, or reference standards were included. A comprehensive search was performed across multiple databases and supplemented with gray literature searches and expert consultation. Data were extracted independently by two reviewers and synthesized using descriptive statistics and qualitative content analysis.</div></div><div><h3>Results</h3><div>We included 139 studies. Suboptimal reporting of methodology was a barrier to assessment of methodological credibility. Authors used one or more of three main approaches to develop diagnostic criteria: consensus-based, literature-based, and/or primary study–based. Consensus methods were used in 98/139 (71%) of studies, with Delphi or modified Delphi approaches being the most commonly adopted. The role of evidence in diagnostic criteria development was not described in 36/139 (26%) of the included studies. In studies using consensus methodology to develop diagnostic criteria, prospective approaches to ensuring appropriate diversity among the diagnostic criteria development panel were employed in only 5/98 (5%) of studies and patient/advocate consultation was performed in 18/98 (18%) of studies.</div></div><div><h3>Conclusion</h3><div>Methodological approaches to developing diagnostic criteria for conditions without objective tests or standards are variable, inconsistently reported and often lack a clear evidence base. This could be aided by development of specific methodological guidance.</div></div><div><h3>Plain Language Summary</h3><div>When lab tests or scans are not available to confirm a diagnosis, doctors may use diagnostic criteria to help them decide what condition a patient may have. There is currently no clear way to create these criteria, which can lead to inconsistency and confusion. We looked at why this matters—because diagnostic criteria developed without transparency or methodological rigor may lead to incorrect diagnosis, patient harm or inequitable access to care—and explored how researchers develop diagnostic criteria when an objective test does not exist. Most studies relied on expert meetings, but many did not explain how they chose experts, gathered evidence or involved diverse perspe
目的:诊断标准在告知临床决策方面发挥重要作用,特别是在缺乏客观检测、生物标志物或参考标准的情况下。尽管它们很重要,但尚无制定诊断标准的既定方法学指导。本综述旨在确定和描述在缺乏客观检测、生物标志物或参考标准的情况下用于制定诊断标准的方法学方法。研究设计和设置:我们按照JBI方法和PRISMA-ScR报告指南进行了范围审查。2000年至2024年间发表的研究,描述了在没有客观测试、生物标志物或参考标准的情况下制定诊断标准的方法。在多个数据库中进行了全面的搜索,并辅以灰色文献搜索和专家咨询。数据由两位审稿人独立提取,并使用描述性统计和定性内容分析进行综合。结果:我们纳入了139项研究。不理想的方法学报告是评估方法学可信性的障碍。作者使用三种主要方法中的一种或多种来制定诊断标准:基于共识、基于文献和/或基于初步研究。98/139(71%)的研究采用了共识法,其中德尔菲法或修正德尔菲法是最常用的方法。纳入的研究中有36/139(26%)没有描述证据在诊断标准制定中的作用。在使用共识方法制定诊断标准的研究中,只有5/98(5%)的研究采用前瞻性方法来确保诊断标准制定小组之间的适当多样性,18/98(18%)的研究进行了患者/倡导者咨询。结论:在没有客观测试或标准的情况下制定诊断标准的方法学方法是可变的,报告不一致,往往缺乏明确的证据基础。这可以通过制定具体的方法指导得到帮助。简单的语言总结:当实验室测试或扫描无法确认诊断时,医生可能会使用诊断标准来帮助他们确定患者可能患有的疾病。目前还没有明确的方法来创建这些标准,这可能导致不一致和混乱。我们研究了为什么这很重要——因为在没有透明度或方法严密性的情况下制定的诊断标准可能导致错误的诊断、对患者的伤害或获得护理的不公平机会——并探讨了在没有客观测试的情况下,研究人员如何制定诊断标准。大多数研究依赖于专家会议,但许多研究没有解释他们如何选择专家、收集证据或涉及不同的观点,如病人的声音。我们的研究表明,目前的做法往往没有得到很好的解释,可能存在偏见或不完整。通过了解哪些是缺失的,哪些是可行的,我们希望这项研究能鼓励更好、更透明的方法,这样未来的诊断标准对患者和医疗保健提供者来说都更清晰、更公平、更值得信赖。
{"title":"Methods for developing diagnostic criteria for conditions without objective tests, biomarkers, or reference standards: a scoping review","authors":"Samuel J. White ,&nbsp;Timothy H. Barker ,&nbsp;Tracy Merlin ,&nbsp;Grace Holland ,&nbsp;Sharon Sanders ,&nbsp;Aoife O'Mahony ,&nbsp;Thanya Pathirana ,&nbsp;Rebecca Theiss ,&nbsp;Danielle Pollock ,&nbsp;Natasha Reid ,&nbsp;Zachary Munn","doi":"10.1016/j.jclinepi.2025.112052","DOIUrl":"10.1016/j.jclinepi.2025.112052","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Background and Objectives&lt;/h3&gt;&lt;div&gt;Diagnostic criteria play an important role in informing clinical decision-making, particularly for conditions lacking objective tests, biomarkers, or reference standards. Despite their importance, there is no established methodological guidance for developing diagnostic criteria. This scoping review aimed to identify and describe the methodological approaches used to develop diagnostic criteria in the absence of objective tests, biomarkers, or reference standards.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;We conducted a scoping review in accordance with JBI methodology and the PRISMA-ScR reporting guideline. Studies published between 2000 and 2024 that described methods used to develop diagnostic criteria for conditions without objective tests, biomarkers, or reference standards were included. A comprehensive search was performed across multiple databases and supplemented with gray literature searches and expert consultation. Data were extracted independently by two reviewers and synthesized using descriptive statistics and qualitative content analysis.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;We included 139 studies. Suboptimal reporting of methodology was a barrier to assessment of methodological credibility. Authors used one or more of three main approaches to develop diagnostic criteria: consensus-based, literature-based, and/or primary study–based. Consensus methods were used in 98/139 (71%) of studies, with Delphi or modified Delphi approaches being the most commonly adopted. The role of evidence in diagnostic criteria development was not described in 36/139 (26%) of the included studies. In studies using consensus methodology to develop diagnostic criteria, prospective approaches to ensuring appropriate diversity among the diagnostic criteria development panel were employed in only 5/98 (5%) of studies and patient/advocate consultation was performed in 18/98 (18%) of studies.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;Methodological approaches to developing diagnostic criteria for conditions without objective tests or standards are variable, inconsistently reported and often lack a clear evidence base. This could be aided by development of specific methodological guidance.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Plain Language Summary&lt;/h3&gt;&lt;div&gt;When lab tests or scans are not available to confirm a diagnosis, doctors may use diagnostic criteria to help them decide what condition a patient may have. There is currently no clear way to create these criteria, which can lead to inconsistency and confusion. We looked at why this matters—because diagnostic criteria developed without transparency or methodological rigor may lead to incorrect diagnosis, patient harm or inequitable access to care—and explored how researchers develop diagnostic criteria when an objective test does not exist. Most studies relied on expert meetings, but many did not explain how they chose experts, gathered evidence or involved diverse perspe","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"190 ","pages":"Article 112052"},"PeriodicalIF":5.2,"publicationDate":"2025-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145566071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guideline organizations' guidance documents paper 11: quality assurance and improvement in guideline development 指南组织的指导文件文件11:指南制定的质量保证和改进。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-17 DOI: 10.1016/j.jclinepi.2025.112069
Lili Zeidan , Ahmad Najia , Elena Parmelli , Miranda Langendam , Joanne Khabsa , Elie A. Akl

Background and Objectives

The integration of quality assurance and improvement (QAI) into all steps of guideline development can promote the measurability and relevance of guidelines to real-world practice. Our objective was to describe QAI processes as described in guidance documents of guideline-producing organizations.

Methods

We conducted a comprehensive search in 2021, and updated it in 2024, to identify guidance documents publicly available by guideline-producing organizations. We abstracted data based on the items of the Guidelines International Network (GIN)-McMaster Checklist Extension for Quality Assurance and Quality Improvement (published in 2022) as well as any additional items that emerged from our data. Two authors independently assessed the eligibility of identified organizations and abstracted data on the organization's characteristics, QAI processes in guideline development, and on terminology used to refer to QAI elements (eg, quality indicators, performance measures). We analyzed categorical variables using frequencies and percentages and summarized the findings in textual and tabular formats.

Results

Sixty-nine of 133 guideline-producing organizations (about half) addressed QAI either as a brief mention (57%), a section in a document (33%), or a dedicated document (10%). Guideline-producing organizations used inconsistent terminology when referring to QAI elements. The most frequently addressed QAI items were predefining the process to select final quality measures (26%), the need for project subgroups to work on QAI (25%), and identifying the individuals of the subgroups (23%). The least addressed items were considering institutional conflicts of interest (1%), providing clarity on accountability to making the changes in quality indicators (3%), and developing/adopting a standardized reporting format (4%). Some QAI items were not addressed at all, including determining the QAI scheme scope, perspective, and pilot-testing of indicators with target users.

Conclusion

The coverage of the items of the GIN-McMaster GDC QAI extension varies across the guidance documents of guideline-producing organizations. Also, the organizations used inconsistent terminology when referring to QAI elements.
导言:将质量保证和改进(QAI)整合到指南制定的所有步骤中,可以促进指南与现实世界实践的可测量性和相关性。我们的目标是按照制定指导方针的组织的指导文件描述质量质量评价过程。方法:我们于2021年进行了全面检索,并于2024年进行了更新,以确定指南制定组织公开提供的指导文件。我们根据GIN-McMaster质量保证和质量改进扩展清单(2022年出版)的项目以及从我们的数据中出现的任何其他项目提取数据。两位作者独立地评估了确定的组织的资格,并对组织的特征、指南制定中的质量评价过程以及用于参考质量评价要素(例如,质量指标、绩效度量)的术语提取了数据。我们使用频率和百分比分析分类变量,并以文本和表格格式总结研究结果。结果:133个制定指南的组织中有68个(约一半)将QAI作为简短的提及(57%),文档中的一个部分(34%)或专门的文档(9%)。制定指南的组织在提及QAI元素时使用了不一致的术语。最常提到的QAI项目是预先定义选择最终质量度量的过程(25%),项目子组在QAI上工作的需要(22%),以及确定子组的个体(22%)。涉及最少的项目是考虑机构利益冲突(1%),制定/采用标准化报告格式(3%),以及为质量指标的变化提供明确的责任(3%)。一些质量评价项目根本没有得到解决,包括确定质量评价方案的范围、观点和目标用户指标的试点测试。讨论:GIN-McMaster指南开发清单QAI扩展项目的覆盖范围在指南制作组织的指导文件中有所不同。此外,组织在引用QAI元素时使用了不一致的术语。
{"title":"Guideline organizations' guidance documents paper 11: quality assurance and improvement in guideline development","authors":"Lili Zeidan ,&nbsp;Ahmad Najia ,&nbsp;Elena Parmelli ,&nbsp;Miranda Langendam ,&nbsp;Joanne Khabsa ,&nbsp;Elie A. Akl","doi":"10.1016/j.jclinepi.2025.112069","DOIUrl":"10.1016/j.jclinepi.2025.112069","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>The integration of quality assurance and improvement (QAI) into all steps of guideline development can promote the measurability and relevance of guidelines to real-world practice. Our objective was to describe QAI processes as described in guidance documents of guideline-producing organizations.</div></div><div><h3>Methods</h3><div>We conducted a comprehensive search in 2021, and updated it in 2024, to identify guidance documents publicly available by guideline-producing organizations. We abstracted data based on the items of the Guidelines International Network (GIN)-McMaster Checklist Extension for Quality Assurance and Quality Improvement (published in 2022) as well as any additional items that emerged from our data. Two authors independently assessed the eligibility of identified organizations and abstracted data on the organization's characteristics, QAI processes in guideline development, and on terminology used to refer to QAI elements (eg, quality indicators, performance measures). We analyzed categorical variables using frequencies and percentages and summarized the findings in textual and tabular formats.</div></div><div><h3>Results</h3><div>Sixty-nine of 133 guideline-producing organizations (about half) addressed QAI either as a brief mention (57%), a section in a document (33%), or a dedicated document (10%). Guideline-producing organizations used inconsistent terminology when referring to QAI elements. The most frequently addressed QAI items were predefining the process to select final quality measures (26%), the need for project subgroups to work on QAI (25%), and identifying the individuals of the subgroups (23%). The least addressed items were considering institutional conflicts of interest (1%), providing clarity on accountability to making the changes in quality indicators (3%), and developing/adopting a standardized reporting format (4%). Some QAI items were not addressed at all, including determining the QAI scheme scope, perspective, and pilot-testing of indicators with target users.</div></div><div><h3>Conclusion</h3><div>The coverage of the items of the GIN-McMaster GDC QAI extension varies across the guidance documents of guideline-producing organizations. Also, the organizations used inconsistent terminology when referring to QAI elements.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"189 ","pages":"Article 112069"},"PeriodicalIF":5.2,"publicationDate":"2025-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145558205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Guideline organizations' guidance documents paper 8: considering equity 指引组织的指引文件第8号文件:考虑公平。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-17 DOI: 10.1016/j.jclinepi.2025.112067
Jana Khawandi , Noha El Yaman , Omar Dewidar , Tracy Faddoul , Lynn Lteif , Reem A. Mustafa , Elie A. Akl , Joanne Khabsa

Background and Objectives

To ensure practice guidelines contribute to improving equity, guideline developers need to consciously consider populations experiencing inequities throughout the process. Our aim was to describe whether and how guideline-producing organizations consider equity in the guideline development process as described in their guidance documents on guideline development.

Methods

We conducted a descriptive summary of guideline-producing organizations using different sources and retrieved their publicly available guidance documents on guideline development (eg, handbooks). We screened guidance documents and abstracted information about equity consideration within topics of the GIN-McMaster guideline development checklist.

Results

Of 133 identified guideline-producing organizations with guidance documents on guideline development, 52% considered equity in their guidance documents in at least one of the 18 topics of the GIN-McMaster checklist. Most organizations were professional (55%) and national (77%). The median number of topics considered per organization was 2 (IQR = 1–4), with the World Health Organization (WHO) considering the highest number of topics. The topic in which equity was considered the most was “guideline group membership” (57%), while the topic in which equity was considered the least was “conflict of interest considerations” (1%). In addition, some of the terms related to equity and populations experiencing inequities used were “inequitable or equality” and “minority or disadvantaged”, respectively.

Conclusion

More than half of guideline-producing organizations consider equity in guideline development, with considerations limited to a few groups of populations and a few topics of the guideline development process.
背景:为了确保实践指南有助于提高公平性,指南的制定者需要有意识地考虑在整个过程中经历不公平的人群。我们的目的是描述指南制定组织是否以及如何在指南制定过程中考虑其指南制定指导文件中所描述的公平性。方法:我们使用不同的资源对制定指南的组织进行了描述性总结,并检索了他们关于指南制定的公开指导文件(例如手册)。我们筛选了指导文件,并从GIN-McMaster指南制定清单的主题中提取了有关公平考虑的信息。结果:在133个确定的指导方针制定组织中,52%的组织在其指导文件中考虑了GIN-McMaster清单中18个主题中至少一个主题的公平性。大多数组织是专业的(55%)和全国性的(77%)。每个组织审议的主题数中位数为2 (IQR=1-4),其中世界卫生组织(世卫组织)审议的主题数最多。公平性被考虑最多的主题是“指南小组成员”(57%),而公平性被考虑最少的主题是“利益冲突考虑”(1%)。此外,所使用的与公平和遭受不平等的人口有关的一些用语分别是:“不公平或平等”和“少数或处境不利”。讨论:超过一半的制定指南的组织在制定指南时考虑到公平,只考虑指南制定过程中的少数人群和少数主题。
{"title":"Guideline organizations' guidance documents paper 8: considering equity","authors":"Jana Khawandi ,&nbsp;Noha El Yaman ,&nbsp;Omar Dewidar ,&nbsp;Tracy Faddoul ,&nbsp;Lynn Lteif ,&nbsp;Reem A. Mustafa ,&nbsp;Elie A. Akl ,&nbsp;Joanne Khabsa","doi":"10.1016/j.jclinepi.2025.112067","DOIUrl":"10.1016/j.jclinepi.2025.112067","url":null,"abstract":"<div><h3>Background and Objectives</h3><div>To ensure practice guidelines contribute to improving equity, guideline developers need to consciously consider populations experiencing inequities throughout the process. Our aim was to describe whether and how guideline-producing organizations consider equity in the guideline development process as described in their guidance documents on guideline development.</div></div><div><h3>Methods</h3><div>We conducted a descriptive summary of guideline-producing organizations using different sources and retrieved their publicly available guidance documents on guideline development (eg, handbooks). We screened guidance documents and abstracted information about equity consideration within topics of the GIN-McMaster guideline development checklist.</div></div><div><h3>Results</h3><div>Of 133 identified guideline-producing organizations with guidance documents on guideline development, 52% considered equity in their guidance documents in at least one of the 18 topics of the GIN-McMaster checklist. Most organizations were professional (55%) and national (77%). The median number of topics considered per organization was 2 (IQR = 1–4), with the World Health Organization (WHO) considering the highest number of topics. The topic in which equity was considered the most was “guideline group membership” (57%), while the topic in which equity was considered the least was “conflict of interest considerations” (1%). In addition, some of the terms related to equity and populations experiencing inequities used were “inequitable or equality” and “minority or disadvantaged”, respectively.</div></div><div><h3>Conclusion</h3><div>More than half of guideline-producing organizations consider equity in guideline development, with considerations limited to a few groups of populations and a few topics of the guideline development process.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"189 ","pages":"Article 112067"},"PeriodicalIF":5.2,"publicationDate":"2025-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145558304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Potential waste in evidence synthesis for health screening: a scoping review and call for action 健康筛查证据合成中的潜在浪费:范围审查和行动呼吁。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-17 DOI: 10.1016/j.jclinepi.2025.112053
Sarah Batson , Matthew J. Randell , Catherine Bane , Julia Geppert , Pranshu Mundada , Chris Stinton , Eleanor Cozens , Maggie Powell , Sian Taylor-Phillips

Objectives

To estimate the extent of potential research waste in the production of evidence-synthesis products for health screening, providing an initial assessment of its magnitude.

Study Design and Setting

Evidence-synthesis products supporting screening recommendations for adult populations, published by the UK National Screening Committee (UK NSC) and the US Preventive Services Task Force (USPSTF) between 2014 and 2024, were identified as anchor reviews. For each anchor review, Embase, Medline, and national and international organization websites were searched for overlapping evidence reviews on the same topic, defined as addressing the same research questions with at least partial overlap in the population, interventions, comparisons, and outcomes.

Results

A total of 48 anchor reviews (covering 33 conditions) were identified from the UK NSC and USPSTF. Overlapping evidence reviews were identified for 92% (44/48) of these, with a median of 4 additional reviews per anchor review (range: 0–60; interquartile range [IQR]: 2–15). Of the overlapping reviews, 11% showed overlap with partial use of prior work, explicitly updating or building upon prior external work, but with new elements and scope differences that maintained their classification as overlapping. Focusing on a core subset of conditions of shared interest to both organizations, the median overlap increased to 13 (range: 2–47; IQR: 4–17), indicating substantial duplication in priority areas. Seventy percent of all reviews in the evidence base were conducted in North America (28%) and Western Europe (42%), with limited representation from low- and middle-income countries.

Conclusion

The results of this review highlight potential research waste due to duplication in evidence synthesis efforts. Coordinated action among organizations advising policymakers, such as NSCs, public health agencies, and evidence review bodies may help establish more efficient, collaborative approaches that enable reuse and adaptation across contexts. Such action could include real-time sharing of ongoing reviews, multiregion comprehensive reviews, and the use of stratified analyses to tailor findings to country-specific needs. These strategies should be explored to determine whether organizations can reduce unnecessary duplication, enhance equity, improve the timeliness and relevance of guidance, and redirect resources toward unmet research priorities and other pressing public health challenges.
目的:估计用于健康筛查的证据合成产品生产中潜在的研究浪费的程度,并对其程度进行初步评估。研究设计和设置:2014年至2024年间由英国国家筛查委员会(UK NSC)和美国预防服务工作组(USPSTF)发布的支持成人人群筛查建议的证据合成产品被确定为锚定综述。对于每一篇锚点综述,我们在Embase、Medline以及国家和国际组织网站上搜索了关于同一主题的重叠证据综述,这些证据综述被定义为解决相同的研究问题,但在人口、干预措施、比较和结果方面至少有部分重叠。结果:从英国NSC和USPSTF共确定了48个锚点审查(涵盖33个条件)。其中有92%(44/48)的证据评价存在重叠,每个锚点评价中位数为4个额外评价(范围:0-60;四分位数间距[IQR]: 2-15)。在重叠的审查中,11%显示了与先前工作的部分使用重叠,明确地更新或建立在先前的外部工作之上,但是有新的元素和范围差异,保持了它们作为重叠的分类。关注两个组织共同感兴趣的核心条件子集,中位数重叠增加到13(范围:2-47;IQR: 4-17),表明在优先领域存在大量重复。证据库中70%的评价是在北美(28%)和西欧(42%)进行的,来自低收入和中等收入国家的代表性有限。结论:本综述的结果突出了由于证据合成工作的重复而可能造成的研究浪费。为决策者提供咨询的组织(如国家筛选委员会、公共卫生机构和证据审查机构)之间的协调行动可能有助于建立更有效的协作方法,从而实现跨环境的重用和适应。这种行动可包括实时分享正在进行的审查、多区域全面审查和使用分层分析使调查结果适合具体国家的需要。应探讨这些战略,以确定各组织是否能够减少不必要的重复,增强公平性,提高指导的及时性和相关性,并将资源转向未满足的研究重点和其他紧迫的公共卫生挑战。
{"title":"Potential waste in evidence synthesis for health screening: a scoping review and call for action","authors":"Sarah Batson ,&nbsp;Matthew J. Randell ,&nbsp;Catherine Bane ,&nbsp;Julia Geppert ,&nbsp;Pranshu Mundada ,&nbsp;Chris Stinton ,&nbsp;Eleanor Cozens ,&nbsp;Maggie Powell ,&nbsp;Sian Taylor-Phillips","doi":"10.1016/j.jclinepi.2025.112053","DOIUrl":"10.1016/j.jclinepi.2025.112053","url":null,"abstract":"<div><h3>Objectives</h3><div>To estimate the extent of potential research waste in the production of evidence-synthesis products for health screening, providing an initial assessment of its magnitude.</div></div><div><h3>Study Design and Setting</h3><div>Evidence-synthesis products supporting screening recommendations for adult populations, published by the UK National Screening Committee (UK NSC) and the US Preventive Services Task Force (USPSTF) between 2014 and 2024, were identified as anchor reviews. For each anchor review, Embase, Medline, and national and international organization websites were searched for overlapping evidence reviews on the same topic, defined as addressing the same research questions with at least partial overlap in the population, interventions, comparisons, and outcomes.</div></div><div><h3>Results</h3><div>A total of 48 anchor reviews (covering 33 conditions) were identified from the UK NSC and USPSTF. Overlapping evidence reviews were identified for 92% (44/48) of these, with a median of 4 additional reviews per anchor review (range: 0–60; interquartile range [IQR]: 2–15). Of the overlapping reviews, 11% showed overlap with partial use of prior work, explicitly updating or building upon prior external work, but with new elements and scope differences that maintained their classification as overlapping. Focusing on a core subset of conditions of shared interest to both organizations, the median overlap increased to 13 (range: 2–47; IQR: 4–17), indicating substantial duplication in priority areas. Seventy percent of all reviews in the evidence base were conducted in North America (28%) and Western Europe (42%), with limited representation from low- and middle-income countries.</div></div><div><h3>Conclusion</h3><div>The results of this review highlight potential research waste due to duplication in evidence synthesis efforts. Coordinated action among organizations advising policymakers, such as NSCs, public health agencies, and evidence review bodies may help establish more efficient, collaborative approaches that enable reuse and adaptation across contexts. Such action could include real-time sharing of ongoing reviews, multiregion comprehensive reviews, and the use of stratified analyses to tailor findings to country-specific needs. These strategies should be explored to determine whether organizations can reduce unnecessary duplication, enhance equity, improve the timeliness and relevance of guidance, and redirect resources toward unmet research priorities and other pressing public health challenges.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"190 ","pages":"Article 112053"},"PeriodicalIF":5.2,"publicationDate":"2025-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145558295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing a framework for assessing the applicability of the target condition in diagnostic research 发展一个评估目标条件在诊断研究中的适用性的框架。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-15 DOI: 10.1016/j.jclinepi.2025.112059
Eve Tomlinson , Jude Holmes , Anne W.S. Rutjes , Clare Davenport , Mariska Leeflang , Bada Yang , Sue Mallett , Penny Whiting
<div><h3>Objectives</h3><div>Assessment of the applicability of primary studies is an essential but often a challenging aspect of systematic reviews of diagnostic test accuracy studies (DTA reviews). We explored review authors’ applicability assessments for the QUADAS-2 reference standard domain within Cochrane DTA reviews. We highlight applicability concerns, identify potential issues with assessment, and develop a framework for assessing the applicability of the target condition as defined by the reference standard.</div></div><div><h3>Study Design and Setting</h3><div>Methodological review. DTA reviews in the Cochrane Library that used QUADAS-2 and judged applicability for the reference standard domain as “high concern” for at least one study were eligible. One reviewer extracted the rationale for the “high concern” and this was checked by a second reviewer. Two reviewers categorized the rationale inductively into themes, and a third reviewer verified these. Discussions regarding the extracted information informed framework development.</div></div><div><h3>Results</h3><div>We identified 50 eligible reviews. Five themes emerged: study uses different reference standard threshold to define the target condition (six reviews), misclassification by the reference standard in the study such that the target condition in the study does not match the review question (11 reviews), reference standard could not be applied to all participants resulting in a different target condition (five reviews), misunderstanding QUADAS-2 applicability (seven reviews), and insufficient information (21 reviews). Our framework for researchers outlines four potential applicability concerns for the assessment of the target condition as defined by the reference standard: different sub-categories of the target condition, different threshold used to define the target condition, reference standard not applied to full study group, and misclassification of the target condition by the reference standard.</div></div><div><h3>Conclusion</h3><div>Clear sources of applicability concerns are identifiable, but several Cochrane review authors struggle to adequately identify and report them. We have developed an applicability framework to guide review authors in their assessment of applicability concerns for the QUADAS reference standard domain.</div></div><div><h3>Plain Language Summary</h3><div>What is the problem? Doctors use tests to help to decide if a person has a certain condition. They want to know how accurate the test is before they use it. This means how well it can tell people who have the condition from people who do not have it. This information can be found in “diagnostic systematic reviews”. Diagnostic systematic reviews start with a research question. They bring together findings from studies that have already been done to try to answer this question. It is important for researchers to check that the studies match the review question. This is called an “applicability assess
目的:评估初步研究的适用性是诊断试验准确性研究系统评价(DTA评价)的一个重要但经常具有挑战性的方面。我们在Cochrane DTA综述中探讨了综述作者对QUADAS-2参考标准领域的适用性评估。我们强调适用性问题,识别评估中的潜在问题,并制定一个框架来评估参考标准定义的目标条件的适用性。研究设计和设置:方法学回顾。Cochrane图书馆中使用QUADAS-2并判定参考标准领域的适用性为至少一项研究“高度关注”的DTA评价是合格的。一位审稿人提取了“高度关注”的理由,这由另一位审稿人进行了检查。两位审稿人将基本原理归纳为主题,第三位审稿人验证了这些主题。关于抽取信息知情框架开发的讨论。结果:我们确定了50篇符合条件的综述。出现了五个主题:研究使用不同的参考标准阈值来定义目标条件(6篇综述),研究中参考标准的错误分类导致研究中的目标条件与综述问题不匹配(11篇综述),参考标准不能适用于所有参与者导致不同的目标条件(5篇综述),误解QUADAS-2适用性(7篇综述),信息不充分(21篇综述)。我们的研究人员框架概述了参考标准所定义的目标条件评估的四个潜在适用性问题:目标条件的不同子类别,定义目标条件的不同阈值,参考标准不适用于整个研究组,以及参考标准对目标条件的错误分类。结论:明确的适用性问题来源是可识别的,但一些Cochrane综述作者难以充分识别和报告它们。我们已经开发了一个适用性框架来指导评审作者评估QUADAS参考标准领域的适用性问题。问题是什么?医生通过测试来帮助确定一个人是否患有某种疾病。在使用之前,他们想知道测试的准确性。这意味着它可以很好地区分患有这种疾病的人。这些信息可以在“诊断系统评价”中找到。诊断性系统评价从一个研究问题开始。他们汇集了已经完成的研究结果,试图回答这个问题。研究人员检查研究是否符合回顾问题是很重要的。这被称为“适用性评估”。例如,如果综述着眼于儿童,那么检查这些研究是否也关注儿童是很重要的。有一个名为“QUADAS-2”的工具可以用来检查研究与复习问题的匹配程度。这可能很难做到,而且没有很多例子可以帮助人们。我们做了什么?我们想更多地了解人们如何使用QUADAS-2工具来判断适用性。我们还想编写指导来支持关于适用性的判断。我们发现了什么?我们找到了人们如何进行适用性评估的例子。许多评论没有做对,我们解释为什么会这样。我们还做了指导,帮助人们进行适用性评估。
{"title":"Developing a framework for assessing the applicability of the target condition in diagnostic research","authors":"Eve Tomlinson ,&nbsp;Jude Holmes ,&nbsp;Anne W.S. Rutjes ,&nbsp;Clare Davenport ,&nbsp;Mariska Leeflang ,&nbsp;Bada Yang ,&nbsp;Sue Mallett ,&nbsp;Penny Whiting","doi":"10.1016/j.jclinepi.2025.112059","DOIUrl":"10.1016/j.jclinepi.2025.112059","url":null,"abstract":"&lt;div&gt;&lt;h3&gt;Objectives&lt;/h3&gt;&lt;div&gt;Assessment of the applicability of primary studies is an essential but often a challenging aspect of systematic reviews of diagnostic test accuracy studies (DTA reviews). We explored review authors’ applicability assessments for the QUADAS-2 reference standard domain within Cochrane DTA reviews. We highlight applicability concerns, identify potential issues with assessment, and develop a framework for assessing the applicability of the target condition as defined by the reference standard.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Study Design and Setting&lt;/h3&gt;&lt;div&gt;Methodological review. DTA reviews in the Cochrane Library that used QUADAS-2 and judged applicability for the reference standard domain as “high concern” for at least one study were eligible. One reviewer extracted the rationale for the “high concern” and this was checked by a second reviewer. Two reviewers categorized the rationale inductively into themes, and a third reviewer verified these. Discussions regarding the extracted information informed framework development.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Results&lt;/h3&gt;&lt;div&gt;We identified 50 eligible reviews. Five themes emerged: study uses different reference standard threshold to define the target condition (six reviews), misclassification by the reference standard in the study such that the target condition in the study does not match the review question (11 reviews), reference standard could not be applied to all participants resulting in a different target condition (five reviews), misunderstanding QUADAS-2 applicability (seven reviews), and insufficient information (21 reviews). Our framework for researchers outlines four potential applicability concerns for the assessment of the target condition as defined by the reference standard: different sub-categories of the target condition, different threshold used to define the target condition, reference standard not applied to full study group, and misclassification of the target condition by the reference standard.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Conclusion&lt;/h3&gt;&lt;div&gt;Clear sources of applicability concerns are identifiable, but several Cochrane review authors struggle to adequately identify and report them. We have developed an applicability framework to guide review authors in their assessment of applicability concerns for the QUADAS reference standard domain.&lt;/div&gt;&lt;/div&gt;&lt;div&gt;&lt;h3&gt;Plain Language Summary&lt;/h3&gt;&lt;div&gt;What is the problem? Doctors use tests to help to decide if a person has a certain condition. They want to know how accurate the test is before they use it. This means how well it can tell people who have the condition from people who do not have it. This information can be found in “diagnostic systematic reviews”. Diagnostic systematic reviews start with a research question. They bring together findings from studies that have already been done to try to answer this question. It is important for researchers to check that the studies match the review question. This is called an “applicability assess","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"190 ","pages":"Article 112059"},"PeriodicalIF":5.2,"publicationDate":"2025-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145543777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Challenges in using GRADE by systematic review authors and how to overcome them: a response to Andric et al. 系统评价作者在使用GRADE时面临的挑战以及如何克服这些挑战:对Andric等人的回应。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-15 DOI: 10.1016/j.jclinepi.2025.112055
Miranda W. Langendam, Ignacio Neumann, Holger J. Schünemann
{"title":"Challenges in using GRADE by systematic review authors and how to overcome them: a response to Andric et al.","authors":"Miranda W. Langendam,&nbsp;Ignacio Neumann,&nbsp;Holger J. Schünemann","doi":"10.1016/j.jclinepi.2025.112055","DOIUrl":"10.1016/j.jclinepi.2025.112055","url":null,"abstract":"","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"190 ","pages":"Article 112055"},"PeriodicalIF":5.2,"publicationDate":"2025-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145543732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimands: what they are and why we should use them 估计:它们是什么,为什么我们应该使用它们。
IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2025-11-15 DOI: 10.1016/j.jclinepi.2025.112054
Brennan C. Kahan , Declan Devane
In clinical trials, postrandomization events, such as treatment discontinuation or the use of rescue medication, can complicate the interpretation of results. An estimand is a precise description of the treatment effect that investigators wish to estimate. Estimands facilitate more straightforward interpretation of trial results by explicitly defining how postrandomization “intercurrent” events are incorporated into the research question. This article introduces the five key attributes of estimands (population, treatment conditions, endpoint, summary measure, and strategies for intercurrent events) and explains the five main strategies for managing intercurrent events (treatment policy, composite, while on treatment, hypothetical, and principal stratum). Using a practical example of a trial comparing cognitive behavioral therapy vs medication for mild anxiety, we demonstrate how different estimand choices lead to varying study designs, analyses, and interpretations. Understanding estimands helps researchers design better trials and enables stakeholders to determine if the results are relevant to their situation. We also explain how sensitivity analyses can be used to check the reliability of results by assessing how results change under different statistical assumptions.
在临床试验中,随机化后的事件,如停止治疗或使用抢救药物,可能使结果的解释复杂化。估计是对研究人员希望估计的治疗效果的精确描述。通过明确定义随机化后的“交互”事件如何纳入研究问题,估算有助于更直接地解释试验结果。本文介绍了估计的五个关键属性(人口、治疗条件、终点、汇总测量和并发事件的策略),并解释了管理并发事件的五个主要策略(治疗策略、综合治疗、同时治疗、假设和主要阶层)。通过一个比较认知行为疗法和药物治疗轻度焦虑的试验实例,我们展示了不同的评估和选择如何导致不同的研究设计、分析和解释。了解评估有助于研究人员设计更好的试验,并使利益相关者能够确定结果是否与他们的情况相关。我们还解释了如何通过评估结果在不同统计假设下的变化来使用敏感性分析来检查结果的可靠性。
{"title":"Estimands: what they are and why we should use them","authors":"Brennan C. Kahan ,&nbsp;Declan Devane","doi":"10.1016/j.jclinepi.2025.112054","DOIUrl":"10.1016/j.jclinepi.2025.112054","url":null,"abstract":"<div><div>In clinical trials, postrandomization events, such as treatment discontinuation or the use of rescue medication, can complicate the interpretation of results. An estimand is a precise description of the treatment effect that investigators wish to estimate. Estimands facilitate more straightforward interpretation of trial results by explicitly defining how postrandomization “intercurrent” events are incorporated into the research question. This article introduces the five key attributes of estimands (population, treatment conditions, endpoint, summary measure, and strategies for intercurrent events) and explains the five main strategies for managing intercurrent events (treatment policy, composite, while on treatment, hypothetical, and principal stratum). Using a practical example of a trial comparing cognitive behavioral therapy vs medication for mild anxiety, we demonstrate how different estimand choices lead to varying study designs, analyses, and interpretations. Understanding estimands helps researchers design better trials and enables stakeholders to determine if the results are relevant to their situation. We also explain how sensitivity analyses can be used to check the reliability of results by assessing how results change under different statistical assumptions.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"189 ","pages":"Article 112054"},"PeriodicalIF":5.2,"publicationDate":"2025-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145543764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Clinical Epidemiology
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1