Inajara Rotta, Joyce A Diniz, Fernando Fernandez-Llimos
{"title":"Assessing methodological quality of systematic reviews with meta-analysis about clinical pharmacy services: A sensitivity analysis of AMSTAR-2.","authors":"Inajara Rotta, Joyce A Diniz, Fernando Fernandez-Llimos","doi":"10.1016/j.sapharm.2024.11.002","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Systematic reviews are critical for evidence-based healthcare decisions, but their validity depends on the quality of conduct and reporting. AMSTAR-2, a widely used tool for assessing the quality of systematic reviews, identifies seven critical domains influencing review validity, although its developers recommend flexibility in prioritizing these domains. To date, no studies have analyzed the impact of this change on systematic reviews with meta-analysis (SRMAs) evaluating clinical pharmacy services.</p><p><strong>Objective: </strong>To evaluate the quality of SRMAs on clinical pharmacy services and the effect of modifying AMSTAR-2 domains criticality on quality assessment.</p><p><strong>Methods: </strong>Systematic searches (updated January 1, 2023) were conducted in PubMed, Scopus, and Web of Science to identify SRMAs reporting the effects of clinical pharmacy services. Manual reference list searches of included studies were also performed. The methodological quality of SRMAs was assessed using the AMSTAR-2 tool. Changes in the overall classification of each SRMA were analyzed by hypothetically removing the critical designation for domains in the original tool.</p><p><strong>Results: </strong>Out of 153 eligible SRMAs, 138 (90.2 %) were classified as critically low quality, 13 (8.5 %) as low quality, and 2 (1.3 %) as moderate quality. Despite slight improvement in methodological quality over time, this change was not directly linked to the creation of various reporting and conducting guidelines and registries. Our analysis showed that the hypothetical removal of the criticality of each AMSTAR-2 domain did not significantly impact the overall quality assessment. Furthermore, all critical domains in AMSTAR-2 are considered essential in the field of pharmacy practice.</p><p><strong>Conclusion: </strong>Most SRMAs on clinical pharmacy services were classified as low or critically low quality and modifying the AMSTAR-2 domain criticality did not improve these assessments. Researchers, journal editors, and peer reviewers must work to enhance SRMAs quality, which are crucial for providing robust evidence for pharmaceutical services.</p>","PeriodicalId":48126,"journal":{"name":"Research in Social & Administrative Pharmacy","volume":" ","pages":"110-115"},"PeriodicalIF":3.7000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research in Social & Administrative Pharmacy","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.sapharm.2024.11.002","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/28 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Systematic reviews are critical for evidence-based healthcare decisions, but their validity depends on the quality of conduct and reporting. AMSTAR-2, a widely used tool for assessing the quality of systematic reviews, identifies seven critical domains influencing review validity, although its developers recommend flexibility in prioritizing these domains. To date, no studies have analyzed the impact of this change on systematic reviews with meta-analysis (SRMAs) evaluating clinical pharmacy services.
Objective: To evaluate the quality of SRMAs on clinical pharmacy services and the effect of modifying AMSTAR-2 domains criticality on quality assessment.
Methods: Systematic searches (updated January 1, 2023) were conducted in PubMed, Scopus, and Web of Science to identify SRMAs reporting the effects of clinical pharmacy services. Manual reference list searches of included studies were also performed. The methodological quality of SRMAs was assessed using the AMSTAR-2 tool. Changes in the overall classification of each SRMA were analyzed by hypothetically removing the critical designation for domains in the original tool.
Results: Out of 153 eligible SRMAs, 138 (90.2 %) were classified as critically low quality, 13 (8.5 %) as low quality, and 2 (1.3 %) as moderate quality. Despite slight improvement in methodological quality over time, this change was not directly linked to the creation of various reporting and conducting guidelines and registries. Our analysis showed that the hypothetical removal of the criticality of each AMSTAR-2 domain did not significantly impact the overall quality assessment. Furthermore, all critical domains in AMSTAR-2 are considered essential in the field of pharmacy practice.
Conclusion: Most SRMAs on clinical pharmacy services were classified as low or critically low quality and modifying the AMSTAR-2 domain criticality did not improve these assessments. Researchers, journal editors, and peer reviewers must work to enhance SRMAs quality, which are crucial for providing robust evidence for pharmaceutical services.
背景：系统评价对循证医疗决策至关重要，但其有效性取决于行为和报告的质量。AMSTAR-2是一个广泛使用的评估系统评审质量的工具，它确定了七个影响评审有效性的关键领域，尽管它的开发者建议在确定这些领域的优先级方面具有灵活性。到目前为止，还没有研究分析了这一变化对评估临床药学服务的meta分析（srma）系统评价的影响。目的：评价临床药学服务srma的质量及修改AMSTAR-2域临界度对质量评价的影响。方法：在PubMed、Scopus和Web of Science中进行系统检索（更新日期为2023年1月1日），以确定报告临床药学服务效果的srma。还对纳入的研究进行了人工参考文献列表搜索。使用AMSTAR-2工具评估srma的方法学质量。通过假设删除原始工具中域的关键指定，分析了每个SRMA总体分类的变化。结果：153例符合条件的srma中，138例（90.2%）为极低质量，13例（8.5%）为低质量，2例（1.3%）为中等质量。尽管随着时间的推移，方法质量略有改善，但这一变化并没有直接与各种报告和执行指导方针和登记的创建联系起来。我们的分析表明，假设去除每个AMSTAR-2域的临界性并没有显著影响总体质量评估。此外，AMSTAR-2中的所有关键领域都被认为是药学实践领域必不可少的。结论：大多数临床药学服务的srma被归类为低质量或极低质量，修改AMSTAR-2域临界性并不能改善这些评估。研究人员、期刊编辑和同行审稿人必须努力提高srma的质量，这对于为药品服务提供强有力的证据至关重要。
期刊介绍：
Research in Social and Administrative Pharmacy (RSAP) is a quarterly publication featuring original scientific reports and comprehensive review articles in the social and administrative pharmaceutical sciences. Topics of interest include outcomes evaluation of products, programs, or services; pharmacoepidemiology; medication adherence; direct-to-consumer advertising of prescription medications; disease state management; health systems reform; drug marketing; medication distribution systems such as e-prescribing; web-based pharmaceutical/medical services; drug commerce and re-importation; and health professions workforce issues.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
