首页 > 最新文献

Implementation Science最新文献

英文 中文
What validated instruments, that measure implementation outcomes, are suitable for use in the Paediatric Intensive Care Unit (PICU) setting? A systematic review of systematic reviews. 哪些衡量执行结果的有效工具适合在儿童重症监护室(PICU)环境中使用?对系统综述的系统综述。
IF 8.8 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-10 DOI: 10.1186/s13012-024-01378-4
Elizabeth Dodds, Sarah Redsell, Stephen Timmons, Joseph C Manning

Background/aims: The measurement of implementation outcomes can establish the success of implementing evidence into practice. However, implementation outcomes are seldom measured in acute healthcare settings, such as Paediatric Intensive Care Units (PICU), and if they are used, are likely to be non-validated, site or intervention-specific measures. To address this literature gap, this systematic review of systematic reviews aims to identify validated instruments to measure implementation outcomes of new EBP interventions in a PICU setting.

Methods: A systematic review of systematic reviews was conducted in two phases. Phase One: Five electronic databases were searched between 06/10/22 and 14/10/22. Systematic reviews were selected using pre-determined eligibility criteria. Methodological quality was assessed using the Critical Appraisal Skills Programme tool and a data extraction table was used to allow further synthesis. Phase Two: Secondary eligibility criteria were used to extract and review instruments from the systematic reviews selected in Phase One. Instruments were analysed and mapped to the Consolidated Framework of Implementation Research (CFIR).

Results: Phase One: Searches resulted in 3195 unique papers. Five systematic reviews were eligible for inclusion. All examined the psychometric properties of each instrument, utilising different methods to do so; three considered their pragmatic or usability properties; and one identified instruments that were transferrable to different settings. Each systematic review identified that most included instruments had limited evidence of their validity or reliability and had poor psychometric properties. Phase two: 93 instruments were screened, and nine were eligible for analysis. After analysis and CFIR mapping, two instruments were identified as potentially adaptable to the PICU setting.

Conclusions: The methodological quality of implementation outcome measurement instruments is inadequate, warranting further validation research. Two instruments were identified that cover multiple CFIR domains and have scope to be adapted for use when implementing evidence-based practice into the PICU. Further work is needed to adapt and further validate an instrument for use in practice.

Trial registration: For transparency of procedures and methods, the protocol for this systematic review was registered with PROSPERO (registration number CRD42022361638L).

背景/目的:对实施结果的衡量可以确定将证据应用于实践的成功与否。然而,在儿科重症监护病房(PICU)等急症医疗环境中,很少对实施结果进行测量,即使使用,也可能是未经验证的、针对特定场所或干预措施的测量方法。为了填补这一文献空白,本系统综述旨在确定有效的工具,以衡量新的 EBP 干预措施在 PICU 环境中的实施结果:方法:分两个阶段对系统综述进行系统综述。第一阶段:2012 年 10 月 6 日至 10 月 14 日期间搜索了五个电子数据库。根据预先确定的资格标准筛选出系统综述。使用 "批判性评估技能计划 "工具对方法学质量进行评估,并使用数据提取表进行进一步综合。第二阶段:使用二级资格标准从第一阶段选定的系统性综述中提取并审查工具。对工具进行分析,并将其映射到实施研究综合框架(CFIR):第一阶段:通过检索,共找到 3195 篇论文。五篇系统综述符合纳入条件。所有综述都研究了每种工具的心理测量特性,并采用了不同的方法;三篇综述考虑了工具的实用性或可用性;一篇综述确定了可用于不同环境的工具。每篇系统性综述都指出,大多数工具的有效性或可靠性证据有限,心理测量特性较差。第二阶段:共筛选出 93 项工具,其中 9 项符合分析条件。经过分析和CFIR图谱绘制,有两种工具被认为可能适用于PICU环境:结论:实施结果测量工具的方法学质量不足,需要进一步验证研究。已确定的两种工具涵盖多个 CFIR 领域,在 PICU 中实施循证实践时有调整使用的余地。需要进一步开展工作,调整并进一步验证在实践中使用的工具:为提高程序和方法的透明度,本系统综述的方案已在 PROSPERO 注册(注册号为 CRD42022361638L)。
{"title":"What validated instruments, that measure implementation outcomes, are suitable for use in the Paediatric Intensive Care Unit (PICU) setting? A systematic review of systematic reviews.","authors":"Elizabeth Dodds, Sarah Redsell, Stephen Timmons, Joseph C Manning","doi":"10.1186/s13012-024-01378-4","DOIUrl":"10.1186/s13012-024-01378-4","url":null,"abstract":"<p><strong>Background/aims: </strong>The measurement of implementation outcomes can establish the success of implementing evidence into practice. However, implementation outcomes are seldom measured in acute healthcare settings, such as Paediatric Intensive Care Units (PICU), and if they are used, are likely to be non-validated, site or intervention-specific measures. To address this literature gap, this systematic review of systematic reviews aims to identify validated instruments to measure implementation outcomes of new EBP interventions in a PICU setting.</p><p><strong>Methods: </strong>A systematic review of systematic reviews was conducted in two phases. Phase One: Five electronic databases were searched between 06/10/22 and 14/10/22. Systematic reviews were selected using pre-determined eligibility criteria. Methodological quality was assessed using the Critical Appraisal Skills Programme tool and a data extraction table was used to allow further synthesis. Phase Two: Secondary eligibility criteria were used to extract and review instruments from the systematic reviews selected in Phase One. Instruments were analysed and mapped to the Consolidated Framework of Implementation Research (CFIR).</p><p><strong>Results: </strong>Phase One: Searches resulted in 3195 unique papers. Five systematic reviews were eligible for inclusion. All examined the psychometric properties of each instrument, utilising different methods to do so; three considered their pragmatic or usability properties; and one identified instruments that were transferrable to different settings. Each systematic review identified that most included instruments had limited evidence of their validity or reliability and had poor psychometric properties. Phase two: 93 instruments were screened, and nine were eligible for analysis. After analysis and CFIR mapping, two instruments were identified as potentially adaptable to the PICU setting.</p><p><strong>Conclusions: </strong>The methodological quality of implementation outcome measurement instruments is inadequate, warranting further validation research. Two instruments were identified that cover multiple CFIR domains and have scope to be adapted for use when implementing evidence-based practice into the PICU. Further work is needed to adapt and further validate an instrument for use in practice.</p><p><strong>Trial registration: </strong>For transparency of procedures and methods, the protocol for this systematic review was registered with PROSPERO (registration number CRD42022361638L).</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"70"},"PeriodicalIF":8.8,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11466035/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142402038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Revisiting the scope and expectations of Implementation Science and Implementation Science Communications. 重新审视 "实施科学 "和 "实施科学传播 "的范围和期望。
IF 8.8 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-04 DOI: 10.1186/s13012-024-01399-z
Paul Wilson, Gregory A Aarons, Anne Sales, Dong Roman Xu, Michel Wensing, Alison Hutchinson, Rinad S Beidas, Elvin Geng

This editorial updates the scope and submission expectations of Implementation Science and Implementation Science Communications. We refine our protocol publishing policies and set out new expectations for reporting studies describing determinants and their relationship with implementation outcomes. Our central focus remains on the implementation of evidence-based interventions into healthcare practice and policy. We are most interested in rigorous empirical studies of the implementation of evidence-based healthcare interventions, practices, and policies, and the de-implementation of those that are demonstrated to be of low-value or no benefit. Alongside this, we remain interested in the systematic study of implementation mechanisms and processes and on the influences of patient, professional, and organizational behaviours. Novel theoretical and methodological developments are considered. For all submissions, we expect authors to demonstrate how their work is integrated with existing knowledge in the field and to clearly state the added value of the work to the field broadly.

这篇社论更新了《实施科学》和《实施科学通讯》的范围和投稿期望。我们完善了协议出版政策,并对描述决定因素及其与实施结果之间关系的研究报告提出了新的期望。我们的核心重点仍然是将循证干预措施落实到医疗实践和政策中。我们最感兴趣的是对循证医疗保健干预措施、实践和政策的实施情况进行严格的实证研究,以及取消那些被证明价值低或无益的干预措施。与此同时,我们对实施机制和过程的系统研究,以及对患者、专业人员和组织行为的影响也很感兴趣。我们会考虑新的理论和方法发展。对于所有投稿,我们希望作者能够展示他们的工作是如何与该领域的现有知识相结合的,并明确说明该工作对整个领域的附加价值。
{"title":"Revisiting the scope and expectations of Implementation Science and Implementation Science Communications.","authors":"Paul Wilson, Gregory A Aarons, Anne Sales, Dong Roman Xu, Michel Wensing, Alison Hutchinson, Rinad S Beidas, Elvin Geng","doi":"10.1186/s13012-024-01399-z","DOIUrl":"10.1186/s13012-024-01399-z","url":null,"abstract":"<p><p>This editorial updates the scope and submission expectations of Implementation Science and Implementation Science Communications. We refine our protocol publishing policies and set out new expectations for reporting studies describing determinants and their relationship with implementation outcomes. Our central focus remains on the implementation of evidence-based interventions into healthcare practice and policy. We are most interested in rigorous empirical studies of the implementation of evidence-based healthcare interventions, practices, and policies, and the de-implementation of those that are demonstrated to be of low-value or no benefit. Alongside this, we remain interested in the systematic study of implementation mechanisms and processes and on the influences of patient, professional, and organizational behaviours. Novel theoretical and methodological developments are considered. For all submissions, we expect authors to demonstrate how their work is integrated with existing knowledge in the field and to clearly state the added value of the work to the field broadly.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"69"},"PeriodicalIF":8.8,"publicationDate":"2024-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11452926/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142376339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of implementation strategies on nursing practice and patient outcomes: a comprehensive systematic review and meta-analysis. 实施策略对护理实践和患者疗效的影响:一项全面的系统回顾和荟萃分析。
IF 8.8 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-30 DOI: 10.1186/s13012-024-01398-0
Guillaume Fontaine, Billy Vinette, Charlene Weight, Marc-André Maheu-Cadotte, Andréane Lavallée, Marie-France Deschênes, Alexandra Lapierre, Sonia A Castiglione, Gabrielle Chicoine, Geneviève Rouleau, Nikolas Argiropoulos, Kristin Konnyu, Meagan Mooney, Christine E Cassidy, Tanya Mailhot, Patrick Lavoie, Catherine Pépin, Sylvie Cossette, Marie-Pierre Gagnon, Sonia Semenic, Nicola Straiton, Sandy Middleton
<p><strong>Background: </strong>Implementation strategies targeting individual healthcare professionals and teams, such as audit and feedback, educational meetings, opinion leaders, and reminders, have demonstrated potential in promoting evidence-based nursing practice. This systematic review examined the effects of the 19 Cochrane Effective Practice and Organization Care (EPOC) healthcare professional-level implementation strategies on nursing practice and patient outcomes.</p><p><strong>Methods: </strong>A systematic review was conducted following the Cochrane Handbook, with six databases searched up to February 2023 for randomized studies and non-randomized controlled studies evaluating the effects of EPOC implementation strategies on nursing practice. Study selection and data extraction were performed in Covidence. Random-effects meta-analyses were conducted in RevMan, while studies not eligible for meta-analysis were synthesized narratively based on the direction of effects. The quality of evidence was assessed using GRADE.</p><p><strong>Results: </strong>Out of 21,571 unique records, 204 studies (152 randomized, 52 controlled, non-randomized) enrolling 36,544 nurses and 340,320 patients were included. Common strategies (> 10% of studies) were educational meetings, educational materials, guidelines, reminders, audit and feedback, tailored interventions, educational outreach, and opinion leaders. Implementation strategies as a whole improved clinical practice outcomes compared to no active intervention, despite high heterogeneity. Group and individual education, patient-mediated interventions, reminders, tailored interventions and opinion leaders had statistically significant effects on clinical practice outcomes. Individual education improved nurses' attitude, knowledge, perceived control, and skills, while group education also influenced perceived social norms. Although meta-analyses indicate a small, non-statistically significant effect of multifaceted versus single strategies on clinical practice, the narrative synthesis of non-meta-analyzed studies shows favorable outcomes in all studies comparing multifaceted versus single strategies. Group and individual education, as well as tailored interventions, had statistically significant effects on patient outcomes.</p><p><strong>Conclusions: </strong>Multiple types of implementation strategies may enhance evidence-based nursing practice, though effects vary due to strategy complexity, contextual factors, and variability in outcome measurement. Some evidence suggests that multifaceted strategies are more effective than single component strategies. Effects on patient outcomes are modest. Healthcare organizations and implementation practitioners may consider employing multifaceted, tailored strategies to address local barriers, expand the use of underutilized strategies, and assess the long-term impact of strategies on nursing practice and patient outcomes.</p><p><strong>Trial registration: </str
背景:针对医护人员个人和团队的实施策略,如审核和反馈、教育会议、意见领袖和提醒等,在促进循证护理实践方面已显示出潜力。本系统性综述研究了 19 项 Cochrane 有效实践和组织护理(EPOC)医护专业人员层面的实施策略对护理实践和患者预后的影响:根据 Cochrane 手册进行了系统性综述,检索了截至 2023 年 2 月的 6 个数据库,其中包括评估 EPOC 实施策略对护理实践影响的随机研究和非随机对照研究。研究选择和数据提取在 Covidence 中进行。随机效应荟萃分析在RevMan中进行,而不符合荟萃分析条件的研究则根据效应方向进行叙述性综合。证据质量采用 GRADE 进行评估:在 21,571 条唯一记录中,共纳入了 204 项研究(152 项随机研究、52 项对照研究和非随机研究),涉及 36,544 名护士和 340,320 名患者。常见的策略(> 10%的研究)包括教育会议、教材、指南、提醒、审核和反馈、定制干预、教育推广和意见领袖。尽管异质性很高,但与不采取积极干预措施相比,实施策略整体上改善了临床实践结果。集体和个人教育、以患者为媒介的干预、提醒、有针对性的干预和意见领袖对临床实践结果有显著的统计学影响。个别教育改善了护士的态度、知识、感知控制和技能,而集体教育也影响了感知社会规范。尽管荟萃分析表明,多方面策略与单一策略相比,对临床实践的影响较小且无统计学意义,但对未进行荟萃分析的研究进行的叙述性综合显示,在所有比较多方面策略与单一策略的研究中,多方面策略与单一策略都取得了良好的结果。小组和个人教育以及量身定制的干预措施对患者的治疗效果具有统计学意义:多种类型的实施策略可加强循证护理实践,但效果因策略的复杂性、背景因素和结果测量的差异性而有所不同。一些证据表明,多方面的策略比单一组成部分的策略更有效。对患者疗效的影响不大。医疗机构和实施人员可以考虑采用多方面的、量身定制的策略来解决当地的障碍,扩大未充分利用的策略的使用范围,并评估这些策略对护理实践和患者预后的长期影响:ProCORD42019130446.
{"title":"Effects of implementation strategies on nursing practice and patient outcomes: a comprehensive systematic review and meta-analysis.","authors":"Guillaume Fontaine, Billy Vinette, Charlene Weight, Marc-André Maheu-Cadotte, Andréane Lavallée, Marie-France Deschênes, Alexandra Lapierre, Sonia A Castiglione, Gabrielle Chicoine, Geneviève Rouleau, Nikolas Argiropoulos, Kristin Konnyu, Meagan Mooney, Christine E Cassidy, Tanya Mailhot, Patrick Lavoie, Catherine Pépin, Sylvie Cossette, Marie-Pierre Gagnon, Sonia Semenic, Nicola Straiton, Sandy Middleton","doi":"10.1186/s13012-024-01398-0","DOIUrl":"10.1186/s13012-024-01398-0","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Implementation strategies targeting individual healthcare professionals and teams, such as audit and feedback, educational meetings, opinion leaders, and reminders, have demonstrated potential in promoting evidence-based nursing practice. This systematic review examined the effects of the 19 Cochrane Effective Practice and Organization Care (EPOC) healthcare professional-level implementation strategies on nursing practice and patient outcomes.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;A systematic review was conducted following the Cochrane Handbook, with six databases searched up to February 2023 for randomized studies and non-randomized controlled studies evaluating the effects of EPOC implementation strategies on nursing practice. Study selection and data extraction were performed in Covidence. Random-effects meta-analyses were conducted in RevMan, while studies not eligible for meta-analysis were synthesized narratively based on the direction of effects. The quality of evidence was assessed using GRADE.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Out of 21,571 unique records, 204 studies (152 randomized, 52 controlled, non-randomized) enrolling 36,544 nurses and 340,320 patients were included. Common strategies (&gt; 10% of studies) were educational meetings, educational materials, guidelines, reminders, audit and feedback, tailored interventions, educational outreach, and opinion leaders. Implementation strategies as a whole improved clinical practice outcomes compared to no active intervention, despite high heterogeneity. Group and individual education, patient-mediated interventions, reminders, tailored interventions and opinion leaders had statistically significant effects on clinical practice outcomes. Individual education improved nurses' attitude, knowledge, perceived control, and skills, while group education also influenced perceived social norms. Although meta-analyses indicate a small, non-statistically significant effect of multifaceted versus single strategies on clinical practice, the narrative synthesis of non-meta-analyzed studies shows favorable outcomes in all studies comparing multifaceted versus single strategies. Group and individual education, as well as tailored interventions, had statistically significant effects on patient outcomes.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;Multiple types of implementation strategies may enhance evidence-based nursing practice, though effects vary due to strategy complexity, contextual factors, and variability in outcome measurement. Some evidence suggests that multifaceted strategies are more effective than single component strategies. Effects on patient outcomes are modest. Healthcare organizations and implementation practitioners may consider employing multifaceted, tailored strategies to address local barriers, expand the use of underutilized strategies, and assess the long-term impact of strategies on nursing practice and patient outcomes.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Trial registration: &lt;/str","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"68"},"PeriodicalIF":8.8,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11443951/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142332711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A living critical interpretive synthesis to yield a framework on the production and dissemination of living evidence syntheses for decision-making. 活生生的批判性解释综述,为决策制定和传播活生生的证据综述提供框架。
IF 8.8 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-27 DOI: 10.1186/s13012-024-01396-2
Cristián Mansilla, Qi Wang, Thomas Piggott, Peter Bragge, Kerry Waddell, Gordon Guyatt, Arthur Sweetman, John N Lavis

Background: The COVID-19 pandemic has had an unprecedented impact in the global research production and has also increased research waste. Living evidence syntheses (LESs) seek to regularly update a body of evidence addressing a specific question. During the COVID-19 pandemic, the production and dissemination of LESs emerged as a cornerstone of the evidence infrastructure. This critical interpretive synthesis answers the questions: What constitutes an LES to support decision-making?; when should one be produced, updated, and discontinued?; and how should one be disseminated?

Methods: Searches included the Cochrane Library, EMBASE (Ovid), Health Systems Evidence, MEDLINE (Ovid), PubMed, and Web of Science up to 23 April 2024 and included articles that provide any insights on addressing the compass questions on LESs. Articles were selected and appraised, and their insights extracted. An interpretive and iterative coding process was used to identify relevant thematic categories and create a conceptual framework.

Results: Among the 16,630 non-duplicate records identified, 208 publications proved eligible. Most were non-empirical articles, followed by actual LESs. Approximately one in three articles were published in response to the COVID-19 pandemic. The conceptual framework addresses six thematic categories: (1) what is an LES; (2) what methodological approaches facilitate LESs production; (3) when to produce an LES; (4) when to update an LES; (5) how to make available the findings of an LES; and (6) when to discontinue LES updates.

Conclusion: LESs can play a critical role in reducing research waste and ensuring alignment with advisory and decision-making processes. This critical interpretive synthesis provides relevant insights on how to better organize the global evidence architecture to support their production.

Trial registration: PROSPERO registration: CRD42021241875.

背景:COVID-19 大流行对全球研究成果产生了前所未有的影响,同时也增加了研究浪费。活证据综述(LES)旨在定期更新针对特定问题的一整套证据。在 COVID-19 大流行期间,活证据综述的制作和传播成为证据基础设施的基石。这篇重要的解释性综述回答了以下问题:什么是支持决策的 LES?何时应编制、更新和终止 LES?搜索范围包括 Cochrane Library、EMBASE (Ovid)、Health Systems Evidence、MEDLINE (Ovid)、PubMed 和 Web of Science,搜索时间截止到 2024 年 4 月 23 日,其中包括对解决 LES 指南问题有任何见解的文章。对文章进行了筛选和评估,并提取了其观点。采用解释性和迭代式编码过程确定相关主题类别并创建概念框架:在已确定的 16,630 条非重复记录中,有 208 篇出版物符合条件。大部分是非实证性文章,其次是实际的 LES。大约每三篇文章中就有一篇是针对 COVID-19 大流行发表的。该概念框架涉及六个专题类别:(1)什么是 LES;(2)哪些方法有利于 LES 的编制;(3)何时编制 LES;(4)何时更新 LES;(5)如何提供 LES 的研究结果;以及(6)何时停止 LES 的更新:LES 可在减少研究浪费、确保与咨询和决策过程保持一致方面发挥关键作用。这篇重要的解释性综述就如何更好地组织全球证据架构以支持其生产提供了相关见解:试验注册:PROSPERO 注册:CRD42021241875。
{"title":"A living critical interpretive synthesis to yield a framework on the production and dissemination of living evidence syntheses for decision-making.","authors":"Cristián Mansilla, Qi Wang, Thomas Piggott, Peter Bragge, Kerry Waddell, Gordon Guyatt, Arthur Sweetman, John N Lavis","doi":"10.1186/s13012-024-01396-2","DOIUrl":"https://doi.org/10.1186/s13012-024-01396-2","url":null,"abstract":"<p><strong>Background: </strong>The COVID-19 pandemic has had an unprecedented impact in the global research production and has also increased research waste. Living evidence syntheses (LESs) seek to regularly update a body of evidence addressing a specific question. During the COVID-19 pandemic, the production and dissemination of LESs emerged as a cornerstone of the evidence infrastructure. This critical interpretive synthesis answers the questions: What constitutes an LES to support decision-making?; when should one be produced, updated, and discontinued?; and how should one be disseminated?</p><p><strong>Methods: </strong>Searches included the Cochrane Library, EMBASE (Ovid), Health Systems Evidence, MEDLINE (Ovid), PubMed, and Web of Science up to 23 April 2024 and included articles that provide any insights on addressing the compass questions on LESs. Articles were selected and appraised, and their insights extracted. An interpretive and iterative coding process was used to identify relevant thematic categories and create a conceptual framework.</p><p><strong>Results: </strong>Among the 16,630 non-duplicate records identified, 208 publications proved eligible. Most were non-empirical articles, followed by actual LESs. Approximately one in three articles were published in response to the COVID-19 pandemic. The conceptual framework addresses six thematic categories: (1) what is an LES; (2) what methodological approaches facilitate LESs production; (3) when to produce an LES; (4) when to update an LES; (5) how to make available the findings of an LES; and (6) when to discontinue LES updates.</p><p><strong>Conclusion: </strong>LESs can play a critical role in reducing research waste and ensuring alignment with advisory and decision-making processes. This critical interpretive synthesis provides relevant insights on how to better organize the global evidence architecture to support their production.</p><p><strong>Trial registration: </strong>PROSPERO registration: CRD42021241875.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"67"},"PeriodicalIF":8.8,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11429155/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142332710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Gaps in communication theory paradigms when conducting implementation science research: qualitative observations from interviews with administrators, implementors, and evaluators of rural health programs 开展实施科学研究时传播理论范式的差距:从对农村卫生项目管理人员、实施人员和评估人员的访谈中得出的定性观察结论
IF 7.2 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-16 DOI: 10.1186/s13012-024-01395-3
Nicole L. Johnson, Jennifer Van Tiem, Erin Balkenende, DeShauna Jones, Julia E. Friberg, Emily E. Chasco, Jane Moeckli, Kenda S. Steffensmeier, Melissa J. A. Steffen, Kanika Arora, Borsika A. Rabin, Heather Schacht Reisinger
Communication is considered an inherent element of nearly every implementation strategy. Often it is seen as a means for imparting new information between stakeholders, representing a Transaction orientation to communication. From a Process orientation, communication is more than information-exchange and is acknowledged as being shaped by (and shaping) the individuals involved and their relationships with one another. As the field of Implementation Science (IS) works to strengthen theoretical integration, we encourage an interdisciplinary approach that engages communication theory to develop richer understanding of strategies and determinants of practice. We interviewed 28 evaluators, 12 implementors, and 12 administrators from 21 Enterprise-Wide Initiatives funded by the Department of Veteran Affairs Office of Rural Health. Semi-structured interviews focused on experiences with implementation and evaluation strategies. We analyzed the interviews using thematic analysis identifying a range of IS constructs. Then we deductively classified those segments based on a Transaction or Process orientation to communication. We organized findings using the two IS constructs most commonly discussed in interviews: Collaboration and Leadership Buy-in. The majority of segments coded as Collaboration (n = 34, 74%) and Leadership Buy-in (n = 31, 70%) discussed communication from a Transaction orientation and referred to communication as synonymous with information exchange, which emphasizes the task over the relationships between the individuals performing the tasks. Conversely, when participants discussed Collaboration and Leadership Buy-in from a Process orientation, they acknowledged both constructs as the result of long-term efforts to develop positive relationships based on trust and respect, and emphasized the time costliness of such strategies. Our findings demonstrate that participants who discussed communication from a Process orientation recognized the nuance and complexity of interpersonal interactions, particularly in the context of IS. Efficient, reliable information exchange is a critical but often overemphasized element of implementation. Practitioners and researchers must recognize and incorporate the larger role of communication in IS. Two suggestions for engaging a Process orientation to communication are to: (a) use interview probes to learn how communication is enacted, and (b) use process-oriented communication theories to develop interventions and evaluation tools.
几乎所有的实施战略都将传播视为固有的要素。通常情况下,沟通被视为在利益相关者之间传递新信息的一种手段,代表了沟通的 "交易导向"。从 "过程 "的角度来看,沟通不仅仅是信息交流,它还被认为是由参与其中的个人及其相互之间的关系所决定的。随着实施科学(IS)领域努力加强理论整合,我们鼓励采用跨学科的方法,将传播理论纳入其中,从而对实践的策略和决定因素有更丰富的理解。我们采访了退伍军人事务部农村卫生办公室资助的 21 个全企业计划的 28 名评估人员、12 名实施人员和 12 名管理人员。半结构式访谈的重点是实施和评估策略方面的经验。我们使用主题分析法对访谈进行了分析,确定了一系列信息系统的结构。然后,我们根据沟通的事务导向或过程导向对这些片段进行了演绎分类。我们利用访谈中最常讨论的两个信息系统结构对调查结果进行了整理:协作和领导买进。大多数被编码为 "协作"(34 人,占 74%)和 "领导买进"(31 人,占 70%)的片段都是从 "事务 "导向来讨论沟通的,并将沟通视为信息交流的同义词,强调任务而非执行任务的个人之间的关系。相反,当参与者从过程的角度来讨论合作和领导买进时,他们认为这两个概念都是长期努力的结果,是在信任和尊重的基础上发展积极关系的结果,并强调了这种策略的时间成本。我们的研究结果表明,从 "过程导向 "出发讨论沟通问题的参与者认识到了人际互动的细微差别和复杂性,尤其是在信息系统的背景下。高效、可靠的信息交流是实施过程中的一个关键因素,但往往被过分强调。从业人员和研究人员必须认识到沟通在信息系统中的更大作用,并将其纳入其中。有两项建议可以从过程的角度来看待交流,它们是(a) 利用访谈调查了解沟通是如何进行的,(b) 利用以过程为导向的沟通理论制定干预措施和评估工具。
{"title":"Gaps in communication theory paradigms when conducting implementation science research: qualitative observations from interviews with administrators, implementors, and evaluators of rural health programs","authors":"Nicole L. Johnson, Jennifer Van Tiem, Erin Balkenende, DeShauna Jones, Julia E. Friberg, Emily E. Chasco, Jane Moeckli, Kenda S. Steffensmeier, Melissa J. A. Steffen, Kanika Arora, Borsika A. Rabin, Heather Schacht Reisinger","doi":"10.1186/s13012-024-01395-3","DOIUrl":"https://doi.org/10.1186/s13012-024-01395-3","url":null,"abstract":"Communication is considered an inherent element of nearly every implementation strategy. Often it is seen as a means for imparting new information between stakeholders, representing a Transaction orientation to communication. From a Process orientation, communication is more than information-exchange and is acknowledged as being shaped by (and shaping) the individuals involved and their relationships with one another. As the field of Implementation Science (IS) works to strengthen theoretical integration, we encourage an interdisciplinary approach that engages communication theory to develop richer understanding of strategies and determinants of practice. We interviewed 28 evaluators, 12 implementors, and 12 administrators from 21 Enterprise-Wide Initiatives funded by the Department of Veteran Affairs Office of Rural Health. Semi-structured interviews focused on experiences with implementation and evaluation strategies. We analyzed the interviews using thematic analysis identifying a range of IS constructs. Then we deductively classified those segments based on a Transaction or Process orientation to communication. We organized findings using the two IS constructs most commonly discussed in interviews: Collaboration and Leadership Buy-in. The majority of segments coded as Collaboration (n = 34, 74%) and Leadership Buy-in (n = 31, 70%) discussed communication from a Transaction orientation and referred to communication as synonymous with information exchange, which emphasizes the task over the relationships between the individuals performing the tasks. Conversely, when participants discussed Collaboration and Leadership Buy-in from a Process orientation, they acknowledged both constructs as the result of long-term efforts to develop positive relationships based on trust and respect, and emphasized the time costliness of such strategies. Our findings demonstrate that participants who discussed communication from a Process orientation recognized the nuance and complexity of interpersonal interactions, particularly in the context of IS. Efficient, reliable information exchange is a critical but often overemphasized element of implementation. Practitioners and researchers must recognize and incorporate the larger role of communication in IS. Two suggestions for engaging a Process orientation to communication are to: (a) use interview probes to learn how communication is enacted, and (b) use process-oriented communication theories to develop interventions and evaluation tools.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"40 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Process evaluation of two large randomized controlled trials to understand factors influencing family physicians’ use of antibiotic audit and feedback reports 对两项大型随机对照试验进行过程评估,以了解影响家庭医生使用抗生素审计和反馈报告的因素
IF 7.2 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-16 DOI: 10.1186/s13012-024-01393-5
Jennifer Shuldiner, Meagan Lacroix, Marianne Saragosa, Catherine Reis, Kevin L. Schwartz, Sharon Gushue, Valerie Leung, Jeremy Grimshaw, Michael Silverman, Kednapa Thavorn, Jerome A. Leis, Michael Kidd, Nick Daneman, Mina Tradous, Bradley Langford, Andrew M. Morris, Jonathan Lam, Gary Garber, Jamie Brehaut, Monica Taljaard, Michelle Greiver, Noah Michael Ivers
Unnecessary antibiotic prescriptions in primary care are common and contribute to antimicrobial resistance in the population. Audit and feedback (A&F) on antibiotic prescribing to primary care can improve the appropriateness of antibiotic prescribing, but the optimal approach is uncertain. We performed two pragmatic randomized controlled trials of different approaches to audit and feedback. The trial results showed that A&F was associated with significantly reducing antibiotic prescribing. Still, the effect size was small, and the modifications to the A&F interventions tested in the trials were not associated with any change. Herein, we report a theory-informed qualitative process evaluation to explore potential mechanisms underlying the observed effects. Ontario family physicians in the intervention arms of both trials who were sent A&F letters were invited for one-on-one interviews. Purposive sampling was used to seek variation across interested participants in personal and practice characteristics. Qualitative analysis utilized inductive and deductive techniques informed by the Clinical Performance Feedback Intervention Theory. Modifications to the intervention design tested in the trial did not alter prescribing patterns beyond the changes made in response to the A&F overall for various reasons. Change in antibiotic prescribing in response to A&F depended on whether it led to the formation of specific intentions and whether those intentions translated to particular behaviours. Those without intentions to change tended to feel that their unique clinical context was not represented in the A&F. Those with intentions but without specific actions taken tended to express a lack of self-efficacy for avoiding a prescription in contexts with time constraints and/or without an ongoing patient relationship. Many participants noted that compared to overall prescribing, A&F on antibiotic prescription duration was perceived as new information and easily actionable. Our findings indicate that contextual factors, including the types of patients and the setting where they are seen, affect how clinicians react to audit and feedback. These results suggest a need to test tailored feedback reports that reflect the context of how, where, and why physicians prescribe antibiotics so that they might be perceived as more personal and more actionable. Clinical Trial registration IDs: NCT04594200, NCT05044052.
基层医疗机构开具不必要的抗生素处方的现象很普遍,这也是导致人群产生抗菌药耐药性的原因之一。对基层医疗机构的抗生素处方进行审核和反馈(A&F)可以提高抗生素处方的合理性,但最佳方法尚不确定。我们对审计和反馈的不同方法进行了两项务实的随机对照试验。试验结果表明,审核与反馈可显著减少抗生素处方。不过,效果规模很小,而且试验中对 A&F 干预方法的修改也没有带来任何变化。在此,我们报告了一项以理论为依据的定性过程评估,以探索观察到的效果背后的潜在机制。我们邀请两项试验干预组中收到 A&F 信件的安大略家庭医生进行一对一访谈。采用了有目的的抽样,以寻求感兴趣的参与者在个人和实践特征方面的差异。定性分析采用了以临床表现反馈干预理论为基础的归纳和演绎技术。由于各种原因,对试验中测试的干预设计进行的修改并没有改变处方模式,超出了对 A&F 整体反应所做的改变。抗生素处方根据 A&F 而发生的变化取决于 A&F 是否促成了特定意图的形成,以及这些意图是否转化为特定行为。那些没有改变意图的人往往认为,他们独特的临床背景在 A&F 中没有得到体现。那些有意愿但没有采取具体行动的人往往表示缺乏在时间有限和/或没有持续病人关系的情况下避免处方的自我效能感。许多参与者指出,与总体处方相比,关于抗生素处方持续时间的 A&F 被视为新信息,很容易采取行动。我们的研究结果表明,环境因素(包括患者类型和就诊环境)会影响临床医生对审核和反馈的反应。这些结果表明,有必要测试量身定制的反馈报告,以反映医生开抗生素处方的方式、地点和原因,从而使这些报告被视为更个性化、更具可操作性。临床试验注册编号:NCT04594200、NCT05044052。
{"title":"Process evaluation of two large randomized controlled trials to understand factors influencing family physicians’ use of antibiotic audit and feedback reports","authors":"Jennifer Shuldiner, Meagan Lacroix, Marianne Saragosa, Catherine Reis, Kevin L. Schwartz, Sharon Gushue, Valerie Leung, Jeremy Grimshaw, Michael Silverman, Kednapa Thavorn, Jerome A. Leis, Michael Kidd, Nick Daneman, Mina Tradous, Bradley Langford, Andrew M. Morris, Jonathan Lam, Gary Garber, Jamie Brehaut, Monica Taljaard, Michelle Greiver, Noah Michael Ivers","doi":"10.1186/s13012-024-01393-5","DOIUrl":"https://doi.org/10.1186/s13012-024-01393-5","url":null,"abstract":"Unnecessary antibiotic prescriptions in primary care are common and contribute to antimicrobial resistance in the population. Audit and feedback (A&F) on antibiotic prescribing to primary care can improve the appropriateness of antibiotic prescribing, but the optimal approach is uncertain. We performed two pragmatic randomized controlled trials of different approaches to audit and feedback. The trial results showed that A&F was associated with significantly reducing antibiotic prescribing. Still, the effect size was small, and the modifications to the A&F interventions tested in the trials were not associated with any change. Herein, we report a theory-informed qualitative process evaluation to explore potential mechanisms underlying the observed effects. Ontario family physicians in the intervention arms of both trials who were sent A&F letters were invited for one-on-one interviews. Purposive sampling was used to seek variation across interested participants in personal and practice characteristics. Qualitative analysis utilized inductive and deductive techniques informed by the Clinical Performance Feedback Intervention Theory. Modifications to the intervention design tested in the trial did not alter prescribing patterns beyond the changes made in response to the A&F overall for various reasons. Change in antibiotic prescribing in response to A&F depended on whether it led to the formation of specific intentions and whether those intentions translated to particular behaviours. Those without intentions to change tended to feel that their unique clinical context was not represented in the A&F. Those with intentions but without specific actions taken tended to express a lack of self-efficacy for avoiding a prescription in contexts with time constraints and/or without an ongoing patient relationship. Many participants noted that compared to overall prescribing, A&F on antibiotic prescription duration was perceived as new information and easily actionable. Our findings indicate that contextual factors, including the types of patients and the setting where they are seen, affect how clinicians react to audit and feedback. These results suggest a need to test tailored feedback reports that reflect the context of how, where, and why physicians prescribe antibiotics so that they might be perceived as more personal and more actionable. Clinical Trial registration IDs: NCT04594200, NCT05044052.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"4 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The effectiveness of a knowledge translation intervention on the implementation of NEWS2 in nursing homes, a pragmatic cluster RCT 知识转化干预对养老院实施 "新闻2号"(NEWS2)的有效性,一项务实的群组研究试验
IF 7.2 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-11 DOI: 10.1186/s13012-024-01392-6
Birgitte Graverholt, Birgitte Espehaug, Donna Ciliska, Thomas Potrebny
Improving the uptake of relevant and reliable research is an important priority in long-term care to achieve sustainable and high-quality services for the increasingly older population. The purpose was to assess the effectiveness of a tailored, adaptive and a multifaceted KT capacity program, relative to usual practice, on the implementation of National Early Warning Score 2 (NEWS2). This study was carried out as a pragmatic cluster-randomized controlled trial. The capacity program consisted of an educational part to address implementation capacity gaps and a facilitation-upon-implementation part to address a relevant knowledge gap in nursing homes. A collective decision was made to address the challenge of early detection of clinical deterioration among nursing home residents, by implementing the (NEWS2) as clinical innovation. Public nursing homes in a Norwegian municipality (n = 21) with a total of 1 466 beds were eligible for inclusion. The study-period spanned over a 22-month period, including a 12-month follow-up. Data was extracted from the Electronic Patient Journal system and analyzed using multilevel growth model analysis. The intervention had a large effect on the use of NEWS2 among care staff in intervention nursing homes, compared to the control group (standardized mean difference, d = 2.42). During the final month of the implementation period, residents in the intervention group was assessed with NEWS2 1.44 times (95% CI: 1.23, 1.64) per month, which is almost four times more often than in the control group (mean = 0.38, 95% CI: 0.19, 0.57). During the follow-up period, the effect of the intervention was not only sustained in the intervention group but there was a substantial increase in the use of NEWS2 in both the intervention (mean = 1.75, 95% CI: 1.55, 1.96) and control groups (mean = 1.45, 95% CI: 1.27, 1.65). This tailored implementation strategy had a large effect on the use of NEWS2 among care staff, demonstrating that integrated knowledge translation strategies can be a promising strategy to achieve evidence-based care in the nursing home sector. ISRCTN12437773 . Registered 19/3 2020, retrospectively.
要为日益增长的老年人口提供可持续的优质服务,提高相关可靠研究的利用率是长期护理领域的一个重要优先事项。本研究的目的是评估与常规做法相比,量身定制的、适应性强的多方面 KT 能力计划对实施国家预警评分 2(NEWS2)的有效性。本研究是一项务实的分组随机对照试验。能力提升计划包括教育部分和促进实施部分,前者旨在解决实施能力方面的不足,后者则旨在解决养老院在相关知识方面的不足。通过实施临床创新项目(NEWS2),集体决定应对早期发现疗养院居民临床病情恶化的挑战。研究对象包括挪威某市的公立疗养院(n = 21),共有床位 1466 张。研究为期22个月,包括12个月的随访。数据提取自电子病历系统,并采用多层次增长模型分析法进行分析。与对照组相比,干预措施对干预疗养院护理人员使用 "NEWS2 "有很大影响(标准化平均差,d = 2.42)。在实施期的最后一个月,干预组居民每月接受 NEWS2 评估的次数为 1.44 次(95% CI:1.23,1.64),几乎是对照组的四倍(平均值 = 0.38,95% CI:0.19,0.57)。在随访期间,干预效果不仅在干预组中得以持续,而且在干预组(平均值=1.75,95% CI:1.55,1.96)和对照组(平均值=1.45,95% CI:1.27,1.65)中,NEWS2 的使用率都有大幅提高。这种量身定制的实施策略对护理人员使用 NEWS2 有很大的影响,表明综合知识转化策略是在养老院领域实现循证护理的一种有前途的策略。ISRCTN12437773 .注册日期:2020 年 3 月 19 日,回顾性注册。
{"title":"The effectiveness of a knowledge translation intervention on the implementation of NEWS2 in nursing homes, a pragmatic cluster RCT","authors":"Birgitte Graverholt, Birgitte Espehaug, Donna Ciliska, Thomas Potrebny","doi":"10.1186/s13012-024-01392-6","DOIUrl":"https://doi.org/10.1186/s13012-024-01392-6","url":null,"abstract":"Improving the uptake of relevant and reliable research is an important priority in long-term care to achieve sustainable and high-quality services for the increasingly older population. The purpose was to assess the effectiveness of a tailored, adaptive and a multifaceted KT capacity program, relative to usual practice, on the implementation of National Early Warning Score 2 (NEWS2). This study was carried out as a pragmatic cluster-randomized controlled trial. The capacity program consisted of an educational part to address implementation capacity gaps and a facilitation-upon-implementation part to address a relevant knowledge gap in nursing homes. A collective decision was made to address the challenge of early detection of clinical deterioration among nursing home residents, by implementing the (NEWS2) as clinical innovation. Public nursing homes in a Norwegian municipality (n = 21) with a total of 1 466 beds were eligible for inclusion. The study-period spanned over a 22-month period, including a 12-month follow-up. Data was extracted from the Electronic Patient Journal system and analyzed using multilevel growth model analysis. The intervention had a large effect on the use of NEWS2 among care staff in intervention nursing homes, compared to the control group (standardized mean difference, d = 2.42). During the final month of the implementation period, residents in the intervention group was assessed with NEWS2 1.44 times (95% CI: 1.23, 1.64) per month, which is almost four times more often than in the control group (mean = 0.38, 95% CI: 0.19, 0.57). During the follow-up period, the effect of the intervention was not only sustained in the intervention group but there was a substantial increase in the use of NEWS2 in both the intervention (mean = 1.75, 95% CI: 1.55, 1.96) and control groups (mean = 1.45, 95% CI: 1.27, 1.65). This tailored implementation strategy had a large effect on the use of NEWS2 among care staff, demonstrating that integrated knowledge translation strategies can be a promising strategy to achieve evidence-based care in the nursing home sector. ISRCTN12437773 . Registered 19/3 2020, retrospectively.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"24 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142191571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of research co-design in health: a systematic overview of reviews and development of a framework 卫生领域共同设计研究的评估:系统性综述和框架开发
IF 7.2 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-11 DOI: 10.1186/s13012-024-01394-4
Sanne Peters, Lisa Guccione, Jill Francis, Stephanie Best, Emma Tavender, Janet Curran, Katie Davies, Stephanie Rowe, Victoria J. Palmer, Marlena Klaic
Co-design with consumers and healthcare professionals is widely used in applied health research. While this approach appears to be ethically the right thing to do, a rigorous evaluation of its process and impact is frequently missing. Evaluation of research co-design is important to identify areas of improvement in the methods and processes, as well as to determine whether research co-design leads to better outcomes. We aimed to build on current literature to develop a framework to assist researchers with the evaluation of co-design processes and impacts. A multifaceted, iterative approach, including three steps, was undertaken to develop a Co-design Evaluation Framework: 1) A systematic overview of reviews; 2) Stakeholder panel meetings to discuss and debate findings from the overview of reviews and 3) Consensus meeting with stakeholder panel. The systematic overview of reviews included relevant papers published between 2000 and 2022. OVID (Medline, Embase, PsycINFO), EBSCOhost (Cinahl) and the Cochrane Database of Systematic reviews were searched for papers that reported co-design evaluation or outcomes in health research. Extracted data was inductively analysed and evaluation themes were identified. Review findings were presented to a stakeholder panel, including consumers, healthcare professionals and researchers, to interpret and critique. A consensus meeting, including a nominal group technique, was applied to agree upon the Co-design Evaluation Framework. A total of 51 reviews were included in the systematic overview of reviews. Fifteen evaluation themes were identified and grouped into the following seven clusters: People (within co-design group), group processes, research processes, co-design context, people (outside co-design group), system and sustainment. If evaluation methods were mentioned, they mainly included qualitative data, informal consumer feedback and researchers’ reflections. The Co-Design Evaluation Framework used a tree metaphor to represent the processes and people in the co-design group (below-ground), underpinning system- and people-level outcomes beyond the co-design group (above-ground). To evaluate research co-design, researchers may wish to consider any or all components in the tree. The Co-Design Evaluation Framework has been collaboratively developed with various stakeholders to be used prospectively (planning for evaluation), concurrently (making adjustments during the co-design process) and retrospectively (reviewing past co-design efforts to inform future activities).
在应用健康研究中,与消费者和医疗保健专业人员共同设计的方法被广泛使用。虽然这种方法在道德上似乎是正确的,但对其过程和影响的严格评估却经常缺失。对研究协同设计进行评估对于确定方法和流程中需要改进的地方以及确定研究协同设计是否会带来更好的结果非常重要。我们的目标是在现有文献的基础上建立一个框架,帮助研究人员评估协同设计的过程和影响。我们采用了一种多方面的迭代方法(包括三个步骤)来开发协同设计评估框架:1) 对综述进行系统性概述;2) 召开利益相关者小组会议,对综述中的结论进行讨论和辩论;3) 与利益相关者小组召开共识会议。系统性综述包括 2000 年至 2022 年间发表的相关论文。在 OVID(Medline、Embase、PsycINFO)、EBSCOhost(Cinahl)和 Cochrane 系统性综述数据库中搜索了报告健康研究中共同设计评估或结果的论文。对提取的数据进行归纳分析,并确定评价主题。评审结果提交给利益相关者小组(包括消费者、医疗保健专业人员和研究人员)进行解释和评论。通过召开包括名义小组技术在内的共识会议,就共同设计评价框架达成一致。共有 51 篇综述被纳入系统综述。确定了 15 个评价主题,并将其分为以下 7 组:人员(协同设计小组内部)、小组流程、研究流程、协同设计背景、人员(协同设计小组外部)、系统和持续性。如果提到评估方法,则主要包括定性数据、非正式的消费者反馈和研究人员的反思。共同设计评价框架使用树形比喻来表示共同设计小组中的流程和人员(地下),以及共同设计小组之外的系统和人员层面的成果(地上)。在评估研究协同设计时,研究人员不妨考虑树中的任何或所有组成部分。共同设计评估框架是与各利益相关方合作开发的,可用于前瞻性评估(规划评估)、同步评估(在共同设计过程中进行调整)和回顾性评估(回顾过去的共同设计工作,为未来的活动提供参考)。
{"title":"Evaluation of research co-design in health: a systematic overview of reviews and development of a framework","authors":"Sanne Peters, Lisa Guccione, Jill Francis, Stephanie Best, Emma Tavender, Janet Curran, Katie Davies, Stephanie Rowe, Victoria J. Palmer, Marlena Klaic","doi":"10.1186/s13012-024-01394-4","DOIUrl":"https://doi.org/10.1186/s13012-024-01394-4","url":null,"abstract":"Co-design with consumers and healthcare professionals is widely used in applied health research. While this approach appears to be ethically the right thing to do, a rigorous evaluation of its process and impact is frequently missing. Evaluation of research co-design is important to identify areas of improvement in the methods and processes, as well as to determine whether research co-design leads to better outcomes. We aimed to build on current literature to develop a framework to assist researchers with the evaluation of co-design processes and impacts. A multifaceted, iterative approach, including three steps, was undertaken to develop a Co-design Evaluation Framework: 1) A systematic overview of reviews; 2) Stakeholder panel meetings to discuss and debate findings from the overview of reviews and 3) Consensus meeting with stakeholder panel. The systematic overview of reviews included relevant papers published between 2000 and 2022. OVID (Medline, Embase, PsycINFO), EBSCOhost (Cinahl) and the Cochrane Database of Systematic reviews were searched for papers that reported co-design evaluation or outcomes in health research. Extracted data was inductively analysed and evaluation themes were identified. Review findings were presented to a stakeholder panel, including consumers, healthcare professionals and researchers, to interpret and critique. A consensus meeting, including a nominal group technique, was applied to agree upon the Co-design Evaluation Framework. A total of 51 reviews were included in the systematic overview of reviews. Fifteen evaluation themes were identified and grouped into the following seven clusters: People (within co-design group), group processes, research processes, co-design context, people (outside co-design group), system and sustainment. If evaluation methods were mentioned, they mainly included qualitative data, informal consumer feedback and researchers’ reflections. The Co-Design Evaluation Framework used a tree metaphor to represent the processes and people in the co-design group (below-ground), underpinning system- and people-level outcomes beyond the co-design group (above-ground). To evaluate research co-design, researchers may wish to consider any or all components in the tree. The Co-Design Evaluation Framework has been collaboratively developed with various stakeholders to be used prospectively (planning for evaluation), concurrently (making adjustments during the co-design process) and retrospectively (reviewing past co-design efforts to inform future activities).","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"23 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142191572","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the tailored implementation of a multisite care navigation service for mental health in rural and remote Australia (The Bridging Study): protocol for a community-engaged hybrid effectiveness-implementation study. 评估针对澳大利亚农村和偏远地区精神健康的多站点护理导航服务的量身定制实施情况(桥梁研究):社区参与的有效性-实施性混合研究协议。
IF 8.8 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-09-04 DOI: 10.1186/s13012-024-01391-7
Zephanie Tyack, Steven McPhail, Gregory A Aarons, Kelly McGrath, Andrew Barron, Hannah Carter, Sarah Larkins, Adrian Barnett, Eloise Hummell, Ruth Tulleners, Olivia Fisher, Gillian Harvey, Lee Jones, Kate Murray, Bridget Abell

Background: A dramatic decline in mental health of people worldwide in the early COVID-19 pandemic years has not recovered. In rural and remote Australia, access to appropriate and timely mental health services has been identified as a major barrier to people seeking help for mental ill-health. From 2020 to 2021 a care navigation model, Navicare, was co-designed with rural and remote communities in the Greater Whitsunday Region of Central Queensland in Australia. The Exploration, Preparation, Implementation and Sustainment (EPIS) framework was used to design and guide multiple aspects of a multisite study, The Bridging Study, to evaluate the implementation of Navicare in Australia.

Methods: A community-engaged hybrid effectiveness-implementation study design will focus on the tailored implementation of Navicare at three new sites as well as monitoring implementation at an existing site established since 2021. Study outcomes assessed will include sustained access as the co-primary outcome (measured using access to Navicare mental health referral services) and Proctor's Implementation Outcomes of feasibility, acceptability, appropriateness, adoption, fidelity, implementation cost, and sustainability. Data collection for the implementation evaluation will include service usage data, community consultations, interviews, and workshops; analysed using mixed methods and guided by EPIS and other implementation frameworks. Pre-post effectiveness and cost-consequence study components are embedded in the implementation and sustainment phases, with comparison to pre-implementation data and value assessed for each EPIS phase using hospital, service, and resource allocation data. A scaling up strategy will be co-developed using a national roundtable forum in the final year of the study. Qualitative exploration of other aspects of the study (e.g., mechanisms of action and stakeholder engagement) will be conducted.

Discussion: Our study will use tailoring to local sites and a community-engaged approach to drive implementation of a mental health care navigation service in rural and remote Australia, with expected benefits to mental healthcare access. This approach is consistent with policy recommendations nationally and internationally as building blocks for rural health including the World Health Organization Framework for Action on Strengthening Health Systems to Improve Health Outcomes.

Trial registration: Prospectively registered on April 2, 2024, on the Australian New Zealand Clinical Trials Registry, no. ACTRN12624000382572. https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=386665&isReview=true .

背景:在 COVID-19 大流行的早期,全世界人们的心理健康水平急剧下降,至今仍未恢复。在澳大利亚的农村和偏远地区,获得适当和及时的心理健康服务被认为是人们寻求心理疾病帮助的主要障碍。从 2020 年到 2021 年,我们与澳大利亚昆士兰州中部大圣灵群岛地区的农村和偏远社区共同设计了一种名为 "导航"(Navicare)的护理导航模式。探索、准备、实施和维持(EPIS)框架被用于设计和指导一项多站点研究--"桥梁研究 "的多个方面,以评估Navicare在澳大利亚的实施情况:方法:采用社区参与的成效-实施混合研究设计,重点关注 Navicare 在三个新站点的定制实施情况,以及对 2021 年以来建立的现有站点实施情况的监测。评估的研究成果将包括作为共同主要成果的持续获得性(通过获得 Navicare 心理健康转介服务来衡量),以及 Proctor 的实施成果,即可行性、可接受性、适当性、采用率、忠实度、实施成本和可持续性。实施评估的数据收集将包括服务使用数据、社区咨询、访谈和研讨会;采用混合方法进行分析,并以 EPIS 和其他实施框架为指导。在实施和持续阶段,将进行事前事后效果和成本后果研究,并利用医院、服务和资源分配数据,对 EPIS 各阶段的实施前数据和价值进行比较评估。在研究的最后一年,将通过全国圆桌论坛共同制定推广战略。还将对研究的其他方面(如作用机制和利益相关者参与)进行定性探索:我们的研究将采用因地制宜和社区参与的方法,在澳大利亚农村和偏远地区推动心理保健导航服务的实施,预计将为心理保健服务的获取带来益处。这种方法符合国家和国际上作为农村健康基石的政策建议,包括世界卫生组织关于加强卫生系统以改善健康结果的行动框架:试验注册:2024 年 4 月 2 日在澳大利亚-新西兰临床试验注册中心进行了前瞻性注册,注册号:actrn1262400038。actrn12624000382572. https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=386665&isReview=true .
{"title":"Evaluating the tailored implementation of a multisite care navigation service for mental health in rural and remote Australia (The Bridging Study): protocol for a community-engaged hybrid effectiveness-implementation study.","authors":"Zephanie Tyack, Steven McPhail, Gregory A Aarons, Kelly McGrath, Andrew Barron, Hannah Carter, Sarah Larkins, Adrian Barnett, Eloise Hummell, Ruth Tulleners, Olivia Fisher, Gillian Harvey, Lee Jones, Kate Murray, Bridget Abell","doi":"10.1186/s13012-024-01391-7","DOIUrl":"10.1186/s13012-024-01391-7","url":null,"abstract":"<p><strong>Background: </strong>A dramatic decline in mental health of people worldwide in the early COVID-19 pandemic years has not recovered. In rural and remote Australia, access to appropriate and timely mental health services has been identified as a major barrier to people seeking help for mental ill-health. From 2020 to 2021 a care navigation model, Navicare, was co-designed with rural and remote communities in the Greater Whitsunday Region of Central Queensland in Australia. The Exploration, Preparation, Implementation and Sustainment (EPIS) framework was used to design and guide multiple aspects of a multisite study, The Bridging Study, to evaluate the implementation of Navicare in Australia.</p><p><strong>Methods: </strong>A community-engaged hybrid effectiveness-implementation study design will focus on the tailored implementation of Navicare at three new sites as well as monitoring implementation at an existing site established since 2021. Study outcomes assessed will include sustained access as the co-primary outcome (measured using access to Navicare mental health referral services) and Proctor's Implementation Outcomes of feasibility, acceptability, appropriateness, adoption, fidelity, implementation cost, and sustainability. Data collection for the implementation evaluation will include service usage data, community consultations, interviews, and workshops; analysed using mixed methods and guided by EPIS and other implementation frameworks. Pre-post effectiveness and cost-consequence study components are embedded in the implementation and sustainment phases, with comparison to pre-implementation data and value assessed for each EPIS phase using hospital, service, and resource allocation data. A scaling up strategy will be co-developed using a national roundtable forum in the final year of the study. Qualitative exploration of other aspects of the study (e.g., mechanisms of action and stakeholder engagement) will be conducted.</p><p><strong>Discussion: </strong>Our study will use tailoring to local sites and a community-engaged approach to drive implementation of a mental health care navigation service in rural and remote Australia, with expected benefits to mental healthcare access. This approach is consistent with policy recommendations nationally and internationally as building blocks for rural health including the World Health Organization Framework for Action on Strengthening Health Systems to Improve Health Outcomes.</p><p><strong>Trial registration: </strong>Prospectively registered on April 2, 2024, on the Australian New Zealand Clinical Trials Registry, no. ACTRN12624000382572. https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=386665&isReview=true .</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"62"},"PeriodicalIF":8.8,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11373177/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142134538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Protocol for a type 3 hybrid implementation cluster randomized clinical trial to evaluate the effect of patient and clinician nudges to advance the use of genomic medicine across a diverse health system. 第 3 类混合实施群组随机临床试验方案,旨在评估患者和临床医生的推动作用,以促进基因组医学在不同医疗系统中的应用。
IF 8.8 1区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-19 DOI: 10.1186/s13012-024-01385-5
Anna C Raper, Benita L Weathers, Theodore G Drivas, Colin A Ellis, Colleen Morse Kripke, Randall A Oyer, Anjali T Owens, Anurag Verma, Paul E Wileyto, Colin C Wollack, Wenting Zhou, Marylyn D Ritchie, Robert A Schnoll, Katherine L Nathanson

Background: Germline genetic testing is recommended for an increasing number of conditions with underlying genetic etiologies, the results of which impact medical management. However, genetic testing is underutilized in clinics due to system, clinician, and patient level barriers. Behavioral economics provides a framework to create implementation strategies, such as nudges, to address these multi-level barriers and increase the uptake of genetic testing for conditions where the results impact medical management.

Methods: Patients meeting eligibility for germline genetic testing for a group of conditions will be identified using electronic phenotyping algorithms. A pragmatic, type 3 hybrid cluster randomization study will test nudges to patients and/or clinicians, or neither. Clinicians who receive nudges will be prompted to either refer their patient to genetics or order genetic testing themselves. We will use rapid cycle approaches informed by clinician and patient experiences, health equity, and behavioral economics to optimize these nudges before trial initiation. The primary implementation outcome is uptake of germline genetic testing for the pre-selected health conditions. Patient data collected through the electronic health record (e.g. demographics, geocoded address) will be examined as moderators of the effect of nudges.

Discussion: This study will be one of the first randomized trials to examine the effects of patient- and clinician-directed nudges informed by behavioral economics on uptake of genetic testing. The pragmatic design will facilitate a large and diverse patient sample, allow for the assessment of genetic testing uptake, and provide comparison of the effect of different nudge combinations. This trial also involves optimization of patient identification, test selection, ordering, and result reporting in an electronic health record-based infrastructure to further address clinician-level barriers to utilizing genomic medicine. The findings may help determine the impact of low-cost, sustainable implementation strategies that can be integrated into health care systems to improve the use of genomic medicine.

Trial registration: ClinicalTrials.gov. NCT06377033. Registered on March 31, 2024. https://clinicaltrials.gov/study/NCT06377033?term=NCT06377033&rank=1.

背景:越来越多具有潜在遗传病因的疾病建议进行种系基因检测,检测结果会影响医疗管理。然而,由于系统、临床医生和患者层面的障碍,基因检测在诊所中的利用率并不高。行为经济学提供了一个框架,可用于制定实施策略,如 "引导"(nudges),以解决这些多层次的障碍,并提高基因检测结果对医疗管理的影响:方法:将使用电子表型算法识别符合一组病症的种系基因检测资格的患者。一项务实的 3 型混合群组随机研究将对患者和/或临床医生或两者都不接受提示的患者进行测试。接受提示的临床医生将被提示将患者转诊至遗传学中心或自行进行基因检测。我们将根据临床医生和患者的经验、健康公平和行为经济学,采用快速循环方法,在试验开始前优化这些提示。主要实施结果是针对预选健康状况的种系基因检测的接受率。通过电子健康记录收集到的患者数据(如人口统计学、地理编码地址)将作为干预效果的调节因素进行研究:本研究将是首批随机试验之一,用于研究以行为经济学为依据、由患者和临床医生指导的劝导对基因检测接受率的影响。务实的设计将有助于获得大量不同的患者样本,评估基因检测的接受程度,并比较不同劝导组合的效果。这项试验还包括在基于电子健康记录的基础设施中优化患者识别、检测选择、订购和结果报告,以进一步解决临床医生在利用基因组医学方面的障碍。研究结果可能有助于确定低成本、可持续的实施策略的影响,这些策略可以整合到医疗保健系统中,以改善基因组医学的使用:试验注册:ClinicalTrials.gov.NCT06377033。注册日期:2024 年 3 月 31 日。https://clinicaltrials.gov/study/NCT06377033?term=NCT06377033&rank=1。
{"title":"Protocol for a type 3 hybrid implementation cluster randomized clinical trial to evaluate the effect of patient and clinician nudges to advance the use of genomic medicine across a diverse health system.","authors":"Anna C Raper, Benita L Weathers, Theodore G Drivas, Colin A Ellis, Colleen Morse Kripke, Randall A Oyer, Anjali T Owens, Anurag Verma, Paul E Wileyto, Colin C Wollack, Wenting Zhou, Marylyn D Ritchie, Robert A Schnoll, Katherine L Nathanson","doi":"10.1186/s13012-024-01385-5","DOIUrl":"10.1186/s13012-024-01385-5","url":null,"abstract":"<p><strong>Background: </strong>Germline genetic testing is recommended for an increasing number of conditions with underlying genetic etiologies, the results of which impact medical management. However, genetic testing is underutilized in clinics due to system, clinician, and patient level barriers. Behavioral economics provides a framework to create implementation strategies, such as nudges, to address these multi-level barriers and increase the uptake of genetic testing for conditions where the results impact medical management.</p><p><strong>Methods: </strong>Patients meeting eligibility for germline genetic testing for a group of conditions will be identified using electronic phenotyping algorithms. A pragmatic, type 3 hybrid cluster randomization study will test nudges to patients and/or clinicians, or neither. Clinicians who receive nudges will be prompted to either refer their patient to genetics or order genetic testing themselves. We will use rapid cycle approaches informed by clinician and patient experiences, health equity, and behavioral economics to optimize these nudges before trial initiation. The primary implementation outcome is uptake of germline genetic testing for the pre-selected health conditions. Patient data collected through the electronic health record (e.g. demographics, geocoded address) will be examined as moderators of the effect of nudges.</p><p><strong>Discussion: </strong>This study will be one of the first randomized trials to examine the effects of patient- and clinician-directed nudges informed by behavioral economics on uptake of genetic testing. The pragmatic design will facilitate a large and diverse patient sample, allow for the assessment of genetic testing uptake, and provide comparison of the effect of different nudge combinations. This trial also involves optimization of patient identification, test selection, ordering, and result reporting in an electronic health record-based infrastructure to further address clinician-level barriers to utilizing genomic medicine. The findings may help determine the impact of low-cost, sustainable implementation strategies that can be integrated into health care systems to improve the use of genomic medicine.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov. NCT06377033. Registered on March 31, 2024. https://clinicaltrials.gov/study/NCT06377033?term=NCT06377033&rank=1.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"61"},"PeriodicalIF":8.8,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11331805/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142005965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Implementation Science
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1