首页 > 最新文献

Implementation science communications最新文献

英文 中文
A participatory systems approach for visualizing and testing implementation strategies and mechanisms: evidence adoption in community coalitions. 可视化和测试实施战略和机制的参与性系统方法:社区联盟的证据采纳。
IF 3.3 Pub Date : 2025-10-01 DOI: 10.1186/s43058-025-00788-9
Travis R Moore, Yuilyn A Chang Chusan, Mark Pachucki, Bo Kim
<p><strong>Background: </strong>The strengths of Implementation Science can be further enhanced by embracing methods that account for the complexity of real-world systems, complementing its existing focus on translating evidence into practice. Systems science offers an approach to understanding the interactions, feedback loops, and non-linear relationships that drive implementation processes. Despite its potential, practical examples of systems methods for designing and linking implementation strategies to mechanisms remain scarce. This case study demonstrates how systems methods can help operationalize implementation strategies and mechanisms within the context of a project called the Feasibility of Network Interventions for Coalition Adoption of Evidence-Informed Strategies initiative, which focuses on community coalitions advancing child health equity.</p><p><strong>Methods: </strong>Using the Participatory Implementation Systems Mapping approach, the research team and a five-member Community Advisory Council engaged in a structured, four-stage process to identify system determinants, co-specify implementation strategies and mechanisms, and simulate dynamic behavior. Causal loop diagrams and stock-and-flow diagrams were developed to visualize relationships, inform strategy design, and test expected effects on knowledge, adoption, and coalition decision-making.</p><p><strong>Results: </strong>The approach generated over 50 implementation determinants, organized into a coalition-focused conceptual systems framework (Stage 1); causal loop diagrams highlighting key feedback dynamics like knowledge diffusion and positive attitude toward evidence (Stage 2); and stock-and-flow diagrams translating five prioritized strategies into core system variables (Stage 3). Strategies, which included network weaving, informing local leaders, facilitating knowledge exchange, structured evidence review, and decision support tools, were operationalized with specific mechanisms (e.g., communication frequency, network density, perceived appropriateness). Simulations (Stage 4) showed that doubling review frequency increased knowledge by 17% but raised adoption by only 4% without complementary strategies. Adding decision support tools reduced time to reach adoption by 3 weeks, while introducing perceived relative advantage mid-simulation boosted adoption by 22%. Diffusion rates ranged from 0.02 to 0.08/week, moderated by social network quality.  DISCUSSION: The study illustrates how systems science methods bridge qualitative insights with quantitative modeling to design and preliminarily test adaptive, contextually relevant implementation strategies. Visualizing feedback loops and representing relationships as stocks and flows provides a framework to assess how implementation strategies influence coalition processes and outcomes. The findings emphasize the importance of participatory processes to ensure strategies are practical and aligned with coalition priorities. Fu
背景:实施科学的优势可以通过采用考虑现实世界系统复杂性的方法进一步增强,补充其现有的将证据转化为实践的重点。系统科学提供了一种理解驱动实现过程的交互、反馈循环和非线性关系的方法。尽管有潜力,但设计执行战略和将其与机制联系起来的系统方法的实际例子仍然很少。本案例研究展示了系统方法如何在一个名为“联合采用循证战略网络干预可行性”的项目背景下帮助实施战略和机制,该项目侧重于促进儿童健康公平的社区联盟。方法:采用参与式实施系统映射方法,研究团队和一个由五名成员组成的社区咨询委员会参与了一个结构化的四阶段过程,以确定系统决定因素,共同指定实施策略和机制,并模拟动态行为。因果循环图和库存-流量图被开发出来,以使关系可视化,为战略设计提供信息,并测试对知识、采用和联合决策的预期影响。结果:该方法产生了50多个实施决定因素,组织成一个以联盟为重点的概念系统框架(阶段1);因果循环图突出了关键的反馈动态,如知识扩散和对证据的积极态度(阶段2);库存和流量图将五个优先策略转化为核心系统变量(阶段3)。战略包括网络编织、通知当地领导人、促进知识交流、结构化证据审查和决策支持工具,并通过特定机制(如通信频率、网络密度、感知适当性)实施。模拟(阶段4)表明,如果没有补充策略,复习频率增加一倍,知识增加17%,但采用率仅提高4%。添加决策支持工具将实现采用的时间缩短了3周,而在模拟中期引入感知相对优势则使采用率提高了22%。扩散率在0.02 - 0.08/周之间,受社交网络质量的调节。讨论:该研究说明了系统科学方法如何将定性见解与定量建模相结合,以设计和初步测试自适应的、与上下文相关的实施策略。将反馈循环可视化并将关系表示为库存和流量,为评估实施战略如何影响联盟过程和结果提供了一个框架。调查结果强调了参与性进程的重要性,以确保战略切实可行,并与联盟的优先事项保持一致。未来的工作应侧重于实施、测试和扩展基于系统的方法,以应对实施方面的挑战。
{"title":"A participatory systems approach for visualizing and testing implementation strategies and mechanisms: evidence adoption in community coalitions.","authors":"Travis R Moore, Yuilyn A Chang Chusan, Mark Pachucki, Bo Kim","doi":"10.1186/s43058-025-00788-9","DOIUrl":"10.1186/s43058-025-00788-9","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;The strengths of Implementation Science can be further enhanced by embracing methods that account for the complexity of real-world systems, complementing its existing focus on translating evidence into practice. Systems science offers an approach to understanding the interactions, feedback loops, and non-linear relationships that drive implementation processes. Despite its potential, practical examples of systems methods for designing and linking implementation strategies to mechanisms remain scarce. This case study demonstrates how systems methods can help operationalize implementation strategies and mechanisms within the context of a project called the Feasibility of Network Interventions for Coalition Adoption of Evidence-Informed Strategies initiative, which focuses on community coalitions advancing child health equity.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;Using the Participatory Implementation Systems Mapping approach, the research team and a five-member Community Advisory Council engaged in a structured, four-stage process to identify system determinants, co-specify implementation strategies and mechanisms, and simulate dynamic behavior. Causal loop diagrams and stock-and-flow diagrams were developed to visualize relationships, inform strategy design, and test expected effects on knowledge, adoption, and coalition decision-making.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;The approach generated over 50 implementation determinants, organized into a coalition-focused conceptual systems framework (Stage 1); causal loop diagrams highlighting key feedback dynamics like knowledge diffusion and positive attitude toward evidence (Stage 2); and stock-and-flow diagrams translating five prioritized strategies into core system variables (Stage 3). Strategies, which included network weaving, informing local leaders, facilitating knowledge exchange, structured evidence review, and decision support tools, were operationalized with specific mechanisms (e.g., communication frequency, network density, perceived appropriateness). Simulations (Stage 4) showed that doubling review frequency increased knowledge by 17% but raised adoption by only 4% without complementary strategies. Adding decision support tools reduced time to reach adoption by 3 weeks, while introducing perceived relative advantage mid-simulation boosted adoption by 22%. Diffusion rates ranged from 0.02 to 0.08/week, moderated by social network quality.  DISCUSSION: The study illustrates how systems science methods bridge qualitative insights with quantitative modeling to design and preliminarily test adaptive, contextually relevant implementation strategies. Visualizing feedback loops and representing relationships as stocks and flows provides a framework to assess how implementation strategies influence coalition processes and outcomes. The findings emphasize the importance of participatory processes to ensure strategies are practical and aligned with coalition priorities. Fu","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"96"},"PeriodicalIF":3.3,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12487054/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145208592","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Between Process Gaps, Knowledge, and Patient Trust: Healthcare Workers' Insights on Implementing Tuberculosis Preventive Therapy for People with HIV in the Philippines and Indonesia. 在过程差距、知识和患者信任之间:菲律宾和印度尼西亚卫生保健工作者对艾滋病毒感染者实施结核病预防治疗的见解。
IF 3.3 Pub Date : 2025-09-30 DOI: 10.1186/s43058-025-00776-z
Mark Donald C Reñosa, Prashant Kulkarni, Laura Steiner, Candice Eula Lamigo, Bianca Joyce Sornillo, Ruth Anne Hechanova-Cruz, Anna Maureen Dungca-Lorilla, Aljira Fitya Hapsari, Evy Yunihastuti, Anshari Saifuddin Hasibuan, Mira Yulianti, Rossana A Ditangco, Jonathan E Golub, Christopher J Hoffmann

Background: Tuberculosis (TB) poses a considerable challenge for people with HIV (PWH), especially in low- and middle-income countries. Even with the availability of effective preventive strategies such as tuberculosis preventive therapy (TPT), the implementation of these measures continues to fall short. Our study explores the perceptions of healthcare workers (HCWs) regarding the barriers and facilitators to TPT implementation in the Philippines and Indonesia.

Methods: We performed 10 focus group discussions and four in-depth interviews with HCWs from June to December 2023. Each discussion and interview lasted between 45 and 120 min. Discussions explored HCWs' perspectives on the policies, logistics, and prescribing practices related to TPT, as well as their personal experiences, concerns, and suggested improvements. Data were coded using MAXQDA24 qualitative software informed by the tenets of constructivist grounded theory. We organized themes using the Consolidated Framework for Implementation Research (CFIR), while contextualizing implementation determinants most pertinent to the local contexts.

Results: Our findings revealed nuanced barriers and facilitators-marked by paradoxes-organized across three CFIR domains: the outer, inner, and individual domains of HIV-TB care. In the outer setting, barriers include limited patient knowledge and drug shortages, while facilitators involved national policies and external pressures from mass media and peer imitation. The inner setting was shaped by structural gaps-such as poor documentation, staff turnover, and procedural challenges in ruling out active TB-that affected patient trust, whereas open communication and role clarity supported TPT implementation. At the individual level, HCWs expressed high motivation but cited limited capacity due to lack of training and information to deliver effective TPT care.

Conclusions: Our findings highlight implementation determinants to TPT implementation across outer, inner, and individual domains of HIV-TB care. Understanding how structural gaps, provider capacity, and patient trust intersect with supportive policies, and peer and mass media influences offer insights into the complex dynamics shaping TPT uptake and integration. Our study insights may inform policy adjustments and guide strategies to better integrate TPT into national health frameworks.

背景:结核病(TB)对艾滋病毒感染者(PWH)构成了相当大的挑战,特别是在低收入和中等收入国家。即使有了结核病预防治疗等有效的预防战略,这些措施的执行仍然不足。我们的研究探讨了卫生保健工作者(HCWs)对菲律宾和印度尼西亚实施TPT的障碍和促进因素的看法。方法:于2023年6月至12月对医护人员进行10次焦点小组讨论和4次深度访谈。每次讨论和访谈持续45到120分钟。讨论探讨了卫生保健工作者对与TPT相关的政策、后勤和处方实践的看法,以及他们的个人经验、关注点和改进建议。根据建构主义扎根理论的原则,使用MAXQDA24定性软件对数据进行编码。我们使用实施研究综合框架(CFIR)组织主题,同时将与当地环境最相关的实施决定因素置于环境中。结果:我们的发现揭示了细微的障碍和促进因素——以悖论为特征——组织在三个CFIR领域:HIV-TB护理的外部、内部和个体领域。在外部环境中,障碍包括患者知识有限和药物短缺,而促进因素涉及国家政策和来自大众媒体和同行模仿的外部压力。内部环境受到结构性缺陷的影响,如文件编制不完善、人员流动和排除主动结核病的程序挑战,这些影响了患者的信任,而开放的沟通和角色明确则支持TPT的实施。在个人层面上,卫生保健员表达了很高的积极性,但指出由于缺乏培训和信息,提供有效的TPT护理的能力有限。结论:我们的研究结果突出了在HIV-TB护理的外部、内部和个人领域实施TPT的实施决定因素。了解结构性差距、提供者能力和患者信任如何与支持性政策以及同行和大众媒体的影响相互交织,有助于深入了解形成TPT吸收和整合的复杂动态。我们的研究见解可以为政策调整提供信息,并指导更好地将TPT纳入国家卫生框架的战略。
{"title":"Between Process Gaps, Knowledge, and Patient Trust: Healthcare Workers' Insights on Implementing Tuberculosis Preventive Therapy for People with HIV in the Philippines and Indonesia.","authors":"Mark Donald C Reñosa, Prashant Kulkarni, Laura Steiner, Candice Eula Lamigo, Bianca Joyce Sornillo, Ruth Anne Hechanova-Cruz, Anna Maureen Dungca-Lorilla, Aljira Fitya Hapsari, Evy Yunihastuti, Anshari Saifuddin Hasibuan, Mira Yulianti, Rossana A Ditangco, Jonathan E Golub, Christopher J Hoffmann","doi":"10.1186/s43058-025-00776-z","DOIUrl":"10.1186/s43058-025-00776-z","url":null,"abstract":"<p><strong>Background: </strong>Tuberculosis (TB) poses a considerable challenge for people with HIV (PWH), especially in low- and middle-income countries. Even with the availability of effective preventive strategies such as tuberculosis preventive therapy (TPT), the implementation of these measures continues to fall short. Our study explores the perceptions of healthcare workers (HCWs) regarding the barriers and facilitators to TPT implementation in the Philippines and Indonesia.</p><p><strong>Methods: </strong>We performed 10 focus group discussions and four in-depth interviews with HCWs from June to December 2023. Each discussion and interview lasted between 45 and 120 min. Discussions explored HCWs' perspectives on the policies, logistics, and prescribing practices related to TPT, as well as their personal experiences, concerns, and suggested improvements. Data were coded using MAXQDA24 qualitative software informed by the tenets of constructivist grounded theory. We organized themes using the Consolidated Framework for Implementation Research (CFIR), while contextualizing implementation determinants most pertinent to the local contexts.</p><p><strong>Results: </strong>Our findings revealed nuanced barriers and facilitators-marked by paradoxes-organized across three CFIR domains: the outer, inner, and individual domains of HIV-TB care. In the outer setting, barriers include limited patient knowledge and drug shortages, while facilitators involved national policies and external pressures from mass media and peer imitation. The inner setting was shaped by structural gaps-such as poor documentation, staff turnover, and procedural challenges in ruling out active TB-that affected patient trust, whereas open communication and role clarity supported TPT implementation. At the individual level, HCWs expressed high motivation but cited limited capacity due to lack of training and information to deliver effective TPT care.</p><p><strong>Conclusions: </strong>Our findings highlight implementation determinants to TPT implementation across outer, inner, and individual domains of HIV-TB care. Understanding how structural gaps, provider capacity, and patient trust intersect with supportive policies, and peer and mass media influences offer insights into the complex dynamics shaping TPT uptake and integration. Our study insights may inform policy adjustments and guide strategies to better integrate TPT into national health frameworks.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"95"},"PeriodicalIF":3.3,"publicationDate":"2025-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12487036/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145202172","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predictors of skill trajectories in the implementation of cognitive behavioral therapy. 认知行为疗法实施中技能轨迹的预测因子。
IF 3.3 Pub Date : 2025-09-30 DOI: 10.1186/s43058-025-00774-1
Patty B Kuo, Amber Calloway, Max A Halvorson, Torrey A Creed

Background: Evidence based practices such as cognitive behavioral therapy (CBT) are often underutilized in community mental health settings. Implementation efforts can be effective in increasing CBT use among clinicians, but not all therapists successfully reach CBT competence at the end of training. Past studies have focused on how clinicians overall acquire CBT skills, rather than examining different learning trajectories that clinicians may follow and predictors of those trajectories; however, understanding of learning trajectories may suggest targets for implementation strategies.

Methods: We used growth mixture models to identity trajectories in CBT skill acquisition among clinicians (n = 812) participating in a large scale CBT training and implementation program, and examined predictors (attitudes towards EBPs, clinician burnout, professional field, educational degree level) of trajectory membership. We assessed model fit using BIC, Vuong likelihood tests, and entropy. We hypothesized that there would be at least two trajectories- one where clinicians increased in skills over time and reach CBT competence, and one with minimal increases in CBT skills that did not result in competence. We hypothesized that presence of a graduate degree, more positive attitudes towards EBPs, and lower burnout would predict more positive trajectories in CBT skill acquisition. We did not have a specific prediction for field of study and CBT skill acquisition.

Results: Clinicians followed either a progressive trajectory with steady increases in CBT skills over time, or a stagnant trajectory with minimal increases in CBT skills. Clinicians with more positive attitudes towards EBPs were 3.51 times more likely to follow a progressive trajectory, while clinicians who were in an 'Other' professional field were 0.46 times less likely to follow a progressive trajectory. Contrary to our hypotheses, educational degree and clinician burnout did not predict CBT trajectories.

Conclusion: Our results indicate that attitudes towards EBPs can be an important intervention point to improve CBT skill acquisition for therapists in training and implementation efforts. More structured support for clinicians who did not receive training in mental health focused fields may also help improve CBT learning.

背景:基于证据的实践,如认知行为疗法(CBT)在社区精神卫生机构中往往未得到充分利用。实施工作可以有效地增加临床医生对CBT的使用,但并不是所有的治疗师在培训结束时都能成功地达到CBT的能力。过去的研究侧重于临床医生如何整体获得CBT技能,而不是检查临床医生可能遵循的不同学习轨迹和这些轨迹的预测因素;然而,对学习轨迹的理解可以为实施策略提供目标。方法:采用成长混合模型对812名参加大型CBT培训和实施项目的临床医生的CBT技能习得轨迹进行识别,并考察轨迹成员的预测因子(对ebp的态度、临床医生的职业倦怠、专业领域、教育程度)。我们使用BIC、Vuong似然检验和熵来评估模型拟合。我们假设至少有两条轨迹——一条是临床医生的技能随着时间的推移而提高,达到CBT能力;另一条是CBT技能的最低限度提高,但没有达到CBT能力。我们假设研究生学位的存在、对ebp更积极的态度和更低的倦怠可以预测更积极的CBT技能习得轨迹。我们对学习领域和CBT技能习得没有具体的预测。结果:临床医生要么遵循CBT技能随时间稳步增长的进步轨迹,要么遵循CBT技能增长最小的停滞轨迹。对ebp持更积极态度的临床医生有3.51倍的可能性遵循渐进式轨迹,而在“其他”专业领域的临床医生遵循渐进式轨迹的可能性低0.46倍。与我们的假设相反,教育程度和临床医生的职业倦怠不能预测CBT轨迹。结论:我们的研究结果表明,对EBPs的态度可以成为治疗师在培训和实施工作中提高CBT技能习得的重要干预点。对没有接受过心理健康领域培训的临床医生提供更有条理的支持,也可能有助于提高认知行为疗法的学习。
{"title":"Predictors of skill trajectories in the implementation of cognitive behavioral therapy.","authors":"Patty B Kuo, Amber Calloway, Max A Halvorson, Torrey A Creed","doi":"10.1186/s43058-025-00774-1","DOIUrl":"10.1186/s43058-025-00774-1","url":null,"abstract":"<p><strong>Background: </strong>Evidence based practices such as cognitive behavioral therapy (CBT) are often underutilized in community mental health settings. Implementation efforts can be effective in increasing CBT use among clinicians, but not all therapists successfully reach CBT competence at the end of training. Past studies have focused on how clinicians overall acquire CBT skills, rather than examining different learning trajectories that clinicians may follow and predictors of those trajectories; however, understanding of learning trajectories may suggest targets for implementation strategies.</p><p><strong>Methods: </strong>We used growth mixture models to identity trajectories in CBT skill acquisition among clinicians (n = 812) participating in a large scale CBT training and implementation program, and examined predictors (attitudes towards EBPs, clinician burnout, professional field, educational degree level) of trajectory membership. We assessed model fit using BIC, Vuong likelihood tests, and entropy. We hypothesized that there would be at least two trajectories- one where clinicians increased in skills over time and reach CBT competence, and one with minimal increases in CBT skills that did not result in competence. We hypothesized that presence of a graduate degree, more positive attitudes towards EBPs, and lower burnout would predict more positive trajectories in CBT skill acquisition. We did not have a specific prediction for field of study and CBT skill acquisition.</p><p><strong>Results: </strong>Clinicians followed either a progressive trajectory with steady increases in CBT skills over time, or a stagnant trajectory with minimal increases in CBT skills. Clinicians with more positive attitudes towards EBPs were 3.51 times more likely to follow a progressive trajectory, while clinicians who were in an 'Other' professional field were 0.46 times less likely to follow a progressive trajectory. Contrary to our hypotheses, educational degree and clinician burnout did not predict CBT trajectories.</p><p><strong>Conclusion: </strong>Our results indicate that attitudes towards EBPs can be an important intervention point to improve CBT skill acquisition for therapists in training and implementation efforts. More structured support for clinicians who did not receive training in mental health focused fields may also help improve CBT learning.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"94"},"PeriodicalIF":3.3,"publicationDate":"2025-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12487072/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145202202","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrating HIV prevention services into care settings for people with opioid use disorder (OUD): a study protocol for implementation strategy development and modeling. 将艾滋病毒预防服务纳入阿片类药物使用障碍患者的护理环境:实施战略制定和建模的研究方案。
IF 3.3 Pub Date : 2025-09-01 DOI: 10.1186/s43058-025-00782-1
Mofan Gu, Ruben G Martinez, Hannah Parent, Brandon D L Marshall, Justin Berk, A Rani Elwy, Philip A Chan, Jun Tao

Background: The overlapping epidemics of opioid use disorder (OUD) and HIV present a critical public health challenge. Although people with OUD frequently engage with healthcare settings, uptake of HIV prevention services such as pre-exposure prophylaxis (PrEP) remains low. Integrating HIV prevention into routine OUD care could reduce new infections, but scalable, evidence-based strategies are lacking. Rhode Island offers a unique opportunity to design and evaluate such strategies using its robust data infrastructure and high OUD burden.

Methods: We will conduct a three-phase, sequential implementation study. In Aim 1, we will use the Rhode Island All-Payer Claims Database and State Emergency Department Database data to identify healthcare engagement patterns and gaps in HIV prevention service delivery among people with OUD, including rates of HIV screening, PrEP use, and medications for OUD uptake, across settings from 2012 to 2022. In Aim 2, we will convene a series of five stakeholder-engaged evidence-based quality improvement panels-including with providers, policymakers, and people with lived experience-to co-develop implementation strategies tailored to each care setting (i.e., primary care, mental health clinics, emergency department, and opioid use treatment centers). Finally, in Aim 3, we will develop an agent-based model (ABM) to simulate the population-level effect of implementation strategies developed for each care setting (as identified in Aim 2). The ABM will project outcomes such as HIV incidence, cases averted, and number needed to treat (NNT) over 5- and 10-year horizons under various scenarios. Model parameters will be based on literature and findings from Aim 1. Outputs from the ABM will be used to prioritize feasible, high-impact strategies for future real-world implementation.

Discussion: This study addresses critical gaps in HIV prevention for people with OUD by combining claims-based analysis, evidence-based quality improvement, and agent-based modeling. By leveraging real-world data and engaging diverse stakeholders, the study aims to generate actionable strategies tailored to clinical settings. Findings will inform future implementation efforts in Rhode Island and other jurisdictions facing overlapping HIV and opioid epidemics.

Trial registration: This study does not meet the World Health Organization's definition of a clinical trial and, therefore, was not registered.

背景:阿片类药物使用障碍(OUD)和艾滋病毒的重叠流行提出了一个关键的公共卫生挑战。尽管OUD患者经常到医疗机构就诊,但接受艾滋病毒预防服务(如暴露前预防)的人数仍然很低。将艾滋病毒预防纳入常规OUD护理可以减少新感染,但缺乏可扩展的、基于证据的战略。罗德岛州利用其强大的数据基础设施和高OUD负担,为设计和评估此类策略提供了独特的机会。方法:我们将进行一个三期、顺序实施的研究。在目标1中,我们将使用罗德岛州全付款人索赔数据库和州急诊科数据库数据,确定2012年至2022年期间OUD患者在艾滋病毒预防服务提供方面的医疗参与模式和差距,包括艾滋病毒筛查率、PrEP使用率和OUD用药率。在目标2中,我们将召集一系列五个利益相关者参与的循证质量改进小组,包括提供者、政策制定者和有生活经验的人,共同制定针对每个护理环境(即初级保健、精神卫生诊所、急诊科和阿片类药物使用治疗中心)的实施战略。最后,在目标3中,我们将开发一个基于主体的模型(ABM)来模拟为每个护理环境制定的实施策略的人口水平效应(如目标2中所述)。ABM将预测各种情况下5年和10年期间的艾滋病毒发病率、避免的病例和需要治疗的人数等结果。模型参数将基于文献和Aim 1的发现。ABM的产出将用于确定可行的、高影响力战略的优先次序,以便将来在现实世界中实施。讨论:本研究通过结合基于索赔的分析、基于证据的质量改进和基于主体的建模,解决了OUD患者艾滋病预防方面的关键差距。通过利用真实世界的数据和参与不同的利益相关者,该研究旨在产生适合临床环境的可操作策略。调查结果将为罗德岛州和其他面临艾滋病毒和阿片类药物重叠流行的司法管辖区未来的实施工作提供信息。试验注册:本研究不符合世界卫生组织对临床试验的定义,因此未注册。
{"title":"Integrating HIV prevention services into care settings for people with opioid use disorder (OUD): a study protocol for implementation strategy development and modeling.","authors":"Mofan Gu, Ruben G Martinez, Hannah Parent, Brandon D L Marshall, Justin Berk, A Rani Elwy, Philip A Chan, Jun Tao","doi":"10.1186/s43058-025-00782-1","DOIUrl":"10.1186/s43058-025-00782-1","url":null,"abstract":"<p><strong>Background: </strong>The overlapping epidemics of opioid use disorder (OUD) and HIV present a critical public health challenge. Although people with OUD frequently engage with healthcare settings, uptake of HIV prevention services such as pre-exposure prophylaxis (PrEP) remains low. Integrating HIV prevention into routine OUD care could reduce new infections, but scalable, evidence-based strategies are lacking. Rhode Island offers a unique opportunity to design and evaluate such strategies using its robust data infrastructure and high OUD burden.</p><p><strong>Methods: </strong>We will conduct a three-phase, sequential implementation study. In Aim 1, we will use the Rhode Island All-Payer Claims Database and State Emergency Department Database data to identify healthcare engagement patterns and gaps in HIV prevention service delivery among people with OUD, including rates of HIV screening, PrEP use, and medications for OUD uptake, across settings from 2012 to 2022. In Aim 2, we will convene a series of five stakeholder-engaged evidence-based quality improvement panels-including with providers, policymakers, and people with lived experience-to co-develop implementation strategies tailored to each care setting (i.e., primary care, mental health clinics, emergency department, and opioid use treatment centers). Finally, in Aim 3, we will develop an agent-based model (ABM) to simulate the population-level effect of implementation strategies developed for each care setting (as identified in Aim 2). The ABM will project outcomes such as HIV incidence, cases averted, and number needed to treat (NNT) over 5- and 10-year horizons under various scenarios. Model parameters will be based on literature and findings from Aim 1. Outputs from the ABM will be used to prioritize feasible, high-impact strategies for future real-world implementation.</p><p><strong>Discussion: </strong>This study addresses critical gaps in HIV prevention for people with OUD by combining claims-based analysis, evidence-based quality improvement, and agent-based modeling. By leveraging real-world data and engaging diverse stakeholders, the study aims to generate actionable strategies tailored to clinical settings. Findings will inform future implementation efforts in Rhode Island and other jurisdictions facing overlapping HIV and opioid epidemics.</p><p><strong>Trial registration: </strong>This study does not meet the World Health Organization's definition of a clinical trial and, therefore, was not registered.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"93"},"PeriodicalIF":3.3,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12400686/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144981166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Testing a multi-faceted strategy to support the implementation of ACEs screenings in primary care: results of a stepped-wedge pilot trial. 测试支持在初级保健中实施ace筛查的多方面战略:阶梯式试点试验的结果
IF 3.3 Pub Date : 2025-09-01 DOI: 10.1186/s43058-025-00771-4
Mónica Pérez Jolles, Wendy J Mack, Samantha Rubio, Laura J Helmkamp, Lisa Saldana, Gregory A Aarons, Anna S Lau

Background: Adverse Childhood Experiences (ACEs) screenings are increasingly being used in primary care clinics to identify toxic stress and potential trauma in children. ACEs are negative life events (e.g., violence exposure) occurring before age 18, that can increase health risks when unaddressed. However, we lack evidence on the impact of ACEs screenings and how they can be feasibly implemented in community-based clinics. We partnered with federally qualified health clinics to test the impact of a multifaceted implementation strategy on ACEs screening reach and mental health referrals for children ages 0-5.

Methods: We conducted a Hybrid Type 2 pilot trial using a stepped-wedge design (2021-2024). Reach data was measured as the proportion of eligible children screened for ACEs, with data collected from Electronic Health Records. We also assessed the percentage of mental health service referrals among all eligible children. Study clinics (n = 3) switched from no ACEs screenings (control) to implementing ACEs screenings supported by the multi-faceted ACE implementation strategy (intervention). The tested strategy comprised personnel training (e.g., trauma-informed care), integrated technology, team-based screening workflows, and ongoing care team implementation support. Additional clinics (n = 2) implemented ACEs screenings as usual without the strategy and served as additional comparison sites for exploratory analyses. Log-binomial and robust Poisson regression models examined differences in screening reach and referrals and were adjusted for site and patient race.

Results: Screening reach rates increased in the intervention period, from 0.0% of patients screened during control to 11.2% screened during intervention. Mental health service referrals increased from 0.4% at control to 7.2% during the intervention, resulting in a risk difference (95% confidence interval) of 6.9% (6.0%, 7.7%). For both the reach and referral outcomes, risk differences were significantly greater for 18-to-60-month-old patients than for patients under 18-months-old.

Discussion: Healthcare policy efforts promoting ACEs screenings in primary care are commendable. We found that a multi-faceted implementation strategy informed by partners and designed to support ACEs screenings in community-based clinics was feasible. However, its impact was attenuated by policy requirements, clinics' capacity to add ACEs screenings to strained workflows, and multiple impactful outer-context events related and unrelated to the COVID-19 pandemic.

Trial registration: Trial # NCT04916587 registered at clinicaltrials.gov on June 4, 2021, https://clinicaltrials.gov/study/NCT04916587.

背景:不良童年经历(ace)筛查越来越多地被用于初级保健诊所,以确定儿童的毒性应激和潜在创伤。不良经历是指18岁之前发生的负面生活事件(例如,接触暴力),如果不加以处理,可能会增加健康风险。然而,我们缺乏证据表明ace筛查的影响,以及如何在社区诊所实施ace筛查。我们与具有联邦资格的健康诊所合作,测试多方面实施策略对ace筛查覆盖面和0-5岁儿童心理健康转诊的影响。方法:我们采用阶梯楔形设计(2021-2024)进行了混合型2先导试验。Reach数据以筛查ace的合格儿童的比例来衡量,数据收集自电子健康记录。我们还评估了所有符合条件的儿童中心理健康服务转诊的百分比。研究诊所(n = 3)从没有ACE筛查(对照组)转变为在多方面ACE实施策略的支持下实施ACE筛查(干预)。经过测试的策略包括人员培训(例如,创伤知情护理)、综合技术、基于团队的筛查工作流程以及持续的护理团队实施支持。其他诊所(n = 2)像往常一样在没有该策略的情况下进行ace筛查,并作为探索性分析的额外比较点。对数二项和稳健泊松回归模型检验了筛查范围和转诊的差异,并根据地点和患者种族进行了调整。结果:筛查覆盖率在干预期间有所增加,从对照组筛查的0.0%增加到干预期间筛查的11.2%。心理健康服务转诊从对照组的0.4%增加到干预期间的7.2%,导致风险差异(95%置信区间)为6.9%(6.0%,7.7%)。对于可及性和转诊结果,18- 60月龄患者的风险差异明显大于18月龄以下患者。讨论:在初级保健中促进ace筛查的医疗政策是值得赞扬的。我们发现,一个由合作伙伴告知并旨在支持社区诊所ace筛查的多方面实施策略是可行的。然而,政策要求、诊所在紧张的工作流程中增加ace筛查的能力,以及与COVID-19大流行相关和无关的多个有影响的外部事件,削弱了其影响。试验注册:试验# NCT04916587于2021年6月4日在clinicaltrials.gov上注册,网址为https://clinicaltrials.gov/study/NCT04916587。
{"title":"Testing a multi-faceted strategy to support the implementation of ACEs screenings in primary care: results of a stepped-wedge pilot trial.","authors":"Mónica Pérez Jolles, Wendy J Mack, Samantha Rubio, Laura J Helmkamp, Lisa Saldana, Gregory A Aarons, Anna S Lau","doi":"10.1186/s43058-025-00771-4","DOIUrl":"10.1186/s43058-025-00771-4","url":null,"abstract":"<p><strong>Background: </strong>Adverse Childhood Experiences (ACEs) screenings are increasingly being used in primary care clinics to identify toxic stress and potential trauma in children. ACEs are negative life events (e.g., violence exposure) occurring before age 18, that can increase health risks when unaddressed. However, we lack evidence on the impact of ACEs screenings and how they can be feasibly implemented in community-based clinics. We partnered with federally qualified health clinics to test the impact of a multifaceted implementation strategy on ACEs screening reach and mental health referrals for children ages 0-5.</p><p><strong>Methods: </strong>We conducted a Hybrid Type 2 pilot trial using a stepped-wedge design (2021-2024). Reach data was measured as the proportion of eligible children screened for ACEs, with data collected from Electronic Health Records. We also assessed the percentage of mental health service referrals among all eligible children. Study clinics (n = 3) switched from no ACEs screenings (control) to implementing ACEs screenings supported by the multi-faceted ACE implementation strategy (intervention). The tested strategy comprised personnel training (e.g., trauma-informed care), integrated technology, team-based screening workflows, and ongoing care team implementation support. Additional clinics (n = 2) implemented ACEs screenings as usual without the strategy and served as additional comparison sites for exploratory analyses. Log-binomial and robust Poisson regression models examined differences in screening reach and referrals and were adjusted for site and patient race.</p><p><strong>Results: </strong>Screening reach rates increased in the intervention period, from 0.0% of patients screened during control to 11.2% screened during intervention. Mental health service referrals increased from 0.4% at control to 7.2% during the intervention, resulting in a risk difference (95% confidence interval) of 6.9% (6.0%, 7.7%). For both the reach and referral outcomes, risk differences were significantly greater for 18-to-60-month-old patients than for patients under 18-months-old.</p><p><strong>Discussion: </strong>Healthcare policy efforts promoting ACEs screenings in primary care are commendable. We found that a multi-faceted implementation strategy informed by partners and designed to support ACEs screenings in community-based clinics was feasible. However, its impact was attenuated by policy requirements, clinics' capacity to add ACEs screenings to strained workflows, and multiple impactful outer-context events related and unrelated to the COVID-19 pandemic.</p><p><strong>Trial registration: </strong>Trial # NCT04916587 registered at clinicaltrials.gov on June 4, 2021, https://clinicaltrials.gov/study/NCT04916587.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"92"},"PeriodicalIF":3.3,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12400772/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144981226","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Normalizing daily awakening and breathing coordination at 15 heterogenous ICUs: a multicenter post-implementation survey. 15例异质icu患者日常觉醒和呼吸协调正常化:一项多中心实施后调查。
IF 3.3 Pub Date : 2025-08-25 DOI: 10.1186/s43058-025-00770-5
Andrew J Knighton, Jacob Kean, Ithan D Peltan, Dee Lisonbee, Ashley Krueger, Doug Wolfe, Carrie M Winberg, Corey Sillito, Christopher B Jones, Lori Carpenter, Jason R Jacobs, Lindsay Leither, Richard Holubkov, Colin K Grissom, Raj Srivastava

Background: Despite high post-implementation adherence, clinicians may have unresolved questions or concerns regarding use of a protocol to standardize routine daily coordination of the spontaneous awakening trial (SAT) and spontaneous breathing trial (SBT) on ventilated patients. Unresolved questions or concerns may unwittingly curtail practice normalization, impacting practice sustainment when implementation support is withdrawn. The objective of this study was to identify unresolved questions or concerns that may persist following successful implementation of a coordinated SAT/SBT (C-SAT/SBT) protocol.

Methods: We used an attributed, cross-sectional survey of physicians, advanced practice providers, nurses and respiratory therapists likely to have participated in a C-SAT/SBT in 12 hospitals (15 intensive care units) in Utah and Idaho. We evaluated clinician perceptions of acceptability, including ease of use, usefulness and confidence, along with perceived practice normalization, six months post implementation of a protocol to routinize C-SAT/SBT use.

Results: C-SAT/SBT adherence was 83.1% at the 6th month post implementation. 606 clinicians completed the survey (response rate: 50.0%). Perceived individual usefulness, ease of use, and confidence using the C-SAT/SBT protocol were high [range: 72.1%-88.1% agree/strongly agree], though individuals not performing an SAT or SBT in more than six months and respiratory therapists scored lower. Perceived practice normalization was similar with 82.0% aggregate agreement [agree/strongly agree]. However, when stratifying respondents into four categories based upon respondent percentage agreement with all statements, 71% did not agree with at least one practice normalization statement and 27% agreed with less than 80% of statements, varying by role and site. Sets of observable characteristics or phenotypes regarding the degree of practice normalization begin to emerge by subgroup.

Conclusions: Unresolved questions or concerns may persist regarding implementation of a C-SAT/SBT protocol among certain population subgroups despite current high practice adherence and high levels of perceived acceptability, including ease of use, usefulness and confidence. It is not clear what impact these unresolved questions or concerns may have on practice normalization and multi-year practice sustainment systemwide, including whether targeted late post-implementation strategies are needed to mitigate concerns and promote sustainment when implementation support is withdrawn.

背景:尽管实施后依从性很高,但临床医生可能对使用一种规范通气患者自发觉醒试验(SAT)和自发呼吸试验(SBT)日常协调的方案存在未解决的问题或担忧。未解决的问题或关注可能会在不知情的情况下限制实践的规范化,在撤销实施支持时影响实践的维持。本研究的目的是确定在成功实施协调SAT/SBT (C-SAT/SBT)协议后可能持续存在的未解决的问题或关注。方法:我们对犹他州和爱达荷州12家医院(15个重症监护病房)可能参加过C-SAT/SBT的医生、高级执业医师、护士和呼吸治疗师进行了一项分类的横断面调查。我们评估了临床医生对可接受性的看法,包括易用性、有用性和信心,以及在实施C-SAT/SBT常规使用方案六个月后感知到的实践正常化。结果:实施后6个月,C-SAT/SBT依从性为83.1%。606名临床医生完成了调查,有效率为50.0%。使用C-SAT/SBT方案的感知个人有用性、易用性和信心较高[范围:72.1%-88.1%同意/强烈同意],尽管超过6个月未进行SAT或SBT的个体和呼吸治疗师得分较低。感知实践正常化与82.0%的总体同意(同意/强烈同意)相似。然而,当根据受访者同意所有陈述的百分比将受访者分为四类时,71%的人不同意至少一个实践正常化陈述,27%的人同意少于80%的陈述,因角色和地点而异。关于实践规范化程度的一系列可观察特征或表型开始由亚群出现。结论:尽管目前C-SAT/SBT方案在某些人群中具有较高的实践依从性和可接受性,包括易用性、有用性和可信度,但仍存在未解决的问题或担忧。目前尚不清楚这些未解决的问题或关注可能对实践规范化和系统范围内多年的实践维持产生什么影响,包括是否需要有针对性的实施后后期战略来减轻关注并在实施支持撤回时促进维持。
{"title":"Normalizing daily awakening and breathing coordination at 15 heterogenous ICUs: a multicenter post-implementation survey.","authors":"Andrew J Knighton, Jacob Kean, Ithan D Peltan, Dee Lisonbee, Ashley Krueger, Doug Wolfe, Carrie M Winberg, Corey Sillito, Christopher B Jones, Lori Carpenter, Jason R Jacobs, Lindsay Leither, Richard Holubkov, Colin K Grissom, Raj Srivastava","doi":"10.1186/s43058-025-00770-5","DOIUrl":"10.1186/s43058-025-00770-5","url":null,"abstract":"<p><strong>Background: </strong>Despite high post-implementation adherence, clinicians may have unresolved questions or concerns regarding use of a protocol to standardize routine daily coordination of the spontaneous awakening trial (SAT) and spontaneous breathing trial (SBT) on ventilated patients. Unresolved questions or concerns may unwittingly curtail practice normalization, impacting practice sustainment when implementation support is withdrawn. The objective of this study was to identify unresolved questions or concerns that may persist following successful implementation of a coordinated SAT/SBT (C-SAT/SBT) protocol.</p><p><strong>Methods: </strong>We used an attributed, cross-sectional survey of physicians, advanced practice providers, nurses and respiratory therapists likely to have participated in a C-SAT/SBT in 12 hospitals (15 intensive care units) in Utah and Idaho. We evaluated clinician perceptions of acceptability, including ease of use, usefulness and confidence, along with perceived practice normalization, six months post implementation of a protocol to routinize C-SAT/SBT use.</p><p><strong>Results: </strong>C-SAT/SBT adherence was 83.1% at the 6th month post implementation. 606 clinicians completed the survey (response rate: 50.0%). Perceived individual usefulness, ease of use, and confidence using the C-SAT/SBT protocol were high [range: 72.1%-88.1% agree/strongly agree], though individuals not performing an SAT or SBT in more than six months and respiratory therapists scored lower. Perceived practice normalization was similar with 82.0% aggregate agreement [agree/strongly agree]. However, when stratifying respondents into four categories based upon respondent percentage agreement with all statements, 71% did not agree with at least one practice normalization statement and 27% agreed with less than 80% of statements, varying by role and site. Sets of observable characteristics or phenotypes regarding the degree of practice normalization begin to emerge by subgroup.</p><p><strong>Conclusions: </strong>Unresolved questions or concerns may persist regarding implementation of a C-SAT/SBT protocol among certain population subgroups despite current high practice adherence and high levels of perceived acceptability, including ease of use, usefulness and confidence. It is not clear what impact these unresolved questions or concerns may have on practice normalization and multi-year practice sustainment systemwide, including whether targeted late post-implementation strategies are needed to mitigate concerns and promote sustainment when implementation support is withdrawn.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"91"},"PeriodicalIF":3.3,"publicationDate":"2025-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12376443/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144981153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tempering implementation optimism: distinguishing between efficacy and effectiveness in implementation research. 缓和实施乐观主义:在实施研究中区分功效与效果。
IF 3.3 Pub Date : 2025-08-23 DOI: 10.1186/s43058-025-00781-2
Per Nilsen, Jeanette Wassar Kirk, Katarina Ulfsdotter Gunnarsson, Kristin Thomas

Background: The distinction between efficacy (performance under ideal conditions) and effectiveness (performance in real-world settings) is well established in intervention research. Intervention effectiveness is often used as a proxy for implementation readiness. However, relying on this assumption can lead to overly optimistic expectations about real-world outcomes if the complexities of routine practice settings are not adequately considered.

Main body: This paper introduces the distinction between implementation efficacy (implementation strategy performance under controlled or highly supported conditions) and implementation effectiveness (performance under typical, resource-constrained settings). We argue that the efficacy-effectiveness distinction is as critical for implementation research as it is for intervention research. Recognizing and systematically operationalizing this distinction can sharpen conceptual clarity, strengthen research design and enhance the relevance and generalizability of findings for real-world application. Yet despite its importance, this distinction is rarely made explicit in implementation studies. Research often fails to specify the conditions under which implementation strategies are investigated; studies can vary widely in how closely they reflect routine practice. Compounding this issue, economic evaluations remain uncommon in implementation research. However, without systematic assessment of resource use, it is difficult to determine whether reported implementation outcomes have been achieved through contextually feasible strategies or through intensive supports, such as dedicated staffing, external facilitation, or financial incentives, which are rarely available in everyday practice. To address this gap, we propose adapting the PRECIS-2 (Pragmatic Explanatory Continuum Indicator Summary 2) framework from clinical trials into an "Implementation PRECIS" tool. An adapted version of PRECIS-2 for implementation research could offer a systematic way to describe the extent to which a study reflects idealized conditions versus real-world practice.

Conclusion: Clarifying whether implementation strategies are studied under efficacy-like or effectiveness-like conditions enhances research design, interpretation, and communication with stakeholders. It also supports informed decisions about replication and scale-up. By embracing this distinction, implementation research can temper overly optimistic assumptions, better reflect real-world constraints, and contribute more meaningfully to evidence-based practice. We argue that making this distinction explicit is a necessary step toward a more pragmatic and transparent science of implementation.

背景:在干预研究中,疗效(在理想条件下的表现)和有效性(在现实环境中的表现)之间的区别已经得到了很好的证实。干预的有效性通常被用作实施准备程度的代表。然而,如果没有充分考虑常规实践环境的复杂性,依赖这种假设可能会导致对现实世界结果的过度乐观预期。正文:本文介绍了实施效能(受控或高度支持条件下的实施策略绩效)和实施效能(典型的资源受限环境下的绩效)之间的区别。我们认为,效能与效果的区分对于实施研究和干预研究同样重要。认识到这一区别并系统地加以实施,可以提高概念的清晰度,加强研究设计,提高研究结果对现实世界应用的相关性和普遍性。然而,尽管这一区别很重要,但在执行研究中很少明确指出。研究往往不能具体说明调查实施战略的条件;研究结果在反映日常实践的程度上差异很大。使这一问题更加复杂的是,经济评价在执行研究中仍然不常见。然而,如果没有对资源使用情况的系统评估,就很难确定报告的实施结果是通过在具体情况下可行的战略实现的,还是通过专门的人员配置、外部促进或财政激励等密集支持实现的,而这些在日常实践中很少得到。为了解决这一差距,我们建议将临床试验的PRECIS-2(实用解释连续指标摘要2)框架改编为“实施PRECIS”工具。用于实施研究的PRECIS-2的改编版本可以提供一种系统的方法来描述一项研究反映理想化条件与现实世界实践的程度。结论:明确实施策略是在类似功效还是类似有效性的条件下进行研究,可以增强研究设计、解释和与利益相关者的沟通。它还支持关于复制和扩大的明智决策。通过接受这一区别,实施研究可以缓和过于乐观的假设,更好地反映现实世界的约束,并为基于证据的实践做出更有意义的贡献。我们认为,明确这一区别是朝着更加务实和透明的执行科学迈出的必要一步。
{"title":"Tempering implementation optimism: distinguishing between efficacy and effectiveness in implementation research.","authors":"Per Nilsen, Jeanette Wassar Kirk, Katarina Ulfsdotter Gunnarsson, Kristin Thomas","doi":"10.1186/s43058-025-00781-2","DOIUrl":"10.1186/s43058-025-00781-2","url":null,"abstract":"<p><strong>Background: </strong>The distinction between efficacy (performance under ideal conditions) and effectiveness (performance in real-world settings) is well established in intervention research. Intervention effectiveness is often used as a proxy for implementation readiness. However, relying on this assumption can lead to overly optimistic expectations about real-world outcomes if the complexities of routine practice settings are not adequately considered.</p><p><strong>Main body: </strong>This paper introduces the distinction between implementation efficacy (implementation strategy performance under controlled or highly supported conditions) and implementation effectiveness (performance under typical, resource-constrained settings). We argue that the efficacy-effectiveness distinction is as critical for implementation research as it is for intervention research. Recognizing and systematically operationalizing this distinction can sharpen conceptual clarity, strengthen research design and enhance the relevance and generalizability of findings for real-world application. Yet despite its importance, this distinction is rarely made explicit in implementation studies. Research often fails to specify the conditions under which implementation strategies are investigated; studies can vary widely in how closely they reflect routine practice. Compounding this issue, economic evaluations remain uncommon in implementation research. However, without systematic assessment of resource use, it is difficult to determine whether reported implementation outcomes have been achieved through contextually feasible strategies or through intensive supports, such as dedicated staffing, external facilitation, or financial incentives, which are rarely available in everyday practice. To address this gap, we propose adapting the PRECIS-2 (Pragmatic Explanatory Continuum Indicator Summary 2) framework from clinical trials into an \"Implementation PRECIS\" tool. An adapted version of PRECIS-2 for implementation research could offer a systematic way to describe the extent to which a study reflects idealized conditions versus real-world practice.</p><p><strong>Conclusion: </strong>Clarifying whether implementation strategies are studied under efficacy-like or effectiveness-like conditions enhances research design, interpretation, and communication with stakeholders. It also supports informed decisions about replication and scale-up. By embracing this distinction, implementation research can temper overly optimistic assumptions, better reflect real-world constraints, and contribute more meaningfully to evidence-based practice. We argue that making this distinction explicit is a necessary step toward a more pragmatic and transparent science of implementation.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"90"},"PeriodicalIF":3.3,"publicationDate":"2025-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12374263/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144981158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Key determinants in implementation processes: a systematic review using the Consolidated Framework for Implementation Research (CFIR). 实施过程中的关键决定因素:使用实施研究综合框架(CFIR)进行系统审查。
IF 3.3 Pub Date : 2025-08-22 DOI: 10.1186/s43058-025-00712-1
Marin Schmitt, Maren Hawkins, Paul Florsheim

Background: Contextual factors, or determinants, are commonly assessed in implementation studies due to their impact on the implementation process. While a substantial number of determinants have been identified, less research has examined the strength of their impact on the implementation process. Identification of key determinants, or those found to play the biggest role in the implementation process more frequently, may assist in guiding implementation of health programs and services. Damschroder & Lowery (2013) developed a rating system to assess which Consolidated Framework for Implementation Research (CFIR) constructs have the strongest impact on implementation. The purpose of this article was to systematically review articles that have utilized this rating system in order to identify key determinants.

Methods: We conducted forward citation searching of articles citing Damschroder & Lowery's (2013) rating criteria in three databases (PubMed, Web of Science, and Google Scholar) in February 2023. Included articles examined the magnitude and valence of factors affecting the implementation process. Quality appraisal was completed using the Mixed Methods Appraisal Tool (MMAT). Articles were included regardless of design, setting, location, or target population. A comprehensive examination of the determinants through numerous graphs and tables was conducted to identify key determinants.

Results: Forty-eight articles were included in the final review. Eight key determinants were identified: Leadership Engagement, Formally Appointed Internal Implementation Leaders, Compatibility, Available Resources, External Change Agents, Champions, Relative Advantage, and Key Stakeholders.

Conclusions: A more systematic approach to guiding implementation efforts will lead to the development of effective implementation strategies that could ultimately improve implementation outcomes. While quantifying qualitative data inherently removes some important nuance, by identifying key determinants, we hope to help researchers and practitioners identify which factors are likely to facilitate success of their implementation efforts.

Trial registration: The protocol for this systematic review was published with PROSPERO (CRD42023416340).

背景:由于环境因素或决定因素对实施过程的影响,通常在实施研究中进行评估。虽然已经确定了大量决定因素,但审查其对执行进程的影响强度的研究较少。确定关键决定因素,或确定那些在实施过程中发挥最大作用的因素,可能有助于指导卫生规划和服务的实施。Damschroder & Lowery(2013)开发了一个评级系统来评估哪个实施研究综合框架(CFIR)结构对实施的影响最大。本文的目的是系统地审查文章,利用这个评级系统,以确定关键的决定因素。方法:对2023年2月在PubMed、Web of Science和谷歌Scholar三个数据库中引用Damschroder & Lowery(2013)评级标准的文章进行了转发引文检索。所包括的文章审查了影响执行进程的因素的大小和价值。采用混合方法评价工具(MMAT)完成质量评价。无论设计、设置、地点或目标人群如何,文章都被纳入。通过许多图表和表格对决定因素进行了全面检查,以确定关键决定因素。结果:最终纳入48篇文献。确定了八个关键决定因素:领导参与、正式任命的内部实施领导者、兼容性、可用资源、外部变革推动者、冠军、相对优势和关键利益相关者。结论:采用更系统的方法指导实施工作,将有助于制定有效的实施战略,最终改善实施成果。虽然定量定性数据本质上消除了一些重要的细微差别,但通过确定关键决定因素,我们希望帮助研究人员和从业者确定哪些因素可能促进其实施工作的成功。试验注册:该系统评价的方案已在PROSPERO (CRD42023416340)上发表。
{"title":"Key determinants in implementation processes: a systematic review using the Consolidated Framework for Implementation Research (CFIR).","authors":"Marin Schmitt, Maren Hawkins, Paul Florsheim","doi":"10.1186/s43058-025-00712-1","DOIUrl":"10.1186/s43058-025-00712-1","url":null,"abstract":"<p><strong>Background: </strong>Contextual factors, or determinants, are commonly assessed in implementation studies due to their impact on the implementation process. While a substantial number of determinants have been identified, less research has examined the strength of their impact on the implementation process. Identification of key determinants, or those found to play the biggest role in the implementation process more frequently, may assist in guiding implementation of health programs and services. Damschroder & Lowery (2013) developed a rating system to assess which Consolidated Framework for Implementation Research (CFIR) constructs have the strongest impact on implementation. The purpose of this article was to systematically review articles that have utilized this rating system in order to identify key determinants.</p><p><strong>Methods: </strong>We conducted forward citation searching of articles citing Damschroder & Lowery's (2013) rating criteria in three databases (PubMed, Web of Science, and Google Scholar) in February 2023. Included articles examined the magnitude and valence of factors affecting the implementation process. Quality appraisal was completed using the Mixed Methods Appraisal Tool (MMAT). Articles were included regardless of design, setting, location, or target population. A comprehensive examination of the determinants through numerous graphs and tables was conducted to identify key determinants.</p><p><strong>Results: </strong>Forty-eight articles were included in the final review. Eight key determinants were identified: Leadership Engagement, Formally Appointed Internal Implementation Leaders, Compatibility, Available Resources, External Change Agents, Champions, Relative Advantage, and Key Stakeholders.</p><p><strong>Conclusions: </strong>A more systematic approach to guiding implementation efforts will lead to the development of effective implementation strategies that could ultimately improve implementation outcomes. While quantifying qualitative data inherently removes some important nuance, by identifying key determinants, we hope to help researchers and practitioners identify which factors are likely to facilitate success of their implementation efforts.</p><p><strong>Trial registration: </strong>The protocol for this systematic review was published with PROSPERO (CRD42023416340).</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"89"},"PeriodicalIF":3.3,"publicationDate":"2025-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12374266/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144981168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Explaining the Diffusion of Project ECHO. 解释ECHO项目的扩散。
IF 3.3 Pub Date : 2025-08-19 DOI: 10.1186/s43058-025-00778-x
James W Dearing, R Sam Larson

Project Extension for Community Healthcare Outcomes (Project ECHO), a telementoring intervention in which medical specialists share knowledge with medical generalists, has spread to many sites during its 22 years, reaching providers in nearly 200 countries. Based on our familiarity with the ECHO Institute, its practices, and our work with ECHO implementers at many sites, we explain the diffusion of this telehealth intervention in which medical specialists and generalist providers mentor each other in delivering specialty care to patients. We find the diffusion of Project ECHO to be well-accounted for by traditional factors including the perceived attributes of the ECHO model, the status of prominent ECHO adopters, and the inter-organizational environment within which the model arose. We also identify aspects of the ECHO model that have not always figured prominently in studies of diffusion but likely stimulated diffusion in this case. These include charismatic leadership, model elasticity, optional evaluation, and bounded elasticity. The Project ECHO experience can inform the decisions by proponents of other health care innovations to accelerate and broaden diffusion.

社区卫生保健成果项目扩展(ECHO项目)是一项远程监控干预措施,在该干预措施中,医学专家与全科医生分享知识,在其22年中已推广到许多地点,覆盖了近200个国家的提供者。基于我们对ECHO研究所及其实践的熟悉,以及我们在许多地点与ECHO实施者的合作,我们解释了这种远程医疗干预的传播,在这种干预中,医学专家和全科医生相互指导,为患者提供专业护理。我们发现,传统因素可以很好地解释ECHO项目的传播,包括ECHO模型的感知属性、突出的ECHO采用者的地位,以及模型产生的组织间环境。我们还确定了在扩散研究中并不总是突出的ECHO模型方面,但在这种情况下可能刺激了扩散。这些包括魅力型领导、模型弹性、可选评估和有限弹性。ECHO项目的经验可以为其他卫生保健创新的支持者的决策提供参考,以加速和扩大传播。
{"title":"Explaining the Diffusion of Project ECHO.","authors":"James W Dearing, R Sam Larson","doi":"10.1186/s43058-025-00778-x","DOIUrl":"10.1186/s43058-025-00778-x","url":null,"abstract":"<p><p>Project Extension for Community Healthcare Outcomes (Project ECHO), a telementoring intervention in which medical specialists share knowledge with medical generalists, has spread to many sites during its 22 years, reaching providers in nearly 200 countries. Based on our familiarity with the ECHO Institute, its practices, and our work with ECHO implementers at many sites, we explain the diffusion of this telehealth intervention in which medical specialists and generalist providers mentor each other in delivering specialty care to patients. We find the diffusion of Project ECHO to be well-accounted for by traditional factors including the perceived attributes of the ECHO model, the status of prominent ECHO adopters, and the inter-organizational environment within which the model arose. We also identify aspects of the ECHO model that have not always figured prominently in studies of diffusion but likely stimulated diffusion in this case. These include charismatic leadership, model elasticity, optional evaluation, and bounded elasticity. The Project ECHO experience can inform the decisions by proponents of other health care innovations to accelerate and broaden diffusion.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"88"},"PeriodicalIF":3.3,"publicationDate":"2025-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12363020/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144884437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond the surface of capacity building: a mixed-methods study of the core functions and forms of dissemination and implementation science consultations. 超越能力建设的表面:传播和实施科学咨询的核心功能和形式的混合方法研究。
IF 3.3 Pub Date : 2025-08-18 DOI: 10.1186/s43058-025-00775-0
Kera N Swanson, Nicole A Stadnick, Gregory A Aarons, Lauren Brookman-Frazee, Isaac Bouchard, Zeying Du, Anna G Brubaker, Carrie Geremia, Kelli Cain, Lilliana R Conradi, Marisa Sklar, Clare Viglione, Borsika A Rabin

Background: The number of Dissemination and Implementation Science (DIS) capacity building programs is increasing worldwide. These programs aim to enhance diverse DIS skills through a variety of activities. Our team's systematic review of DIS programs determined that DIS consultations were offered across 67% of programs, yet their specific roles in capacity development were not well defined. This mixed methods study aimed to identify and categorize the functions and forms of consultation activities across three DIS capacity building programs at the University of California San Diego that varied in content focus and infrastructure and then to map findings onto DIS competencies.

Methods: Consultation notes from the three programs were extracted for content analysis to identify discussion topics, DIS guidance provided, and resources shared. Generative artificial intelligence (ChatGPT Plus) facilitated content analyses with multiple rounds of validation from program consultants to refine and finalize themes. Themes were categorized into consultation functions and forms. Forms were mapped onto DIS competencies and a gap analysis was conducted to identify areas for improvement. Program metrics were used to further contextualize findings.

Results: A total of 108 consultation notes were analyzed across the three programs. The most common types of support requested related to grant proposals (54%) and ongoing D&I projects (25%). Consultation discussion topics most frequently involved applying implementation science principles (55%) grant development (31%), guidance centered on DIS methods (47%), and study/project design (37%). Consultation guidance was most often aligned with intermediate-level DIS competencies (58%), primarily in the design and analysis and practice-based considerations domains.

Conclusions: These findings highlight the nature of DIS consultation services, particularly among those seeking support for grant proposals and ongoing implementation projects. Consultations primarily addressed intermediate-level competencies within the domains of design, analysis, and practice-based implementation strategies, indicating a clear opportunity to strengthen support for both foundational and advanced skill development. These results suggest the need for scalable consultation frameworks, improved tracking systems, and tiered training resources to optimize the reach and impact of DIS capacity-building efforts.

背景:传播与实施科学(DIS)能力建设项目的数量在世界范围内不断增加。这些项目旨在通过各种活动提高DIS的各种技能。我们的团队对DIS项目的系统回顾确定,67%的项目提供了DIS咨询,但他们在能力发展中的具体作用尚未得到很好的界定。这项混合方法研究旨在识别和分类加州大学圣地亚哥分校三个DIS能力建设项目中咨询活动的功能和形式,这些项目在内容重点和基础设施方面各不相同,然后将研究结果映射到DIS能力上。方法:从三个项目中提取咨询记录进行内容分析,以确定讨论主题、提供的DIS指导和共享的资源。生成式人工智能(ChatGPT Plus)通过项目顾问的多轮验证促进了内容分析,以完善和最终确定主题。主题被划分为协商功能和形式。表格被映射到DIS能力,并进行差距分析,以确定需要改进的领域。程序度量标准被用来进一步将研究结果语境化。结果:三个项目共分析了108份咨询记录。最常见的支持类型与拨款提案(54%)和正在进行的D&I项目(25%)有关。咨询讨论的主题最常涉及应用实施科学原则(55%)、拨款发展(31%)、以DIS方法为中心的指导(47%)和研究/项目设计(37%)。咨询指导通常与中级DIS能力(58%)保持一致,主要是在设计和分析以及基于实践的考虑领域。结论:这些发现突出了DIS咨询服务的性质,特别是那些寻求资助提案和正在进行的实施项目支持的咨询服务。磋商主要涉及设计、分析和基于实践的实施战略领域的中级能力,这表明有明确的机会加强对基础技能和高级技能发展的支持。这些结果表明,需要可扩展的咨询框架、改进的跟踪系统和分层培训资源,以优化DIS能力建设工作的覆盖范围和影响。
{"title":"Beyond the surface of capacity building: a mixed-methods study of the core functions and forms of dissemination and implementation science consultations.","authors":"Kera N Swanson, Nicole A Stadnick, Gregory A Aarons, Lauren Brookman-Frazee, Isaac Bouchard, Zeying Du, Anna G Brubaker, Carrie Geremia, Kelli Cain, Lilliana R Conradi, Marisa Sklar, Clare Viglione, Borsika A Rabin","doi":"10.1186/s43058-025-00775-0","DOIUrl":"10.1186/s43058-025-00775-0","url":null,"abstract":"<p><strong>Background: </strong>The number of Dissemination and Implementation Science (DIS) capacity building programs is increasing worldwide. These programs aim to enhance diverse DIS skills through a variety of activities. Our team's systematic review of DIS programs determined that DIS consultations were offered across 67% of programs, yet their specific roles in capacity development were not well defined. This mixed methods study aimed to identify and categorize the functions and forms of consultation activities across three DIS capacity building programs at the University of California San Diego that varied in content focus and infrastructure and then to map findings onto DIS competencies.</p><p><strong>Methods: </strong>Consultation notes from the three programs were extracted for content analysis to identify discussion topics, DIS guidance provided, and resources shared. Generative artificial intelligence (ChatGPT Plus) facilitated content analyses with multiple rounds of validation from program consultants to refine and finalize themes. Themes were categorized into consultation functions and forms. Forms were mapped onto DIS competencies and a gap analysis was conducted to identify areas for improvement. Program metrics were used to further contextualize findings.</p><p><strong>Results: </strong>A total of 108 consultation notes were analyzed across the three programs. The most common types of support requested related to grant proposals (54%) and ongoing D&I projects (25%). Consultation discussion topics most frequently involved applying implementation science principles (55%) grant development (31%), guidance centered on DIS methods (47%), and study/project design (37%). Consultation guidance was most often aligned with intermediate-level DIS competencies (58%), primarily in the design and analysis and practice-based considerations domains.</p><p><strong>Conclusions: </strong>These findings highlight the nature of DIS consultation services, particularly among those seeking support for grant proposals and ongoing implementation projects. Consultations primarily addressed intermediate-level competencies within the domains of design, analysis, and practice-based implementation strategies, indicating a clear opportunity to strengthen support for both foundational and advanced skill development. These results suggest the need for scalable consultation frameworks, improved tracking systems, and tiered training resources to optimize the reach and impact of DIS capacity-building efforts.</p>","PeriodicalId":73355,"journal":{"name":"Implementation science communications","volume":"6 1","pages":"87"},"PeriodicalIF":3.3,"publicationDate":"2025-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12359906/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144877027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Implementation science communications
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1