Implementation research and practice最新文献

Background: Efforts to maximize the impact of healthcare improvement interventions are hampered when intervention components are not well defined or described, precluding the ability to understand how and why interventions are expected to work.

Method: We partnered with two organizations delivering province-wide quality improvement interventions to establish how they envisaged their interventions lead to change (their underlying causal assumptions) and to identify active ingredients (behavior change techniques [BCTs]). The interventions assessed were an audit and feedback report and an academic detailing program. Both focused on supporting safer opioid prescribing in primary care in Ontario, Canada. Data collection involved semi-structured interviews with intervention developers (n = 8) and a content analysis of intervention documents. Analyses unpacked and articulated how the interventions were intended to achieve change and how this was operationalized.

Results: Developers anticipated that the feedback report would provide physicians with a clear understanding of their own prescribing patterns in comparison to others. In the feedback report, we found an emphasis on BCTs consistent with that assumption (feedback on behavior; social comparison). The detailing was designed to provide tailored support to enable physicians to overcome barriers to change and to gradually enact specific practice changes for patients based on improved communication. In the detailing materials, we found an emphasis on instructions on how to perform the behavior, for a range of behaviors (e.g., tapering opioids, treating opioid use disorder). The materials were supplemented by detailer-enacted BCTs (e.g., social support [practical]; goal setting [behavior]; review behavioral goal[s]).

Conclusions: The interventions included a small range of BCTs addressing various clinical behaviors. This work provides a methodological example of how to apply a behavioral lens to surface the active ingredients, target clinical behaviors, and causal assumptions of existing large-scale improvement interventions that could be applied in other contexts to optimize effectiveness and facilitate scale and spread.

Background: Organizational factors may help explain variation in the effectiveness of evidence-based clinical innovations through implementation and sustainment. This study tested the relationship between organizational culture and climate and variation in clinical outcomes of the Collaborative Care Model (CoCM) for treatment of maternal depression implemented in community health centers.

Method: Organizational cultures and climates of 10 community health centers providing CoCM for depression among low-income women pregnant or parenting were assessed using the organizational social context (OSC) measure. Three-level hierarchical linear models tested whether variation in culture and climate predicted variation in improvement in depression symptoms from baseline to 6.5-month post-baseline for N = 468 women with care ±1 year of OSC assessment. Depression symptomology was measured using the Patient Health Questionnaire (PHQ-9).

Results: After controlling for patient characteristics, case mix, center size, and implementation support, patients served by centers with more proficient cultures improved significantly more from baseline to 6.5-month post-baseline than patients in centers with less proficient cultures (mean improvement = 5.08 vs. 0.14, respectively, p = .020), resulting in a large adjusted effect size of d_adj = 0.78. A similar effect was observed for patients served by centers with more functional climates (mean improvement = 5.25 vs. 1.12, p < .044, d_adj = 0.65). Growth models indicated that patients from all centers recovered on average after 4 months of care. However, those with more proficient cultures remained stabilized whereas patients served by centers with less proficient cultures deteriorated by 6.5-month post-baseline. A similar pattern was observed for functional climate.

Conclusions: Variation in clinical outcomes for women from historically underserved populations receiving Collaborative Care for maternal depression was associated with the organizational cultures and climates of community health centers. Implementation strategies targeting culture and climate may improve the implementation and effectiveness of integrated behavioral health care for depression.

Background: Telehealth technologies are now featured more prominently in addiction treatment services than prior to the COVID-19 pandemic, but system barriers should be carefully considered for the successful implementation of innovative remote solutions for medication management and recovery coaching support for people with opioid use disorder (OUD).

Method: The Centers for Disease Control and Prevention funded a telehealth trial prior to the COVID-19 pandemic with a multi-institution team who attempted to implement an innovative protocol during the height of the pandemic in 2020 in Tampa, Florida. The study evaluated the effectiveness of a mobile device application, called MySafeRx, which integrated remote motivational recovery coaching with daily supervised dosing from secure pill dispensers via videoconference, on medication adherence during buprenorphine treatment. This paper provides a participant case example followed by a reflective evaluation of how the pandemic amplified both an existing research-to-practice gap and clinical system barriers during the implementation of telehealth clinical research intervention for patients with OUD.

Findings: Implementation challenges arose from academic institutional requirements, boundaries and role identity, clinical staff burnout and lack of buy-in, rigid clinical protocols, and limited clinical resources, which hampered recruitment and intervention engagement.

Conclusions: As the urgency for feasible and effective telehealth solutions continues to rise in response to the growing numbers of opioid-related deaths, the scientific community may use these lessons learned to re-envision the relationship between intervention implementation and the role of clinical research toward mitigating the opioid overdose epidemic.

Background: This Viewpoint argues for consumers (people with lived experience and their families) to be amplified as key partners in dissemination and implementation science and practice.

Method: We contend that consumer opinion and consumer demand can be harnessed to influence practitioners and policymakers.

Results: Amplifying consumers' voices can improve the fit of evidence-based interventions to the intended end user. We offer recommendations of frameworks to engage consumers in the dissemination and implementation of health interventions. We discuss the primary types of evidence consumers may rely upon, including testimonials and lived experience.

Conclusions: Our intention is for this Viewpoint to continue the momentum in dissemination and implementation science and practice of engaging consumers in our work.

Background: Adherence to intervention training implementation strategies is at the foundation of fidelity; however, few studies have linked training adherence to trainee attitudes and leadership behaviors to identify what practically matters for the adoption and dissemination of evidence-based practices. Through the conduct of this hybrid type 3 effectiveness-implementation cluster randomized controlled trial, we collected Exploration, Preparation, Implementation, and Sustainment (EPIS) data and merged it with tailored motivational interviewing training adherence data, to elucidate the relationship between provider attitudes toward evidence-based practices, leadership behaviors, and training implementation strategy (e.g., workshop attendance and participation in one-on-one coaching) adherence.

Method: Our sample included data from providers who completed baseline (pre-intervention) surveys that captured inner and outer contexts affecting implementation and participated in tailored motivational interviewing training, producing a dataset that included training implementation strategies adherence and barriers and facilitators to implementation (N = 77). Leadership was assessed by two scales: the director leadership scale and implementation leadership scale. Attitudes were measured with the evidence-based practice attitude scale (EBPAS-50). Adherence to training implementation strategies was modeled as a continuous outcome with a Gaussian distribution. Analyses were conducted in SPSS.

Results: Of the nine general attitudes toward evidence-based practice, openness was associated with training adherence (estimate [EST] = 0.096, p < .001; 95% CI = [0.040, 0.151]). Provider general (EST = 0.054, 95% CI = [0.007, 0.102]) and motivational interviewing-specific (EST = 0.044, 95% CI = [0.002, 0.086]) leadership behaviors were positively associated with training adherence (p < .05). Of the four motivational interviewing-specific leadership domains, knowledge and perseverant were associated with training adherence (p < .05). As these leadership behaviors increased, knowledge (EST = 0.042, 95% CI = [0.001, 0.083]) and perseverant (EST = 0.039, 95% CI = [0.004, 0.075]), so did provider adherence to training implementation strategies.

Conclusions: As implementation science places more emphasis on assessing readiness prior to delivering evidence-based practices by evaluating organizational climate, funding streams, and change culture, consideration should also be given to metrics of leadership. A potential mechanism to overcome resistance is via the implementation of training strategies focused on addressing leadership prior to conducting training for the evidence-based practice of interest.

Background: Increased HIV testing is essential to ending the HIV epidemic. People who inject drugs (PWID) are among the highest risk for HIV infection. Previous research at Tufts Medical Center identified low HIV testing rates in hospitalized PWID. Our research team aimed to identify and overcome barriers to inpatient HIV screening of PWID using implementation science methods.

Methods: Stakeholders were engaged to gather perspectives on barriers and facilitators of HIV testing. A PWID care bundle was developed and implemented, which included (1) HIV screening; (2) hepatitis A, B, and C testing and vaccination; (3) medications for opioid use disorder; and (4) naloxone prescription. Strategies from all nine Expert Recommendations for Implementing Change (ERIC) clusters guided the implementation plan. Stakeholder feedback was gathered throughout implementation, and implementation outcomes of acceptability and feasibility were assessed.

Results: PWID overall felt comfortable with HIV testing being offered while hospitalized. Clinicians cited that the main barriers to HIV testing were discomfort and confusion around consenting requirements. Many resident physicians surveyed reported that, at times, they forgot HIV testing for PWID. Overall, though, resident physicians felt that the PWID bundle was useful and did not distract from other patient care responsibilities.

Conclusions: Engagement of key stakeholders to increase HIV testing in an inpatient setting led to the implementation of a PWID bundle, which was feasible and acceptable. Bundling evidence-informed care elements for inpatient PWID should be investigated further.

Background: Dissemination and implementation frameworks provide the scaffolding to explore the effectiveness of evidence-based practices (EBPs) targeting process of care and organizational outcomes. Few instruments, like the stages of implementation completion (SIC) examine implementation fidelity to EBP adoption and how organizations differ in their approach to implementation. Instruments to measure organizational competency in the utilization of implementation strategies are lacking.

Method: An iterative process was utilized to adapt the SIC to the NIATx implementation strategies. The new instrument, NIATx-SIC, was applied in a randomized controlled trial involving 53 addiction treatment agencies in Washington state to improve agency co-occurring capacity. NIATx-SIC data were reported by state staff and external facilitators and through participating agency documentation. Proportion and duration scores for each stage and phase of the NIATx-SIC were calculated for each agency. Competency was assessed using the NIATx fidelity tool. Comparisons of proportion, duration, and NIATx activities completed were determined using independent sample t-tests by agency competency level.

Results: The NIATx-SIC distinguished between agencies achieving competency (n  =  23) and those not achieving competency (n  =  26). Agencies achieving competency completed a greater proportion of implementation phase activities and had a significantly longer Stage 7 duration. These agencies participated in significantly more individual and group coaching calls, attended more in-person meetings, implemented more change projects, and spent approximately 64 more days, on average, engaging in all NIATx activities.

Conclusions: Organizational participation in dissemination and implementation research requires a significant investment of staff resources. The inability of an organization to achieve competency when utilizing a set of implementation strategies waste an opportunity to institutionalize knowledge of how to apply implementation strategies to future change efforts. The NIATx-SIC provides evidence that competency is not an attribute of the organization but rather a result of the application of the NIATx implementation strategies to improve agency co-occurring capacity.

Trial registration: ClinicalTrials.gov, NCT03007940. Registered January 2, 2017, https://clinicaltrials.gov/ct2/show/NCT03007940.

Background: Barriers at the system, clinician, and patient level limit access to medications for opioid use disorder (MOUD). The Advancing Pharmacological Treatments for Opioid Use Disorder (ADaPT-OUD) study implemented an external facilitation strategy within the Veterans Health Administration (VHA) aimed at facility-level barriers to improve uptake of MOUD. During ADaPT-OUD, an independent Academic Detailing Services Opioid Agonist Treatment of OUD Campaign was co-occurring and aimed to increase evidence-based practice for OUD at the clinician level. While both these initiatives aim to increase MOUD reach, they address different barriers and did not intentionally collaborate. Thus, understanding the interaction between these two independent implementation initiatives and their effect on MOUD reach will further inform and mold future implementation efforts of MOUD.

Methods: This was a secondary analysis of the ADaPT-OUD study that included 35 VHA facilities in the lowest quartile of MOUD reach; eight received the ADaPT-OUD external facilitation and 27 matched sites received implementation as usual. The number of academic detailing (AD) visits during ADaPT-OUD was used as a proxy for the intensity of Academic Detailing for OUD Campaign activity. The interaction between external facilitation status and AD intensity was evaluated by comparing the change in facility-level MOUD reach.

Results: There was a general increase in the number of AD visits, in both external facilitation and implementation as usual sites, over the course of ADaPT-OUD's implementation period. A non-statistically significant, positively sloped, linear relationship was observed between average number of AD visits per quarter and change in MOUD reach in facilities also receiving ADaPT-OUD external facilitation that was not observed in the implementation as usual sites.

Conclusion: Co-occurring initiatives focusing on different barriers to MOUD access have the potential to further increase MOUD in low-performing facilities, but further research into timing, quality, and collaboration between initiatives are warranted.

Background: In 2012, Philadelphia's Department of Behavioral Health and Intellectual disAbility Services (DBHIDS) developed an initiative to implement an evidence-based treatment for posttraumatic stress disorder (PTSD), trauma-focused cognitive behavioral therapy (TF-CBT), across the city's behavioral health system. This report evaluates the initiative's 10-year implementation and effectiveness outcomes. Method: The Exploration, Preparation, Implementation, and Sustainment framework guided our implementation evaluation. The implementation outcomes include adoption, reach, and sustainment; these were obtained during regular evaluation data collection from publicly funded behavioral health agencies participating in the TF-CBT initiative. We analyze effectiveness outcomes (i.e., changes in PTSD symptoms) from a subset of patients receiving TF-CBT, which were collected in 6-month intervals by our research team between 2013 and 2021. Results: From 2012 to 2021, DBHIDS trained 478 clinicians in TF-CBT across 20 behavioral health agencies. During this time, 23,401 youths were screened for potentially traumatic events and PTSD symptoms, and 7,550 youths received TF-CBT. Through the TF-CBT initiative, the city expanded the network of TF-CBT providers from 3 to 20 agencies. DBHIDS sustained this network by maintaining the participation of 16 behavioral health agencies over the course of a decade. The subset of 202 youths who were evaluated to assess TF-CBT effectiveness was drawn from 94 therapists and 20 agencies across Philadelphia. All participating youths completed a baseline assessment, and 151 (75%) completed at least one follow-up assessment. Linear mixed-effects models accounting for observations nested within participants and nested within clinicians found that treatment significantly reduced PTSD symptoms. Conclusion: Between 2012 and 2021, DBHIDS successfully implemented and sustained TF-CBT across the city's behavioral health system. Adoption, reach, and sustainment of TF-CBT were high. Despite the considerable adverse experiences faced by youths seeking treatment in Philadelphia's behavioral health system, TF-CBT was effective. Future directions to improve TF-CBT implementation in the next iteration of the initiative are described.

Background: The increase in the number of autistic children being identified has led to increased demand on public schools to provide high-quality services. Effectively scaling up evidence-based practice (EBP) use for autistic students is challenging, given the complicated organization of special education. Teachers have significant challenges implementing autism EBP with fidelity. Factors such as implementation leadership and climate and attitudes toward EBP are linked to successful EBP use and may vary at different levels of the education system. Examining mechanisms of successful implementation is a critical step to support scale-up.

Method: In this observational study, conducted from September 2018 to March 2020, California school personnel (n = 2273) at multiple levels of the system completed surveys related to implementation climate, leadership, and attitudes toward EBP. Data were collected throughout California at the Special Education Local Plan Areas, County Office of Education, and district and school levels from educators and administrators working in public schools supporting autistic students. Multi-level modeling was conducted to characterize implementation readiness.

Results: Overall, implementation climate and leadership scores are low across levels with regional levels rated more positively than districts or schools. Attitudes toward EBP were moderate, with those working in schools having the poorest ratings and specialists/trainers and related service providers (e.g., speech-language pathologists) having the highest ratings.

Conclusions: Outcomes provide a unique opportunity to compare implementation factors across organizational levels with a large, statewide sample. These data provide guidance for developing implementation interventions at multiple levels of the education system to increase readiness for effective scale-up of autism EBP in schools. Personnel and leaders at different organizational levels may need differentiated training targeting improved implementation climate and leadership. Personnel within districts and schools may experience a particular benefit from leadership support for EBP implementation.