Implementation research and practice最新文献

Background: Barriers at the system, clinician, and patient level limit access to medications for opioid use disorder (MOUD). The Advancing Pharmacological Treatments for Opioid Use Disorder (ADaPT-OUD) study implemented an external facilitation strategy within the Veterans Health Administration (VHA) aimed at facility-level barriers to improve uptake of MOUD. During ADaPT-OUD, an independent Academic Detailing Services Opioid Agonist Treatment of OUD Campaign was co-occurring and aimed to increase evidence-based practice for OUD at the clinician level. While both these initiatives aim to increase MOUD reach, they address different barriers and did not intentionally collaborate. Thus, understanding the interaction between these two independent implementation initiatives and their effect on MOUD reach will further inform and mold future implementation efforts of MOUD.

Methods: This was a secondary analysis of the ADaPT-OUD study that included 35 VHA facilities in the lowest quartile of MOUD reach; eight received the ADaPT-OUD external facilitation and 27 matched sites received implementation as usual. The number of academic detailing (AD) visits during ADaPT-OUD was used as a proxy for the intensity of Academic Detailing for OUD Campaign activity. The interaction between external facilitation status and AD intensity was evaluated by comparing the change in facility-level MOUD reach.

Results: There was a general increase in the number of AD visits, in both external facilitation and implementation as usual sites, over the course of ADaPT-OUD's implementation period. A non-statistically significant, positively sloped, linear relationship was observed between average number of AD visits per quarter and change in MOUD reach in facilities also receiving ADaPT-OUD external facilitation that was not observed in the implementation as usual sites.

Conclusion: Co-occurring initiatives focusing on different barriers to MOUD access have the potential to further increase MOUD in low-performing facilities, but further research into timing, quality, and collaboration between initiatives are warranted.

Background: In 2012, Philadelphia's Department of Behavioral Health and Intellectual disAbility Services (DBHIDS) developed an initiative to implement an evidence-based treatment for posttraumatic stress disorder (PTSD), trauma-focused cognitive behavioral therapy (TF-CBT), across the city's behavioral health system. This report evaluates the initiative's 10-year implementation and effectiveness outcomes. Method: The Exploration, Preparation, Implementation, and Sustainment framework guided our implementation evaluation. The implementation outcomes include adoption, reach, and sustainment; these were obtained during regular evaluation data collection from publicly funded behavioral health agencies participating in the TF-CBT initiative. We analyze effectiveness outcomes (i.e., changes in PTSD symptoms) from a subset of patients receiving TF-CBT, which were collected in 6-month intervals by our research team between 2013 and 2021. Results: From 2012 to 2021, DBHIDS trained 478 clinicians in TF-CBT across 20 behavioral health agencies. During this time, 23,401 youths were screened for potentially traumatic events and PTSD symptoms, and 7,550 youths received TF-CBT. Through the TF-CBT initiative, the city expanded the network of TF-CBT providers from 3 to 20 agencies. DBHIDS sustained this network by maintaining the participation of 16 behavioral health agencies over the course of a decade. The subset of 202 youths who were evaluated to assess TF-CBT effectiveness was drawn from 94 therapists and 20 agencies across Philadelphia. All participating youths completed a baseline assessment, and 151 (75%) completed at least one follow-up assessment. Linear mixed-effects models accounting for observations nested within participants and nested within clinicians found that treatment significantly reduced PTSD symptoms. Conclusion: Between 2012 and 2021, DBHIDS successfully implemented and sustained TF-CBT across the city's behavioral health system. Adoption, reach, and sustainment of TF-CBT were high. Despite the considerable adverse experiences faced by youths seeking treatment in Philadelphia's behavioral health system, TF-CBT was effective. Future directions to improve TF-CBT implementation in the next iteration of the initiative are described.

Background: The increase in the number of autistic children being identified has led to increased demand on public schools to provide high-quality services. Effectively scaling up evidence-based practice (EBP) use for autistic students is challenging, given the complicated organization of special education. Teachers have significant challenges implementing autism EBP with fidelity. Factors such as implementation leadership and climate and attitudes toward EBP are linked to successful EBP use and may vary at different levels of the education system. Examining mechanisms of successful implementation is a critical step to support scale-up.

Method: In this observational study, conducted from September 2018 to March 2020, California school personnel (n = 2273) at multiple levels of the system completed surveys related to implementation climate, leadership, and attitudes toward EBP. Data were collected throughout California at the Special Education Local Plan Areas, County Office of Education, and district and school levels from educators and administrators working in public schools supporting autistic students. Multi-level modeling was conducted to characterize implementation readiness.

Results: Overall, implementation climate and leadership scores are low across levels with regional levels rated more positively than districts or schools. Attitudes toward EBP were moderate, with those working in schools having the poorest ratings and specialists/trainers and related service providers (e.g., speech-language pathologists) having the highest ratings.

Conclusions: Outcomes provide a unique opportunity to compare implementation factors across organizational levels with a large, statewide sample. These data provide guidance for developing implementation interventions at multiple levels of the education system to increase readiness for effective scale-up of autism EBP in schools. Personnel and leaders at different organizational levels may need differentiated training targeting improved implementation climate and leadership. Personnel within districts and schools may experience a particular benefit from leadership support for EBP implementation.

Background: Attention is being placed on the "ironic gap" or "secondary" research-to-practice gap in the field of implementation science. Among several challenges posited to exacerbate this research-to-practice gap, we call attention to one challenge in particular-the relative dearth of implementation research that is tethered intimately to the lived experiences of implementation support practitioners (ISPs). The purpose of this study is to feature a qualitative approach to engaging with highly experienced ISPs to inform the development of a practice-driven research agenda in implementation science. In general, we aim to encourage ongoing empirical inquiry that foregrounds practice-driven implementation research questions.

Method: Our analytic sample was comprised of 17 professionals in different child and family service systems, each with long-term experience using implementation science frameworks to support change efforts. Data were collected via in-depth, semi-structured interviews. Our analysis followed a qualitative content analysis approach. Our focal conceptual category centered on the desired areas of future research highlighted by respondents, with subcategories reflecting subsets of related research question ideas.

Results: Interviews yielded varying responses that could help shape a practice-driven research agenda for the field of implementation science. The following subcategories regarding desired areas for future research were identified in respondents' answers: (a) stakeholder engagement and developing trusting relationships, (b) evidence use, (c) workforce development, and (d) cost-effective implementation.

Conclusions: There is significant promise in bringing implementation research and implementation practice together more closely and building a practice-informed research agenda to shape implementation science. Our findings point not only to valuable practice-informed gaps in the literature that could be filled by implementation researchers, but also topics for which dissemination and translation efforts may not have yielded optimal reach. We also highlight the value in ISPs bolstering their own capacity for engaging with the implementation science literature to the fullest extent possible.

Background: Train-the-trainer (TT) implementation strategies (in which designated clinicians are trained to then train others in an intervention) are promising approaches to support mental health clinician use of evidence-based interventions in school contexts. However, there is little evidence to date examining clinicians' perceptions of the acceptability and feasibility of TT strategies, or comparing clinicians' perceptions of different types of TT strategies.

Methods: The current study was conducted as part of a larger hybrid effectiveness-implementation trial, in which school-based therapists and supervisors received one of two different types of implementation support to implement cognitive behavioral therapy (CBT) groups for anxiety: TT (i.e., initial training for therapists and supervisors) or enhanced TT (TT+; i.e., initial training for therapists and supervisors, and ongoing external consultation for supervisors). We used applied thematic analysis to compare qualitative interview transcripts from 28 therapist interviews and 33 supervisor interviews from therapists and supervisors who received TT or TT+ support and report themes that were similar and different across the two groups.

Results: Most themes were similar across the TT and TT+ conditions: therapists and supervisors in both conditions perceived the group anxiety intervention as acceptable and viewed supervision as acceptable, helpful, and feasible. Therapists and supervisors in both conditions had mixed impressions of the contextual appropriateness of the group anxiety intervention, and some reported logistical challenges with weekly supervision. Some unique themes were identified among the TT+ condition, including supervisors experiencing professional growth, and therapists and supervisors perceiving supervision as critically important and enjoyable.

Conclusions: These results suggest that TT implementation support, using a model in which an internal supervisor receives initial training and then provides ongoing supervision, is acceptable and feasible to support a group CBT intervention in schools. The results also highlight additional benefits that therapists and supervisors perceived when supervisors received ongoing consultation.

Clinical trial registration information: The clinical trial from which these data were derived was registered at ClinicalTrials.gov (https://clinicaltrials.gov/) prior to the time of first patient enrollment. The registration number is: NCT02651402.

Background: Evidence-based interventions (EBIs) seldom fit seamlessly into a setting and are often adapted. The literature identifies practitioners' management of fidelity and adaptations as problematic but offers little guidance. This study aimed to investigate practitioners' perceptions of the feasibility and usability of an intervention aimed to support them in fidelity and adaptation management when working with EBIs.

Methods: The intervention, the adaptation and fidelity tool (A-FiT), was developed based on the literature, along with input from social service practitioners and social services' Research and Development units' personnel. The intervention consisted of two workshops where the participants were guided through a five-step process to manage fidelity and adaptations. It was tested in a longitudinal mixed-method intervention study with 103 practitioners from 19 social service units in Stockholm, Sweden. A multimethod data collection was employed, which included interviews at follow-up, questionnaires at baseline and follow-up (readiness for change and self-rated knowledge), workshop evaluation questionnaires (usability and feasibility) after each workshop, and documentation (participants' notes on worksheets). To analyze the data, qualitative content analysis, Kruskal-Wallis tests, and Wilcoxon rank-sum tests were performed.

Results: Overall, the practitioners had a positive perception of the intervention and perceived it as relevant for fidelity and adaptation management (mean ratings over 7.0 on usability and feasibility). The workshops also provided new knowledge and skills to manage fidelity and adaptations. Furthermore, the intervention provided insights into the practitioners' understanding about adaptation and fidelity through a more reflective approach.

Conclusion: Practical tools are needed to guide professionals not only to adhere to intervention core elements but also to help them to manage fidelity and adaptation. The proposed A-FiT intervention for practitioners' management of both fidelity and adaptation is a novel contribution to the implementation literature. Potentially, the next step is an evaluation of the intervention's impact in an experimental design.

Background: Effective teams are essential to high-quality healthcare. However, teams, team-level constructs, and team effectiveness strategies are poorly delineated in implementation science theories, models, and frameworks (TMFs), hindering our understanding of how teams may influence implementation. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework is a flexible and accommodating framework that can facilitate the application of team effectiveness approaches in implementation science.

Main text: We define teams and provide an overview of key constructs in team effectiveness research. We describe ways to conceptualize different types of teams and team constructs relevant to implementation within the EPIS framework. Three case examples illustrate the application of EPIS to implementation studies involving teams. Within each study, we describe the structure of the team and how team constructs influenced implementation processes and outcomes.

Conclusions: Integrating teams and team constructs into the EPIS framework demonstrates how TMFs can be applied to advance our understanding of teams and implementation. Implementation strategies that target team effectiveness may improve implementation outcomes in team-based settings. Incorporation of teams into implementation TMFs is necessary to facilitate application of team effectiveness research in implementation science.

Background: Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods: In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results: Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83-1.02 to 0.62-0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81-27.3 to 0.62-19.50, resulting in an approximate average improvement of 18%.

Conclusions: These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

Trial registration: NCT03013309 ClinicalTrials.gov.

Introduction: In 2020, the COVID-19 pandemic forced many schools to close their doors and transition to remote learning, disrupting how autistic students received school-based services and support. While school structure changes were challenging for all students, autistic students were uniquely affected, considering their reliance on predictability and routine; moreover, education settings are where most autistic children receive services. Much has been studied regarding the use of evidence-based practices (EBPs) for autistic students in traditional school settings, yet little is known about how educators use EBPs in remote learning environments in the wake of the COVID-19 pandemic.

Method: In this study, we explore educators' experiences with EBP implementation at the height of the pandemic and educators' reflections of its impact on autistic students and their school systems. Qualitative data were collected from 81 educators (general educators, special educators, and paraeducators) in semi-structured interviews regarding EBP use at the onset of the pandemic.

Results: Four themes emerged from interviews: (1) pandemic and remote learning environment challenges to inclusion and EBP use; (2) EBP use adaptations for remote learning environments; (3) pandemic and remote learning environment benefits for EBP use; and (4) considerations for EBP use beyond the pandemic.

Conclusion: These findings elucidate educators' experiences using EBPs during the COVID-19 pandemic and highlight important areas of consideration for autism-focused EBP implementation as remote instruction continues to be a learning format. More research is needed to understand how to best implement EBPs for autistic students in this emerging instruction context.

Background: Fidelity measurement is critical for developing, evaluating, and implementing evidence-based treatments (EBTs). However, traditional fidelity measurement tools are often not feasible for community-based settings. We developed a short fidelity rating form for the Collaborative Problem Solving (CPS) approach from an existing manualized coding system that requires extensive training. We examined the reliability and accuracy of this short form when completed by trained observers, untrained observers, and self-reporting providers to evaluate multiple options for reducing barriers to fidelity measurement in community-based settings.

Methods: Community-based treatment providers submitted recordings of youth service sessions in which they did, or did not, use CPS. For 60 recordings, we compared short-form fidelity ratings assigned by trained observers and untrained observers to those provided by trained observers on the manualized coding system. For 141 recordings, we compared providers' self-reported fidelity on the short form to ratings provided by trained observers on the manualized coding system and examined providers' accuracy as a function of their global fidelity.

Results & conclusions: The short form was reliable and accurate for trained observers. An assigned global integrity score and a calculated average of component scores on the short form, but not component scores themselves, were reliable and accurate for observers who had CPS expertise but no specific training on rating CPS fidelity. When providers self-reported fidelity on the short form, their global integrity score was a reliable estimate of their CPS integrity; however, providers with better CPS fidelity were most accurate in their self-reports. We discuss the costs and benefits of these more pragmatic fidelity measurement options in community-based settings.