Implementation research and practice最新文献

Background: Attention is being placed on the "ironic gap" or "secondary" research-to-practice gap in the field of implementation science. Among several challenges posited to exacerbate this research-to-practice gap, we call attention to one challenge in particular-the relative dearth of implementation research that is tethered intimately to the lived experiences of implementation support practitioners (ISPs). The purpose of this study is to feature a qualitative approach to engaging with highly experienced ISPs to inform the development of a practice-driven research agenda in implementation science. In general, we aim to encourage ongoing empirical inquiry that foregrounds practice-driven implementation research questions.

Method: Our analytic sample was comprised of 17 professionals in different child and family service systems, each with long-term experience using implementation science frameworks to support change efforts. Data were collected via in-depth, semi-structured interviews. Our analysis followed a qualitative content analysis approach. Our focal conceptual category centered on the desired areas of future research highlighted by respondents, with subcategories reflecting subsets of related research question ideas.

Results: Interviews yielded varying responses that could help shape a practice-driven research agenda for the field of implementation science. The following subcategories regarding desired areas for future research were identified in respondents' answers: (a) stakeholder engagement and developing trusting relationships, (b) evidence use, (c) workforce development, and (d) cost-effective implementation.

Conclusions: There is significant promise in bringing implementation research and implementation practice together more closely and building a practice-informed research agenda to shape implementation science. Our findings point not only to valuable practice-informed gaps in the literature that could be filled by implementation researchers, but also topics for which dissemination and translation efforts may not have yielded optimal reach. We also highlight the value in ISPs bolstering their own capacity for engaging with the implementation science literature to the fullest extent possible.

Background: Train-the-trainer (TT) implementation strategies (in which designated clinicians are trained to then train others in an intervention) are promising approaches to support mental health clinician use of evidence-based interventions in school contexts. However, there is little evidence to date examining clinicians' perceptions of the acceptability and feasibility of TT strategies, or comparing clinicians' perceptions of different types of TT strategies.

Methods: The current study was conducted as part of a larger hybrid effectiveness-implementation trial, in which school-based therapists and supervisors received one of two different types of implementation support to implement cognitive behavioral therapy (CBT) groups for anxiety: TT (i.e., initial training for therapists and supervisors) or enhanced TT (TT+; i.e., initial training for therapists and supervisors, and ongoing external consultation for supervisors). We used applied thematic analysis to compare qualitative interview transcripts from 28 therapist interviews and 33 supervisor interviews from therapists and supervisors who received TT or TT+ support and report themes that were similar and different across the two groups.

Results: Most themes were similar across the TT and TT+ conditions: therapists and supervisors in both conditions perceived the group anxiety intervention as acceptable and viewed supervision as acceptable, helpful, and feasible. Therapists and supervisors in both conditions had mixed impressions of the contextual appropriateness of the group anxiety intervention, and some reported logistical challenges with weekly supervision. Some unique themes were identified among the TT+ condition, including supervisors experiencing professional growth, and therapists and supervisors perceiving supervision as critically important and enjoyable.

Conclusions: These results suggest that TT implementation support, using a model in which an internal supervisor receives initial training and then provides ongoing supervision, is acceptable and feasible to support a group CBT intervention in schools. The results also highlight additional benefits that therapists and supervisors perceived when supervisors received ongoing consultation.

Clinical trial registration information: The clinical trial from which these data were derived was registered at ClinicalTrials.gov (https://clinicaltrials.gov/) prior to the time of first patient enrollment. The registration number is: NCT02651402.

Background: Evidence-based interventions (EBIs) seldom fit seamlessly into a setting and are often adapted. The literature identifies practitioners' management of fidelity and adaptations as problematic but offers little guidance. This study aimed to investigate practitioners' perceptions of the feasibility and usability of an intervention aimed to support them in fidelity and adaptation management when working with EBIs.

Methods: The intervention, the adaptation and fidelity tool (A-FiT), was developed based on the literature, along with input from social service practitioners and social services' Research and Development units' personnel. The intervention consisted of two workshops where the participants were guided through a five-step process to manage fidelity and adaptations. It was tested in a longitudinal mixed-method intervention study with 103 practitioners from 19 social service units in Stockholm, Sweden. A multimethod data collection was employed, which included interviews at follow-up, questionnaires at baseline and follow-up (readiness for change and self-rated knowledge), workshop evaluation questionnaires (usability and feasibility) after each workshop, and documentation (participants' notes on worksheets). To analyze the data, qualitative content analysis, Kruskal-Wallis tests, and Wilcoxon rank-sum tests were performed.

Results: Overall, the practitioners had a positive perception of the intervention and perceived it as relevant for fidelity and adaptation management (mean ratings over 7.0 on usability and feasibility). The workshops also provided new knowledge and skills to manage fidelity and adaptations. Furthermore, the intervention provided insights into the practitioners' understanding about adaptation and fidelity through a more reflective approach.

Conclusion: Practical tools are needed to guide professionals not only to adhere to intervention core elements but also to help them to manage fidelity and adaptation. The proposed A-FiT intervention for practitioners' management of both fidelity and adaptation is a novel contribution to the implementation literature. Potentially, the next step is an evaluation of the intervention's impact in an experimental design.

Background: Effective teams are essential to high-quality healthcare. However, teams, team-level constructs, and team effectiveness strategies are poorly delineated in implementation science theories, models, and frameworks (TMFs), hindering our understanding of how teams may influence implementation. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework is a flexible and accommodating framework that can facilitate the application of team effectiveness approaches in implementation science.

Main text: We define teams and provide an overview of key constructs in team effectiveness research. We describe ways to conceptualize different types of teams and team constructs relevant to implementation within the EPIS framework. Three case examples illustrate the application of EPIS to implementation studies involving teams. Within each study, we describe the structure of the team and how team constructs influenced implementation processes and outcomes.

Conclusions: Integrating teams and team constructs into the EPIS framework demonstrates how TMFs can be applied to advance our understanding of teams and implementation. Implementation strategies that target team effectiveness may improve implementation outcomes in team-based settings. Incorporation of teams into implementation TMFs is necessary to facilitate application of team effectiveness research in implementation science.

Background: Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods: In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results: Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83-1.02 to 0.62-0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81-27.3 to 0.62-19.50, resulting in an approximate average improvement of 18%.

Conclusions: These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

Trial registration: NCT03013309 ClinicalTrials.gov.

Introduction: In 2020, the COVID-19 pandemic forced many schools to close their doors and transition to remote learning, disrupting how autistic students received school-based services and support. While school structure changes were challenging for all students, autistic students were uniquely affected, considering their reliance on predictability and routine; moreover, education settings are where most autistic children receive services. Much has been studied regarding the use of evidence-based practices (EBPs) for autistic students in traditional school settings, yet little is known about how educators use EBPs in remote learning environments in the wake of the COVID-19 pandemic.

Method: In this study, we explore educators' experiences with EBP implementation at the height of the pandemic and educators' reflections of its impact on autistic students and their school systems. Qualitative data were collected from 81 educators (general educators, special educators, and paraeducators) in semi-structured interviews regarding EBP use at the onset of the pandemic.

Results: Four themes emerged from interviews: (1) pandemic and remote learning environment challenges to inclusion and EBP use; (2) EBP use adaptations for remote learning environments; (3) pandemic and remote learning environment benefits for EBP use; and (4) considerations for EBP use beyond the pandemic.

Conclusion: These findings elucidate educators' experiences using EBPs during the COVID-19 pandemic and highlight important areas of consideration for autism-focused EBP implementation as remote instruction continues to be a learning format. More research is needed to understand how to best implement EBPs for autistic students in this emerging instruction context.

Background: Fidelity measurement is critical for developing, evaluating, and implementing evidence-based treatments (EBTs). However, traditional fidelity measurement tools are often not feasible for community-based settings. We developed a short fidelity rating form for the Collaborative Problem Solving (CPS) approach from an existing manualized coding system that requires extensive training. We examined the reliability and accuracy of this short form when completed by trained observers, untrained observers, and self-reporting providers to evaluate multiple options for reducing barriers to fidelity measurement in community-based settings.

Methods: Community-based treatment providers submitted recordings of youth service sessions in which they did, or did not, use CPS. For 60 recordings, we compared short-form fidelity ratings assigned by trained observers and untrained observers to those provided by trained observers on the manualized coding system. For 141 recordings, we compared providers' self-reported fidelity on the short form to ratings provided by trained observers on the manualized coding system and examined providers' accuracy as a function of their global fidelity.

Results & conclusions: The short form was reliable and accurate for trained observers. An assigned global integrity score and a calculated average of component scores on the short form, but not component scores themselves, were reliable and accurate for observers who had CPS expertise but no specific training on rating CPS fidelity. When providers self-reported fidelity on the short form, their global integrity score was a reliable estimate of their CPS integrity; however, providers with better CPS fidelity were most accurate in their self-reports. We discuss the costs and benefits of these more pragmatic fidelity measurement options in community-based settings.

Background: Audience segmentation is an analysis technique that can identify meaningful subgroups within a population to inform the tailoring of dissemination strategies. We have conducted an empirical clustering audience segmentation study of licensed psychologists using survey data about the sources of knowledge they report most often consulting to guide their clinical decision-making. We identify meaningful subgroups within the population and inform the tailoring of dissemination strategies for evidence-based practice (EBP) materials.

Method: Data come from a 2018-2019 web-based survey of licensed psychologists who were members of the American Psychological Association (APA; N = 518, response rate = 29.8%). Ten dichotomous variables assessed sources that psychologists regularly consult to inform clinical decision-making (e.g., colleagues, academic literature, and practice guidelines). We used latent class analysis to identify segments of psychologists who turn to similar sources and named each segment based on the segment's most salient characteristics.

Results: Four audience segments were identified: the No-guidelines (45% of psychologists), Research-driven (16%), Thirsty-for-knowledge (9%), and No-reviews (30%). The four segments differed not only in their preferred sources of knowledge, but also in the types of evidence-based posttraumatic stress disorder (PTSD) treatments they provide, their awareness and usage intention of the APA PTSD clinical practice guideline, and attitudes toward clinical practice guidelines.

Conclusion: The results demonstrate that licensed psychologists are heterogeneous in terms of their knowledge-seeking behaviors and preferences for knowledge sources. The distinctive characteristics of these segments could guide the tailoring of dissemination materials and strategies to subsequently enhance the implementation of EBP among psychologists.

Background: Cancer patients who receive evidence-based tobacco-dependence treatment are more likely to quit and remain abstinent, but tobacco treatment programs (TTPs) are not consistently offered. In 2017, the U.S. National Cancer Institute, through the Cancer Moonshot, funded the Cancer Center Cessation Initiative (C3I). C3I supports 52 cancer centers to implement and expand evidence-based tobacco treatment in routine oncology care. Integration into routine care involves the use of health information technology (IT), including modifying electronic health records and clinical workflows. Here, we examine C3I cancer centers' IT leadership involvement and experiences in tobacco-dependence treatment implementation.

Method: This qualitative study of C3I-funded cancer centers integrated data from online surveys and in-person, semistructured interviews with IT leaders. We calculated descriptive statistics of survey data and applied content analysis to interview transcripts.

Results: Themes regarding IT personnel included suggestions to involve IT early, communicate regularly, understand the roles and influence of the IT team, and match program design with IT funding and resources. Themes regarding electronic health record (EHR) modifications included beginning modifications early to account for long lead time to make changes, working with IT to identify and adapt existing EHR tools for TTP or designing tools that will support a desired workflow developed with end-users, and working with IT personnel to make sure TTPs comply with system and state policies (e.g., privacy laws).

Conclusions: The experiences of C3I cancer centers regarding the use of health IT to enhance tobacco-dependence treatment program implementation can guide cancer centers and community oncology practices to potentially enhance TTP implementation and patient outcomes.