Background: Relationships are foundational to successful implementation of innovations in healthcare. In genomic medicine, multidisciplinary teams with good communication are most effective to provide safe genomic care; however, working together could be challenging due to the distinct work culture, worldviews, and clinical approaches held by different professional groups. In this paper, we explored the various strategies used to build relationships and foster collaboration as part of a Change program that supported the use of genomic testing and counselling in specialty areas.
Methods: Qualitative interviews were conducted with 36 participants across 3 professional categories (genetic counsellors, medical specialists, and nurses/allied health workers) to ask about their experiences working together in innovative models of genomic care across 7 clinical specialties. Data analysis was conducted through a two-staged inductive and deductive coding process: firstly to identify the categories based on the attributes of the Relational Theory and then coded against the Theoretical Model for Trusting Relationships and Implementation (the 'Model').
Results: Eight out of nine strategies to build/strengthen relationships described in the 'Model' were identified in the interview data. They included three technical strategies and five relational strategies. The inter-connections were present between relational and technical strategies, as well as within the relational category, whereby some served to reinforce one another. Two additional strategies emerged from the interview data but were not included within the 'Model,' including: negotiating boundary work and accepting differences used at inter-professional level. Specifically, genetic counsellors either reconstructed the professional boundary by taking over tasks beyond their role or adopted a boundary-preserving strategy to balance the social order within the team.
Conclusions: Our study highlights how relationship-building strategies can be leveraged in genomic multidisciplinary teams and can inform decisions about creating conditions that promote positive relationships and relational competence, ultimately leading to successful implementation of innovations into organisations/systems.
Background: The Normalization Process Theory (NPT) is increasingly used for evaluating and understanding implementation processes of complex care interventions. One key tool for applying the NPT in research and practice is the NoMAD questionnaire, which offers a structured approach to examination of the four constructs that according to the NPT are central in implementation and normalisation processes. We aimed to evaluate the psychometric properties of the Swedish version S-NoMAD.
Methods: Secondary analysis was performed on pooled S-NoMAD survey data from six implementation studies in different health and social care contexts. The NPT factor structure was tested by confirmatory factor analysis (CFA). Internal construct reliability was tested using Cronbach's alpha. Validity was confirmed by assessing the fit of the CFA using the fit measures Comparative Fit Index, Tucker-Lewis Index, root mean square error of approximation and standardised root mean square residual. Pearson correlations amongst the latent construct and general questions about the intervention were calculated.
Results: The estimation results of the CFA indicate that the four-factor model implied by the NPT fits the data reasonably well. The factor loadings are of good sizes and the fit indices do not imply a mis-specified model. A good internal construct validity, indicated by a good model fit to the NPT four-construct model and acceptable to good internal reliability, was shown. External validity was also demonstrated.
Conclusions: The CFA results indicate that the S-NoMAD has good psychometric properties for capturing perceptions of people involved in various Swedish implementation studies conducted in both health and social care contexts, demonstrating its general applicability. They show that the S-NoMAD, unlike the majority of instruments for evaluation of implementation processes, is not context- and intervention-specific. The findings highlight the utility of the S-NoMAD and show that it meets some important criteria for pragmatic measures. Further studies are warranted on different interventions implemented in diverse contexts regarding the meaning of the magnitude of the NoMAD scores in order to clarify its potential value as a tool for assessment of implementation strategies and on psychometric properties beyond construct validity and internal construct reliability, for example on test-retest reliability and longitudinal studies focusing on responsiveness.
Background: According to phasic models of implementation, a Preparation phase designed to enhance the implementation climate should be completed prior to the Implementation phase. Yet preparatory activities and outcomes are rarely reported or assessed in implementation research. Project MIMIC (Maximizing Implementation of Motivational Incentives in Clinics) was a hybrid type 3 effectiveness-implementation trial that compared two multi-component, phasic strategies to implement contingency management (CM) in opioid treatment programs. The current secondary analysis assessed the comparative effectiveness of the two strategies on 5-month Preparation phase outcomes: attainment of knowledge and fidelity benchmarks, implementation climate at the end of the Preparation phase, and time required for providers to complete the final preparatory/pre-implementation activity of enrolling and scheduling their first CM patient.
Methods: Twenty-eight opioid treatment programs and 186 staff were cluster-randomized to receive the Addition Technology Transfer Center (ATTC) control strategy (didactic workshop + performance feedback + consultation) or the theory-driven Enhanced-ATTC (E-ATTC) experimental strategy. During the Preparation phase, the E-ATTC strategy consisted of the ATTC strategy plus monthly Implementation Sustainment Facilitation sessions rooted in principles of team-based motivational interviewing to cultivate a strong implementation climate and accelerate successful completion of the Preparation phase.
Results: Across the 28 OTPs and 186 staff, attainment of knowledge and fidelity benchmarks favored the E-ATTC but did not differ significantly by condition. Implementation climate ratings after the Preparation phase were high in both conditions with no conditional differences. Providers randomized to E-ATTC completed their final preparatory activity at significantly higher rates than those randomized to ATTC. Cox regression revealed that receipt of the E-ATTC strategy was also associated with significantly faster completion of the final Preparation activity.
Conclusions: Consistent with hypotheses, the theory-driven implementation strategy was associated with higher levels of and faster time to completion of preparatory activities, a key indicator of readiness for implementation. Counter to expectations, this was not driven by differences in implementation climate. High ratings of implementation climate at baseline limited our ability to detect change over time, highlighting a need for alternate strategies to measure putative mechanisms of change. This analysis adds to the scant literature reporting Preparation phase strategies and outcomes, which are strong predictors of successful implementation.
Trial registration: This study is registered in Clinicaltrials.gov (NCT03931174).
Background: Assessing implementation fidelity-the degree to which a program is implemented as intended-is essential to understand whether poor outcomes are due to implementation problems or the design of an intervention. Few studies in health research have documented the association between implementation fidelity and effectiveness. The Integrated District Evidence-to-Action (IDEAs) is a multicomponent audit and feedback strategy designed to improve the implementation of maternal and child clinical guidelines in Mozambique. In a previous study, we found mixed results of IDEAs effectiveness. The objective of the present study is to understand how implementation fidelity may have influenced the effectiveness of the strategy.
Methods: IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces in Mozambique between 2016 and 2020. We used the conceptual framework for implementation fidelity to guide descriptive analysis of IDEAs adherence. Regression modeling was used to study patterns of the direction of association between measures of fidelity and effectiveness for ten service delivery outcomes and five service readiness outcomes.
Results: We describe adherence on 15 measures of fidelity, of which 12 had high fidelity. Poor fidelity was found in conducting facility service readiness assessments and completing micro-interventions from action plans. Service delivery measures tended to be positively associated with participation and degree of micro-intervention completion and negatively associated with a higher number of action plans elaborated by participating teams. For the service readiness outcomes, delivery of essential care was positively associated with participation and micro-intervention completion, and staff availability was negatively associated with supervision.
Conclusion: Participation in audit and feedback meetings, the number of action plans elaborated, and the degree of completion of micro-interventions seem to be related to the effectiveness results. IDEAs should be adapted to reduce the number of action plans elaborated and promote better micro-intervention completion. Additionally, combining audit and feedback strategies with other strategies might enhance effectiveness in service outcomes. This study examines how to analyze the link between fidelity and effectiveness of a strategy to inform better design and recommend context-specific improvements.
Background: Saturation is a common criterion for determining qualitative sample size adequacy and analytic completeness. The dynamic and fast-paced implementation research environment poses unique challenges for investigators conducting qualitative studies that seek to reach saturation. Saturated studies require an iterative, often lengthy and labor-intensive process of data collection and analysis, which is frequently at odds with implementation science's focus on rapid turnaround times for translating knowledge into practice. Moreover, despite its common usage, uncertainty around saturation's meaning and application remains. To date, there has been no systematic attempt to understand how the concept of saturation is defined and deployed specifically in the context of qualitative implementation research, or guidance on how to adapt the saturation concept in response to field-specific needs.
Methods: A concept synthesis was conducted to establish baseline knowledge that would inform field-specific guidance for assessing sample adequacy and analytic completeness in qualitative implementation research. Three leading implementation science journals were searched. Eligible studies (a) described empirical research, (b) discussed the saturation concept in the context of qualitative methodology, and (c) mentioned saturation in the body of the manuscript. Articles were systematically read and coded to identify meaningful content and patterns of interpretation.
Results: Of 207 studies identified, 158 met eligibility for full-text review, and 146 were included in the final analysis. Findings show cursory treatment of the saturation concept. Various saturation-related terms and definitions were identified, as were prevailing interview sample sizes and citation patterns. Studies rarely explained how analytic completeness was determined, and discussion of saturation leading to theory or concept generation was sparse. These findings informed development of the 3S Continuum as an alternative approach for assessing qualitative sample adequacy and analytic completeness.
Conclusions: In implementation research, saturation as an analytic benchmark is seldom explained and difficult to attain. We propose a practical approach for reconceptualizing saturation as part of a larger continuum for assessing sample adequacy and analytic completeness. We aim to help implementation researchers navigate decisions about qualitative sample adequacy and analytic completeness in pragmatic and transparent ways.
Background: Clinical performance feedback (CPF) is widely used to support physician development and improve care. Yet, its impact remains limited by low voluntary engagement. This study sought to: (1) develop a theory-informed, report-agnostic model outlining the key beliefs that shape physician engagement with CPF; (2) explore patterns of feedback orientation across physicians; and (3) understand how individual perceptions influence engagement with CPF.
Methods: We used a cross-sectional, multi-method approach combining a survey and qualitative interviews with primary care physicians in Ontario, Canada. We validated a conceptual model using path analysis, explored heterogeneity in feedback orientation using latent profile analysis, and qualitatively examined how perceptions of CPF influenced engagement.
Results: Survey results (n = 206) supported a model in which engagement with CPF is shaped by five recipient characteristics: perceived need for change (change discrepancy), perceived value of CPF, confidence to act on feedback (feedback self-efficacy), belief that feedback is useful (feedback utility), and sense of responsibility to act (feedback accountability). Perceived utility mediated the effects of self-efficacy and value on accountability, and perceived need for change influenced value. Latent profile analysis identified three groups: physicians with high and balanced feedback orientation (n = 32), moderate and balanced (n = 143), and low feedback orientation with low self-efficacy (n = 31). Interview findings (n = 9) revealed two mindsets: physicians who saw value in CPF despite its limitations (engagers), and those who dismissed its relevance (non-engagers). These mindsets aligned with differences in value, utility, and accountability scores from the survey.
Conclusions: Engagement with CPF is not one-size-fits-all. Physicians differ in how they appraise and act on feedback based on their beliefs about its relevance, usefulness, and their ability to act. CPF initiatives should explicitly link feedback to improved patient outcomes, focus on future actions, and provide clear, actionable guidance. Designing CPF that accounts for recipient heterogeneity is essential to realizing its full potential as an improvement strategy.
Background: The demand for implementation science training far exceeds supply, indicating a need to expand capacity building efforts. Since 2014, the Implementation Science Summer Institute at the University of Washington (ISSI-UW) has provided an annual intensive training program to strengthen capacity in implementation science. In this article, we describe an evaluation of the program to determine its impact on short and long-term outcomes.
Methods: We used the Kirkpatrick model to guide the evaluation. We administered pre- and post-surveys with 2024 trainees to evaluate changes in implementation science knowledge and skills, intent to use methods and tools, and overall satisfaction. A survey of alumni from 2014 to 2024 evaluated post-training engagement in implementation science-related activities, the course's impact on alumni work, and its effect on professional networks. Surveys included both closed- and open-ended questions. Descriptive statistics were used to analyze demographic characteristics and present Likert-type response frequencies. Wilcoxon rank-sum tests were used to compare median differences across surveys and to determine statistical significance. Qualitative content analysis was conducted to examine open-ended responses.
Results: Of the 477 individuals from 48 countries (69% were low and middle-income countries) trained at the institute between 2014 and 2024 who were invited to participate in the alumni survey, 136 (28%) responded. Of the 72 individuals invited to participate in the 2024 pre- and post-surveys, 54 (75%) and 51 (70%) responded, respectively. Participants included global health researchers, implementers, graduate students, and donors. Findings from the 2024 pre- and post-surveys showed a significant improvement in the median responses for knowledge, skills, and intent, and respondents expressed high satisfaction. Alumni reported incorporating skills related to implementation science theories, models, and frameworks (84%), design of implementation evaluations (52%), and writing grants (50%) into their work. Alumni reported that the course had a very large (21%) or large influence on their work (32%) and noted a positive impact on networking (66%).
Conclusions: The ISSI-UW was associated with short-term improvements in implementation science knowledge and longer-term integration of implementation science methods and tools in professional work. This is an example of how universities can contribute to expanding and building capacity in implementation research and practice.
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：