Pub Date : 2025-07-27DOI: 10.1186/s13012-025-01444-5
Carl R May, Alyson Hillis, Bianca Albers, Laura Desveaux, Anthony Gilbert, Melissa Girling, Roman Kislov, Anne MacFarlane, Frances S Mair, Sebastian Potthoff, Tim Rapley, Tracy L Finch
Background: Implementation strategies are deliberate systematic actions used to support the uptake of innovations in health and social care. While widely used taxonomies such as ERIC and EPOC have emerged from consensus exercises, few implementation strategies are explicitly derived from theory and tested against empirical data. This study develops a taxonomy of implementation strategies grounded in Normalization Process Theory (NPT), an implementation theory that explains how new practices become embedded and sustained.
Methods: We conducted a qualitative evidence synthesis of studies that reported implementation projects informed by NPT. Studies were identified through citation tracking and database searches, screened using pre-specified criteria, and appraised for methodological quality. Using the NPT coding manual, we identified implementation mechanisms described in each study and translated these into candidate implementation strategies. These were then tested against all included studies through iterative qualitative content analysis.
Result: Searches led to 9,147 references, and we then eliminated 5,708 duplicates. After title and abstract screening a further 1,443 were eliminated. Full text screening was undertaken with 1,996 papers, and 1,411 of these were eliminated. This left 585 papers subjected to quality assessment, of which 522 were eliminated. Finally, 63 papers were included in the review. Qualitative analysis of included papers yielded 24 general strategies linked to NPT's theoretical constructs and 96 micro-strategies representing four domains of implementation activity: leadership, information, empowerment, and service user involvement. Each strategy was explicitly linked to an NPT construct.
Conclusions: This study provides a theory-based and empirically grounded set of actionable implementation strategies. These are grounded in qualitative descriptions of implementation work. These strategies support practical decision-making across the planning, delivery, and sustainment phases of implementation, and offer context-sensitive guidance for adapting interventions to diverse settings. Unlike consensus-based taxonomies, these strategies are tied to observable mechanisms of action, enabling users to better understand and respond to the dynamic and socially organised nature of implementation. The NPT taxonomy of implementation strategies can support the design, tailoring, and operationalisation of implementation efforts across varied health and social care contexts.
{"title":"Translational framework for implementation evaluation and research: implementation strategies derived from normalization process theory.","authors":"Carl R May, Alyson Hillis, Bianca Albers, Laura Desveaux, Anthony Gilbert, Melissa Girling, Roman Kislov, Anne MacFarlane, Frances S Mair, Sebastian Potthoff, Tim Rapley, Tracy L Finch","doi":"10.1186/s13012-025-01444-5","DOIUrl":"10.1186/s13012-025-01444-5","url":null,"abstract":"<p><strong>Background: </strong>Implementation strategies are deliberate systematic actions used to support the uptake of innovations in health and social care. While widely used taxonomies such as ERIC and EPOC have emerged from consensus exercises, few implementation strategies are explicitly derived from theory and tested against empirical data. This study develops a taxonomy of implementation strategies grounded in Normalization Process Theory (NPT), an implementation theory that explains how new practices become embedded and sustained.</p><p><strong>Methods: </strong>We conducted a qualitative evidence synthesis of studies that reported implementation projects informed by NPT. Studies were identified through citation tracking and database searches, screened using pre-specified criteria, and appraised for methodological quality. Using the NPT coding manual, we identified implementation mechanisms described in each study and translated these into candidate implementation strategies. These were then tested against all included studies through iterative qualitative content analysis.</p><p><strong>Result: </strong>Searches led to 9,147 references, and we then eliminated 5,708 duplicates. After title and abstract screening a further 1,443 were eliminated. Full text screening was undertaken with 1,996 papers, and 1,411 of these were eliminated. This left 585 papers subjected to quality assessment, of which 522 were eliminated. Finally, 63 papers were included in the review. Qualitative analysis of included papers yielded 24 general strategies linked to NPT's theoretical constructs and 96 micro-strategies representing four domains of implementation activity: leadership, information, empowerment, and service user involvement. Each strategy was explicitly linked to an NPT construct.</p><p><strong>Conclusions: </strong>This study provides a theory-based and empirically grounded set of actionable implementation strategies. These are grounded in qualitative descriptions of implementation work. These strategies support practical decision-making across the planning, delivery, and sustainment phases of implementation, and offer context-sensitive guidance for adapting interventions to diverse settings. Unlike consensus-based taxonomies, these strategies are tied to observable mechanisms of action, enabling users to better understand and respond to the dynamic and socially organised nature of implementation. The NPT taxonomy of implementation strategies can support the design, tailoring, and operationalisation of implementation efforts across varied health and social care contexts.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"34"},"PeriodicalIF":13.4,"publicationDate":"2025-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12297445/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144735468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-17DOI: 10.1186/s13012-025-01445-4
Christina Derksen, Fiona M Walter, Adriana B Akbar, Asha V E Parmar, Tyler S Saunders, Thomas Round, Greg Rubin, Suzanne E Scott
Background: Early detection of diseases in primary care is crucial for timely treatment and better outcomes. Complex care demands and limited resources can make early detection challenging. Clinical decision support systems (CDSS) aim to improve the diagnostic process. However, barriers to implementation have so far prevented their effective use. This systematic review aimed to identify barriers for the implementation of CDSS for disease detection in primary care and use this to develop recommendations for implementation.
Methods: We searched MEDLINE, EMBASE, Scopus, Web of Science and Cochrane databases. Included studies reported barriers to the implementation of CDSS for the detection of undiagnosed, prevalent diseases in primary care. Two independent researchers undertook screening and data extraction. The QuADS tool was used for quality assessment. Data on barriers and facilitators were synthesised using an inductive-deductive approach based on the Theoretical Domains Framework. This was used to identify solutions via the Behaviour Change Wheel.
Results: 10498 titles and abstracts were screened, and 768 full texts were assessed. We included 99 studies describing 85 tools, mostly in high-income countries. Most studies (66, 66.7%) applied qualitative methods and described CDSS implemented in pilot studies (64, 64.7%). Included studies had very limited stakeholder involvement or theoretical underpinning. We identified 2563 unique barriers and facilitators to implementation. Barriers were spread across the Theoretical Domains Framework including technical and workflow implementation issues at practice level, wider healthcare system issues, problems with the usability of systems, PCPs' and patients' attitudes and beliefs, a lack of skills and knowledge, and social barriers. Implementation recommendations for development teams involve selecting appropriate diagnostic challenges for CDSS, ensuring usability, engaging stakeholders and testing CDSS prior to implementation. Primary care teams need to clarify responsibilities, provide training and support patients. Underlying barriers across healthcare systems will need to be addressed at policy level.
Conclusions: The range and scale of the barriers and complexity of recommendations highlight implementation challenges for CDSS in primary care. Although recommendations can be used to improve implementation, our findings emphasise the need to carefully reflect on the feasibility of CDSS in primary care at the point of design and development. The systematic review was preregistered using PROSPERO (CRD42024517054): https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=517054.
背景:在初级保健中早期发现疾病对于及时治疗和获得更好的结果至关重要。复杂的护理需求和有限的资源使早期发现具有挑战性。临床决策支持系统(CDSS)旨在改善诊断过程。然而,迄今为止,执行方面的障碍阻碍了它们的有效利用。本系统综述旨在确定在初级保健中实施CDSS用于疾病检测的障碍,并据此制定实施建议。方法:检索MEDLINE、EMBASE、Scopus、Web of Science、Cochrane等数据库。纳入的研究报告了在初级保健中实施CDSS检测未确诊的流行疾病的障碍。两名独立研究人员进行了筛选和数据提取。采用QuADS工具进行质量评价。使用基于理论领域框架的归纳演绎方法综合了障碍和促进因素的数据。这被用来通过行为改变轮确定解决方案。结果:共筛选题目和摘要10498篇,评估全文768篇。我们纳入了99项研究,描述了85种工具,主要来自高收入国家。大多数研究(66,66.7%)采用定性方法,描述了在试点研究中实施的CDSS(64,64.7%)。纳入研究的利益相关者参与或理论基础非常有限。我们确定了2563个独特的实施障碍和促进因素。障碍分布在理论领域框架中,包括实践层面的技术和工作流程实施问题,更广泛的医疗保健系统问题,系统可用性问题,pcp和患者的态度和信念,缺乏技能和知识以及社会障碍。开发团队的实施建议包括为CDSS选择适当的诊断挑战、确保可用性、吸引利益相关者和在实施之前测试CDSS。初级保健团队需要明确责任,提供培训并支持患者。需要在政策层面解决卫生保健系统的潜在障碍。结论:障碍的范围和规模以及建议的复杂性突出了CDSS在初级保健中的实施挑战。虽然建议可用于改进实施,但我们的研究结果强调需要在设计和开发阶段仔细考虑CDSS在初级保健中的可行性。系统评价使用PROSPERO (CRD42024517054)进行预注册:https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=517054。
{"title":"The implementation challenge of computerised clinical decision support systems for the detection of disease in primary care: systematic review and recommendations.","authors":"Christina Derksen, Fiona M Walter, Adriana B Akbar, Asha V E Parmar, Tyler S Saunders, Thomas Round, Greg Rubin, Suzanne E Scott","doi":"10.1186/s13012-025-01445-4","DOIUrl":"10.1186/s13012-025-01445-4","url":null,"abstract":"<p><strong>Background: </strong>Early detection of diseases in primary care is crucial for timely treatment and better outcomes. Complex care demands and limited resources can make early detection challenging. Clinical decision support systems (CDSS) aim to improve the diagnostic process. However, barriers to implementation have so far prevented their effective use. This systematic review aimed to identify barriers for the implementation of CDSS for disease detection in primary care and use this to develop recommendations for implementation.</p><p><strong>Methods: </strong>We searched MEDLINE, EMBASE, Scopus, Web of Science and Cochrane databases. Included studies reported barriers to the implementation of CDSS for the detection of undiagnosed, prevalent diseases in primary care. Two independent researchers undertook screening and data extraction. The QuADS tool was used for quality assessment. Data on barriers and facilitators were synthesised using an inductive-deductive approach based on the Theoretical Domains Framework. This was used to identify solutions via the Behaviour Change Wheel.</p><p><strong>Results: </strong>10498 titles and abstracts were screened, and 768 full texts were assessed. We included 99 studies describing 85 tools, mostly in high-income countries. Most studies (66, 66.7%) applied qualitative methods and described CDSS implemented in pilot studies (64, 64.7%). Included studies had very limited stakeholder involvement or theoretical underpinning. We identified 2563 unique barriers and facilitators to implementation. Barriers were spread across the Theoretical Domains Framework including technical and workflow implementation issues at practice level, wider healthcare system issues, problems with the usability of systems, PCPs' and patients' attitudes and beliefs, a lack of skills and knowledge, and social barriers. Implementation recommendations for development teams involve selecting appropriate diagnostic challenges for CDSS, ensuring usability, engaging stakeholders and testing CDSS prior to implementation. Primary care teams need to clarify responsibilities, provide training and support patients. Underlying barriers across healthcare systems will need to be addressed at policy level.</p><p><strong>Conclusions: </strong>The range and scale of the barriers and complexity of recommendations highlight implementation challenges for CDSS in primary care. Although recommendations can be used to improve implementation, our findings emphasise the need to carefully reflect on the feasibility of CDSS in primary care at the point of design and development. The systematic review was preregistered using PROSPERO (CRD42024517054): https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=517054.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"33"},"PeriodicalIF":13.4,"publicationDate":"2025-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12269258/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144651271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-09DOI: 10.1186/s13012-025-01440-9
Allison G Harvey, Emma R Agnew, Rafael Esteva Hache, Julia M Spencer, Marlen Diaz, Estephania Ovalle Patino, Anne Milner, Lu Dong, Amy M Kilbourne, Daniel J Buysse, Catherine A Callaway, Laurel D Sarfan
Background: Grounded in the Integrated Promoting Action on Research Implementation in Health Services framework (i-PARIHS) and the Replicating Effective Programs framework (REP), the goal is to determine if the use of theory, data and end-user perspectives to guide an adaptation of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TSC) yields better outcomes and improves the "fit" of TSC to community mental health centers (CMHCs), relative to the standard version.
Methods: Ten counties in California were cluster-randomized by county to Adapted or Standard TSC. Within each county, adults who exhibited sleep and circadian dysfunction and serious mental illness (SMI) were randomized to immediate TSC or Usual Care followed by Delayed Treatment with TSC (UC-DT). Facilitation was the implementation strategy. The participants were 93 CMHC providers who delivered TSC (Standard = 30; Adapted = 63) and 396 CMHC patients (Standard = 74; Adapted = 124; UC-DT = 198). Patient assessments were completed at pre-treatment, post-treatment, and six months after treatment (6FU). Provider assessments were completed at post-training, mid-treatment, and post-treatment.
Results: TSC (combining Adapted and Standard), relative to UC-DT before delayed treatment with TSC, was associated with improvement from pre- to post-treatment in sleep disturbance (b = -10.91, p < 0.001, d = -1.52), sleep-related impairment (b = -9.52, p < 0.001, d = -1.06), sleep health composite (b = 1.63, p < 0.001, d = 0.95), psychiatric symptoms (b = -6.72, p < 0.001, d = -0.52), and overall functional impairment (b = -5.12, p < 0.001, d = -0.71). TSC's benefits for functional impairment and psychiatric symptoms were mediated by improvements in sleep and circadian problems. Adapted versus Standard TSC did not differ on provider ratings of fit and better fit did not mediate the relation between TSC condition and patient outcome.
Conclusions: TSC can be delivered by CMHC providers. Adapted and Standard TSC both fit the CMHC context. These findings are interpreted through the lens of the four core constructs of the i-PARIHS framework.
Trial registration: Clinicaltrials.gov identifier: NCT04154631. Registered on November 6, 2019. https://clinicaltrials.gov/ct2/show/NCT04154631.
{"title":"A randomized trial of adapted versus standard versions of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction implemented via facilitation and delivered by community mental health providers: improving the \"fit\" of psychological treatments by adapting to context.","authors":"Allison G Harvey, Emma R Agnew, Rafael Esteva Hache, Julia M Spencer, Marlen Diaz, Estephania Ovalle Patino, Anne Milner, Lu Dong, Amy M Kilbourne, Daniel J Buysse, Catherine A Callaway, Laurel D Sarfan","doi":"10.1186/s13012-025-01440-9","DOIUrl":"10.1186/s13012-025-01440-9","url":null,"abstract":"<p><strong>Background: </strong>Grounded in the Integrated Promoting Action on Research Implementation in Health Services framework (i-PARIHS) and the Replicating Effective Programs framework (REP), the goal is to determine if the use of theory, data and end-user perspectives to guide an adaptation of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TSC) yields better outcomes and improves the \"fit\" of TSC to community mental health centers (CMHCs), relative to the standard version.</p><p><strong>Methods: </strong>Ten counties in California were cluster-randomized by county to Adapted or Standard TSC. Within each county, adults who exhibited sleep and circadian dysfunction and serious mental illness (SMI) were randomized to immediate TSC or Usual Care followed by Delayed Treatment with TSC (UC-DT). Facilitation was the implementation strategy. The participants were 93 CMHC providers who delivered TSC (Standard = 30; Adapted = 63) and 396 CMHC patients (Standard = 74; Adapted = 124; UC-DT = 198). Patient assessments were completed at pre-treatment, post-treatment, and six months after treatment (6FU). Provider assessments were completed at post-training, mid-treatment, and post-treatment.</p><p><strong>Results: </strong>TSC (combining Adapted and Standard), relative to UC-DT before delayed treatment with TSC, was associated with improvement from pre- to post-treatment in sleep disturbance (b = -10.91, p < 0.001, d = -1.52), sleep-related impairment (b = -9.52, p < 0.001, d = -1.06), sleep health composite (b = 1.63, p < 0.001, d = 0.95), psychiatric symptoms (b = -6.72, p < 0.001, d = -0.52), and overall functional impairment (b = -5.12, p < 0.001, d = -0.71). TSC's benefits for functional impairment and psychiatric symptoms were mediated by improvements in sleep and circadian problems. Adapted versus Standard TSC did not differ on provider ratings of fit and better fit did not mediate the relation between TSC condition and patient outcome.</p><p><strong>Conclusions: </strong>TSC can be delivered by CMHC providers. Adapted and Standard TSC both fit the CMHC context. These findings are interpreted through the lens of the four core constructs of the i-PARIHS framework.</p><p><strong>Trial registration: </strong>Clinicaltrials.gov identifier: NCT04154631. Registered on November 6, 2019. https://clinicaltrials.gov/ct2/show/NCT04154631.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"32"},"PeriodicalIF":13.4,"publicationDate":"2025-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12239326/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144602293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-01DOI: 10.1186/s13012-025-01443-6
Erin Nolan, Joshua Dizon, Christopher Oldmeadow, Elizabeth Holliday, Alix Hall, Daniel Barker
Trials optimising implementation strategies are complex, assess multicomponent strategies, and cluster randomise. We define optimisation as identifying the best combination of components for multi-component implementation strategies. Multi-arm, fixed, cluster randomised control trials (cRCTs) can assess multiple implementation components but suffer from low power due to challenges of recruitment. Adaptive designs offer increased efficiency, when compared to "fixed trial" approaches. A simulation study was conducted to assess whether adaptive designs are feasible (acceptable operating characteristics and adaptive interim decisions) for implementation cRCTs with few clusters. A four-arm cRCT was simulated under varying trial properties. The trials were simulated using fixed design and adaptive design parameters (number of interim analyses, timing of interim analysis, actions at interim e.g. allowing for early stopping for futility, arm dropping) and modelled using Bayesian hierarchical models. The power and type 1 error were compared between the fixed and adaptive designs, and the number of correct interim decisions under the adaptive design were examined. When the intra-class correlation (ICC) was high, the proportion of trials that incorrectly dropped the most effective arm increased. There were small power gains for adaptive designs, without increasing type 1 error. Power gains attenuated when ICC was high and sample size was low. Type 1 error was lower comparable between adaptive and non-adaptive designs. Adaptive designs are feasible for cRCTs with few clusters. They are not as feasible when the ICC is high due to increased risk of incorrect adaptive interim decisions.
{"title":"Properties of adaptive, cluster-randomised controlled trials with few clusters: a simulation study.","authors":"Erin Nolan, Joshua Dizon, Christopher Oldmeadow, Elizabeth Holliday, Alix Hall, Daniel Barker","doi":"10.1186/s13012-025-01443-6","DOIUrl":"10.1186/s13012-025-01443-6","url":null,"abstract":"<p><p>Trials optimising implementation strategies are complex, assess multicomponent strategies, and cluster randomise. We define optimisation as identifying the best combination of components for multi-component implementation strategies. Multi-arm, fixed, cluster randomised control trials (cRCTs) can assess multiple implementation components but suffer from low power due to challenges of recruitment. Adaptive designs offer increased efficiency, when compared to \"fixed trial\" approaches. A simulation study was conducted to assess whether adaptive designs are feasible (acceptable operating characteristics and adaptive interim decisions) for implementation cRCTs with few clusters. A four-arm cRCT was simulated under varying trial properties. The trials were simulated using fixed design and adaptive design parameters (number of interim analyses, timing of interim analysis, actions at interim e.g. allowing for early stopping for futility, arm dropping) and modelled using Bayesian hierarchical models. The power and type 1 error were compared between the fixed and adaptive designs, and the number of correct interim decisions under the adaptive design were examined. When the intra-class correlation (ICC) was high, the proportion of trials that incorrectly dropped the most effective arm increased. There were small power gains for adaptive designs, without increasing type 1 error. Power gains attenuated when ICC was high and sample size was low. Type 1 error was lower comparable between adaptive and non-adaptive designs. Adaptive designs are feasible for cRCTs with few clusters. They are not as feasible when the ICC is high due to increased risk of incorrect adaptive interim decisions.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"31"},"PeriodicalIF":13.4,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12211755/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144546254","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-06-23DOI: 10.1186/s13012-025-01441-8
Kelly A Aschbrenner, Borsika A Rabin, Stephen J Bartels, Russell E Glasgow
Background: A major gap in implementation research is guidance for designing studies to assess the impact of adaptations to interventions and implementation strategies. Many researchers regard experimental designs as the gold standard. However, the possible study designs for assessing the impact of adaptation on implementation, service and person-level outcomes is broad in scope, including descriptive and correlational research and variations of randomized controlled trials. This article provides a set of key methodological recommendations for assessing the impact of adaptations to interventions and implementation strategies on implementation outcomes.
Recommendations: We offer four key recommendations for investigating the impact of adaptations on implementation outcomes. First, we recommend defining the construct of adaptations and identifying the type and timing of adaptations. Second, we recommend that study teams identify the expected proximal and distal outcomes of adaptations. Third, we recommend that study teams consider all possible study design options and select the design that is best suited to answer the research question(s), and is feasible given practical and technical constraints, and acceptable to research partners and participants. Fourth, we recommend that study teams consider the type of adaptation and outcome data available, the goals of the adaptation study, and the complexity of the study design when selecting analytic approaches. We provide materials and examples related to the four key recommendations to help study teams plan and conduct adaptation studies.
Conclusions: This article provides methodological recommendations for assessing the impact of adaptations to interventions and implementation strategies on implementation, service, and person-level outcomes that are grounded in the practical realities of implementation research. Increasing the number of studies examining how, which, and under what conditions adaptations are associated with mechanisms and outcomes will advance research on adaptation.
{"title":"Methodological recommendations for assessing the impact of adaptations on outcomes in implementation research.","authors":"Kelly A Aschbrenner, Borsika A Rabin, Stephen J Bartels, Russell E Glasgow","doi":"10.1186/s13012-025-01441-8","DOIUrl":"10.1186/s13012-025-01441-8","url":null,"abstract":"<p><strong>Background: </strong>A major gap in implementation research is guidance for designing studies to assess the impact of adaptations to interventions and implementation strategies. Many researchers regard experimental designs as the gold standard. However, the possible study designs for assessing the impact of adaptation on implementation, service and person-level outcomes is broad in scope, including descriptive and correlational research and variations of randomized controlled trials. This article provides a set of key methodological recommendations for assessing the impact of adaptations to interventions and implementation strategies on implementation outcomes.</p><p><strong>Recommendations: </strong>We offer four key recommendations for investigating the impact of adaptations on implementation outcomes. First, we recommend defining the construct of adaptations and identifying the type and timing of adaptations. Second, we recommend that study teams identify the expected proximal and distal outcomes of adaptations. Third, we recommend that study teams consider all possible study design options and select the design that is best suited to answer the research question(s), and is feasible given practical and technical constraints, and acceptable to research partners and participants. Fourth, we recommend that study teams consider the type of adaptation and outcome data available, the goals of the adaptation study, and the complexity of the study design when selecting analytic approaches. We provide materials and examples related to the four key recommendations to help study teams plan and conduct adaptation studies.</p><p><strong>Conclusions: </strong>This article provides methodological recommendations for assessing the impact of adaptations to interventions and implementation strategies on implementation, service, and person-level outcomes that are grounded in the practical realities of implementation research. Increasing the number of studies examining how, which, and under what conditions adaptations are associated with mechanisms and outcomes will advance research on adaptation.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"30"},"PeriodicalIF":13.4,"publicationDate":"2025-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12183851/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144477944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-06-20DOI: 10.1186/s13012-025-01433-8
{"title":"Proceedings of the 17<sup>th</sup> Annual Conference on the Science of Dissemination and Implementation in Health.","authors":"","doi":"10.1186/s13012-025-01433-8","DOIUrl":"10.1186/s13012-025-01433-8","url":null,"abstract":"","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 Suppl 1","pages":"29"},"PeriodicalIF":8.8,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12180168/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144334520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-06-02DOI: 10.1186/s13012-025-01439-2
Avni Gupta, Laura C Wyatt, Shinu Mammen, Jennifer M Zanowiak, Sahnah Lim, Nadia S Islam, Rashi Kumar, Susan Beane, Heather T Gold
Background: We conducted a cost analysis of implementing a randomized controlled trial that proved the effectiveness of a community health worker (CHW) facilitated weight loss intervention among South Asian patients with prediabetes receiving care at primary care practices in New York City. South Asians have a high prevalence of diabetes, but no study to date has evaluated the cost of implementing an evidence-based lifestyle intervention in this population. Cost estimates are necessary for an intervention's adoption and scale-up.
Methods: The first wave of the intervention was implemented in-person, followed by two waves implemented remotely during the COVID-19 pandemic. We estimated the implementation, intervention, and adaptation costs and the costs by each wave of implementation, by applying the Gold et al.'s economic framework and ERIC discrete implementation strategy compilation Costs were calculated from the perspective of a health care payer, public health agency, or health care system. The CHW intervention included group education sessions over six months. For each wave, we separately estimated the total cost, cost per practice, and cost when implemented at only one practice. Using the Bureau of Labor Statistics salary estimates, we calculated the national average (mean salary) and lower (25th percentile salary) and upper (75th percentile salary) bounds.
Results: The average total 6-month implementation costs over 3 waves, each targeting seven practices was $215,420 (range: $158,620-$257,020). Program staff salaries comprised > 93% of total costs. Adaptation cost was nearly 1/3 of start-up costs. On average, implementation at one practice would cost twice as much as the per-practice costs when implemented simultaneously at seven practices in a wave, due to spread of start-up costs across multiple sites.
Conclusions: Staff salaries comprise most of the budget to implement such an intervention. It is most efficient for an agency to implement this intervention across several practices simultaneously. Decision-makers will need to evaluate relative costs and effectiveness of other options to achieve weight loss in a minority community with constrained resources.
Clinicaltrials: GOV: This study was registered on June 15, 2017 at https://www.
Clinicaltrials: gov as NCT03188094. https://clinicaltrials.gov/ct2/show/NCT03188094 .
背景:我们进行了一项实施随机对照试验的成本分析,该试验证明了社区卫生工作者(CHW)促进在纽约市初级保健诊所接受治疗的南亚糖尿病前期患者减肥干预的有效性。南亚人的糖尿病患病率很高,但迄今为止还没有研究评估在该人群中实施循证生活方式干预的成本。成本估算对于干预措施的采用和推广是必要的。方法:在2019冠状病毒病大流行期间,第一波干预在现场实施,随后两波干预在远程实施。通过应用Gold等人的经济框架和ERIC离散实施策略汇编,我们估计了实施、干预和适应成本以及每一波实施的成本,从医疗保健支付者、公共卫生机构或医疗保健系统的角度计算了成本。CHW干预包括为期六个月的小组教育课程。对于每一波,我们分别估计了总成本、每次实践的成本,以及仅在一次实践中实现时的成本。根据美国劳工统计局(Bureau of Labor Statistics)的工资估计,我们计算出了全国平均工资(平均工资)、最低工资(第25百分位工资)和最高工资(第75百分位工资)界限。结果:6个月的平均总实施成本分为3波,每波针对7个实践,为215,420美元(范围:158,620美元- 257,020美元)。项目人员的工资占总成本的93%。适应成本接近启动成本的1/3。平均而言,在一个实践中实现的成本将是在一个波中同时实现七个实践时每个实践成本的两倍,这是由于在多个站点上分散的启动成本。结论:工作人员工资占实施这种干预的大部分预算。对于一个机构来说,同时跨多个实践实施这种干预是最有效的。决策者将需要评估在资源有限的少数民族社区实现减肥的其他选择的相对成本和有效性。临床试验:GOV:本研究于2017年6月15日在https://www.Clinicaltrials: GOV注册,注册号为NCT03188094。https://clinicaltrials.gov/ct2/show/NCT03188094。
{"title":"Cost analysis of implementing a community health worker-led weight reduction randomized-controlled trial among prediabetic south asian patients at primary care sites in NYC.","authors":"Avni Gupta, Laura C Wyatt, Shinu Mammen, Jennifer M Zanowiak, Sahnah Lim, Nadia S Islam, Rashi Kumar, Susan Beane, Heather T Gold","doi":"10.1186/s13012-025-01439-2","DOIUrl":"10.1186/s13012-025-01439-2","url":null,"abstract":"<p><strong>Background: </strong>We conducted a cost analysis of implementing a randomized controlled trial that proved the effectiveness of a community health worker (CHW) facilitated weight loss intervention among South Asian patients with prediabetes receiving care at primary care practices in New York City. South Asians have a high prevalence of diabetes, but no study to date has evaluated the cost of implementing an evidence-based lifestyle intervention in this population. Cost estimates are necessary for an intervention's adoption and scale-up.</p><p><strong>Methods: </strong>The first wave of the intervention was implemented in-person, followed by two waves implemented remotely during the COVID-19 pandemic. We estimated the implementation, intervention, and adaptation costs and the costs by each wave of implementation, by applying the Gold et al.'s economic framework and ERIC discrete implementation strategy compilation Costs were calculated from the perspective of a health care payer, public health agency, or health care system. The CHW intervention included group education sessions over six months. For each wave, we separately estimated the total cost, cost per practice, and cost when implemented at only one practice. Using the Bureau of Labor Statistics salary estimates, we calculated the national average (mean salary) and lower (25th percentile salary) and upper (75th percentile salary) bounds.</p><p><strong>Results: </strong>The average total 6-month implementation costs over 3 waves, each targeting seven practices was $215,420 (range: $158,620-$257,020). Program staff salaries comprised > 93% of total costs. Adaptation cost was nearly 1/3 of start-up costs. On average, implementation at one practice would cost twice as much as the per-practice costs when implemented simultaneously at seven practices in a wave, due to spread of start-up costs across multiple sites.</p><p><strong>Conclusions: </strong>Staff salaries comprise most of the budget to implement such an intervention. It is most efficient for an agency to implement this intervention across several practices simultaneously. Decision-makers will need to evaluate relative costs and effectiveness of other options to achieve weight loss in a minority community with constrained resources.</p><p><strong>Clinicaltrials: </strong>GOV: This study was registered on June 15, 2017 at https://www.</p><p><strong>Clinicaltrials: </strong>gov as NCT03188094. https://clinicaltrials.gov/ct2/show/NCT03188094 .</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"26"},"PeriodicalIF":8.8,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12131561/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144210297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-06-02DOI: 10.1186/s13012-025-01442-7
Charlene Weight, Billy Vinette, Rachael Laritz, Meagan Mooney, Sonia A Castiglione, Marc-André Maheu-Cadotte, Nikolas Argiropoulos, Kristin Konnyu, Christine E Cassidy, Simonne E Collins, Sonia Semenic, Nicola Straiton, Sandy Middleton, Natalie Taylor, Marie-Pierre Gagnon, Shuang Liang, Laura Crump, Olivia Di Lalla, Talia Meyers, Daniel N Elakpa, Guillaume Fontaine
Background: Clear specification and reporting of implementation strategies and their targeted healthcare professional behaviors are essential for replication, adaptation, and cumulative learning in implementation science. However, critical gaps remain in the consistent use of reporting frameworks. This study aimed to: (1) assess the completeness of implementation strategy reporting using the Template for Intervention Description and Replication (TIDieR) checklist; (2) examine trends in implementation strategy reporting over time; and (3) assess the completeness of the reporting of healthcare professional behaviors targeted for change using the Action, Actor, Context, Target, Time (AACTT) framework.
Methods: We conducted a secondary analysis of 204 trials included in a systematic review of implementation strategies aimed at changing healthcare professional behavior. Implementation strategies were assessed using the 12-item TIDieR checklist; target behaviors were characterized using the five AACTT domains. Two independent reviewers extracted and coded the data. Descriptive statistics were used to summarize reporting patterns. Data were synthesized narratively and presented in tables, with trends illustrated via a scatterplot.
Results: Assessment of implementation strategy reporting using TIDieR showed that procedural details (98%), materials used (95%), and modes of delivery (88%) were frequently reported. Critical elements such as strategy tailoring (28%), fidelity assessment (19% planned; 17% actual), and modifications (10%) were often missing. A modest improvement in reporting was observed after the publication of TIDieR, with median scores increasing from 15.0 (IQR: 13.0-16.0) pre-2014 to 16.0 (IQR: 15.0-18.0) post-2014. Assessment of target healthcare professional behavior reporting using AACTT indicated that actions (e.g., "assess illness") and actors (e.g., nurses) were generally well reported at a high level. However, key contextual and temporal details were largely absent. While physical context was documented in all studies, the emotional and social contexts of behaviors were rarely reported. Crucial information on the duration, frequency, and period of behaviors was rarely reported.
Conclusions: Implementation strategies and target behaviors are not consistently or sufficiently reported in trials. Increased adoption of structured reporting tools such as TIDieR and AACTT is essential to enhance transparency. Incorporating these frameworks during protocol development could strengthen intervention evaluation and reporting, advancing implementation science and fostering cumulative knowledge.
{"title":"How well are implementation strategies and target healthcare professional behaviors reported? A secondary analysis of 204 implementation trials using the TIDieR checklist and AACTT framework.","authors":"Charlene Weight, Billy Vinette, Rachael Laritz, Meagan Mooney, Sonia A Castiglione, Marc-André Maheu-Cadotte, Nikolas Argiropoulos, Kristin Konnyu, Christine E Cassidy, Simonne E Collins, Sonia Semenic, Nicola Straiton, Sandy Middleton, Natalie Taylor, Marie-Pierre Gagnon, Shuang Liang, Laura Crump, Olivia Di Lalla, Talia Meyers, Daniel N Elakpa, Guillaume Fontaine","doi":"10.1186/s13012-025-01442-7","DOIUrl":"10.1186/s13012-025-01442-7","url":null,"abstract":"<p><strong>Background: </strong>Clear specification and reporting of implementation strategies and their targeted healthcare professional behaviors are essential for replication, adaptation, and cumulative learning in implementation science. However, critical gaps remain in the consistent use of reporting frameworks. This study aimed to: (1) assess the completeness of implementation strategy reporting using the Template for Intervention Description and Replication (TIDieR) checklist; (2) examine trends in implementation strategy reporting over time; and (3) assess the completeness of the reporting of healthcare professional behaviors targeted for change using the Action, Actor, Context, Target, Time (AACTT) framework.</p><p><strong>Methods: </strong>We conducted a secondary analysis of 204 trials included in a systematic review of implementation strategies aimed at changing healthcare professional behavior. Implementation strategies were assessed using the 12-item TIDieR checklist; target behaviors were characterized using the five AACTT domains. Two independent reviewers extracted and coded the data. Descriptive statistics were used to summarize reporting patterns. Data were synthesized narratively and presented in tables, with trends illustrated via a scatterplot.</p><p><strong>Results: </strong>Assessment of implementation strategy reporting using TIDieR showed that procedural details (98%), materials used (95%), and modes of delivery (88%) were frequently reported. Critical elements such as strategy tailoring (28%), fidelity assessment (19% planned; 17% actual), and modifications (10%) were often missing. A modest improvement in reporting was observed after the publication of TIDieR, with median scores increasing from 15.0 (IQR: 13.0-16.0) pre-2014 to 16.0 (IQR: 15.0-18.0) post-2014. Assessment of target healthcare professional behavior reporting using AACTT indicated that actions (e.g., \"assess illness\") and actors (e.g., nurses) were generally well reported at a high level. However, key contextual and temporal details were largely absent. While physical context was documented in all studies, the emotional and social contexts of behaviors were rarely reported. Crucial information on the duration, frequency, and period of behaviors was rarely reported.</p><p><strong>Conclusions: </strong>Implementation strategies and target behaviors are not consistently or sufficiently reported in trials. Increased adoption of structured reporting tools such as TIDieR and AACTT is essential to enhance transparency. Incorporating these frameworks during protocol development could strengthen intervention evaluation and reporting, advancing implementation science and fostering cumulative knowledge.</p><p><strong>Trial registration: </strong>PROSPERO CRD42019130446.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"28"},"PeriodicalIF":8.8,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12131398/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144210298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-06-02DOI: 10.1186/s13012-025-01438-3
Miquel Bennasar-Veny, Manuela Abbate, Miquel Colom-Rosselló, Laura Capitán-Moyano, Ivonne C Hernández-Bermúdez, Ignacio Ricci-Cabello, Aina M Yañez, Maria E Fernandez
Background: Type 2 diabetes (T2D) is a global health concern affecting 10.5% of the adult population and is projected to rise significantly in the coming decades. Lifestyle modification programs, such as the Diabetes Prevention Program (DPP), can effectively reduce T2D risk among individuals with prediabetes. However, their implementation in real-world healthcare settings remains poor, particularly in Spain, where T2D prevalence is the highest in Europe. The ALADIM study aims to evaluate the effectiveness and implementation of an adapted DPP in Spanish Primary Care Centers (PCCs). The primary effectiveness outcome is weight, the co-primary implementation outcome is implementation fidelity. We will also assess the effect of DPP implementation on overall prediabetes management within the PCCs (spillover) by measuring the percentage of people with prediabetes receiving lifestyle advice.
Methods: The ALADIM trial is a hybrid type II effectiveness-implementation cluster-randomized controlled trial involving 10 PCCs of Mallorca (Balearic Islands, Spain). PCCs will be randomized to the intervention (5 PCCs) or control (5 PCCs) group in a 1:1 ratio. The intervention group will receive training and materials to implement and deliver the adapted DPP over 12 months. The control group will continue providing usual care. The DPP will be culturally adapted using the Intervention Mapping-ADAPT (IM-ADAPT) approach. The implementation strategy will be designed using Implementation Mapping. Measures of effectiveness will be assessed at the participant level at baseline, 6 and 12 months during the intervention period, and 18 months after baseline. Implementation outcomes will be assessed at the PCC level at multiple time-points throughout the study period. Spillover will be assessed at PCC level at months -1, 6 and 18. An intention-to-treat analysis will assess effectiveness and spillover effect using generalized estimating equations. Implementation outcomes will be evaluated using a mixed-methods approach.
Discussion: The ALADIM study has the potential to address the gap between research and practice by employing implementation science for evaluation, adaptation and implementation of an evidence-based diabetes intervention. The findings will contribute to the development of a sustainable and scalable implementation strategy for T2D prevention, with potential implications for policy and practice at regional and national levels.
Trial registration: ClinicalTrials.gov, NCT06871059. Registered 10 March 2025, https://clinicaltrials.gov/study/NCT06871059.
{"title":"Impact of an adapted diabetes prevention program in a spanish primary care setting: protocol for a type II hybrid effectiveness-implementation cluster-randomized trial (ALADIM).","authors":"Miquel Bennasar-Veny, Manuela Abbate, Miquel Colom-Rosselló, Laura Capitán-Moyano, Ivonne C Hernández-Bermúdez, Ignacio Ricci-Cabello, Aina M Yañez, Maria E Fernandez","doi":"10.1186/s13012-025-01438-3","DOIUrl":"10.1186/s13012-025-01438-3","url":null,"abstract":"<p><strong>Background: </strong>Type 2 diabetes (T2D) is a global health concern affecting 10.5% of the adult population and is projected to rise significantly in the coming decades. Lifestyle modification programs, such as the Diabetes Prevention Program (DPP), can effectively reduce T2D risk among individuals with prediabetes. However, their implementation in real-world healthcare settings remains poor, particularly in Spain, where T2D prevalence is the highest in Europe. The ALADIM study aims to evaluate the effectiveness and implementation of an adapted DPP in Spanish Primary Care Centers (PCCs). The primary effectiveness outcome is weight, the co-primary implementation outcome is implementation fidelity. We will also assess the effect of DPP implementation on overall prediabetes management within the PCCs (spillover) by measuring the percentage of people with prediabetes receiving lifestyle advice.</p><p><strong>Methods: </strong>The ALADIM trial is a hybrid type II effectiveness-implementation cluster-randomized controlled trial involving 10 PCCs of Mallorca (Balearic Islands, Spain). PCCs will be randomized to the intervention (5 PCCs) or control (5 PCCs) group in a 1:1 ratio. The intervention group will receive training and materials to implement and deliver the adapted DPP over 12 months. The control group will continue providing usual care. The DPP will be culturally adapted using the Intervention Mapping-ADAPT (IM-ADAPT) approach. The implementation strategy will be designed using Implementation Mapping. Measures of effectiveness will be assessed at the participant level at baseline, 6 and 12 months during the intervention period, and 18 months after baseline. Implementation outcomes will be assessed at the PCC level at multiple time-points throughout the study period. Spillover will be assessed at PCC level at months -1, 6 and 18. An intention-to-treat analysis will assess effectiveness and spillover effect using generalized estimating equations. Implementation outcomes will be evaluated using a mixed-methods approach.</p><p><strong>Discussion: </strong>The ALADIM study has the potential to address the gap between research and practice by employing implementation science for evaluation, adaptation and implementation of an evidence-based diabetes intervention. The findings will contribute to the development of a sustainable and scalable implementation strategy for T2D prevention, with potential implications for policy and practice at regional and national levels.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov, NCT06871059. Registered 10 March 2025, https://clinicaltrials.gov/study/NCT06871059.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"27"},"PeriodicalIF":8.8,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12131578/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144210299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-05-30DOI: 10.1186/s13012-025-01437-4
Andreas Rödlund, Anna Toropova, Rebecca Lengnick-Hall, Byron J Powell, Liselotte Schäfer Elinder, Christina Björklund, Lydia Kwak
Background: Occupational guidelines exist to support workplaces with the prevention of mental health problems (MHP) among their staff. However, knowledge of effective implementation strategies to support their implementation is limited. This study experimentally tested whether a multifaceted implementation strategy - comprising an educational meeting, five workshops, implementation teams, small cyclical tests of change, and facilitation - improves fidelity to a guideline for preventing MHP in a school setting through the pathway of change of the Capability Opportunity Motivation-Behavior (COM-B)-model. To gain a more granular understanding of the mechanisms of change, the Theoretical Domains Framework (TDF) was used to specify mediators related to capability, opportunity, and motivation. This study tested whether the multifaceted strategy versus a discrete strategy (1) improves fidelity, (2) enhances capability, opportunity, and motivation over time, and (3) if the strategy's effect on fidelity is mediated by capability, opportunity, and motivation.
Methods: Fifty-five schools were randomly assigned to a multifaceted strategy or a discrete strategy. Fidelity was measured by questionnaires at baseline and 12 months, while capability, opportunity, and motivation were assessed three times within this period (directly after the educational meeting and at three and nine months). The Determinants of Implementation Behavior Questionnaire was used to assess TDF hypothesized mediators corresponding to the COM-B components. Separate pathways were analyzed for each mediator. Linear Mixed Modeling was employed to test the strategy's effect on fidelity, and mediation analyses were conducted using the PROCESS Macro.
Results: The multifaceted strategy led to improved fidelity at 12 months (B = 2.81, p < .001). Multifaceted schools reported higher scores for all mediators after nine months compared to schools receiving the discrete strategy. The effect of the multifaceted strategy on fidelity was partially mediated by all TDF mediators (p = < .05) except for beliefs about consequences. Capability-related mediators, including skills (Proportion-mediated = 41%, p = < .01) and behavioral regulation (Proportion-mediated = 35%, p = < .001), accounted for the largest proportion of the effect, followed by the motivation-related mediator goals (Proportion-mediated = 34%, p = < .01).
Conclusions: The multifaceted strategy improved guideline fidelity by enhancing capability, opportunity, and motivation confirming the proposed function of COM-B. This study addresses calls for experimental evidence on how multifaceted implementation strategies achieve implementation outcomes.
{"title":"Mechanisms of change of a multifaceted implementation strategy on fidelity to a guideline for the prevention of mental health problems at the workplace: a mechanism analysis within a cluster-randomized controlled trial.","authors":"Andreas Rödlund, Anna Toropova, Rebecca Lengnick-Hall, Byron J Powell, Liselotte Schäfer Elinder, Christina Björklund, Lydia Kwak","doi":"10.1186/s13012-025-01437-4","DOIUrl":"10.1186/s13012-025-01437-4","url":null,"abstract":"<p><strong>Background: </strong>Occupational guidelines exist to support workplaces with the prevention of mental health problems (MHP) among their staff. However, knowledge of effective implementation strategies to support their implementation is limited. This study experimentally tested whether a multifaceted implementation strategy - comprising an educational meeting, five workshops, implementation teams, small cyclical tests of change, and facilitation - improves fidelity to a guideline for preventing MHP in a school setting through the pathway of change of the Capability Opportunity Motivation-Behavior (COM-B)-model. To gain a more granular understanding of the mechanisms of change, the Theoretical Domains Framework (TDF) was used to specify mediators related to capability, opportunity, and motivation. This study tested whether the multifaceted strategy versus a discrete strategy (1) improves fidelity, (2) enhances capability, opportunity, and motivation over time, and (3) if the strategy's effect on fidelity is mediated by capability, opportunity, and motivation.</p><p><strong>Methods: </strong>Fifty-five schools were randomly assigned to a multifaceted strategy or a discrete strategy. Fidelity was measured by questionnaires at baseline and 12 months, while capability, opportunity, and motivation were assessed three times within this period (directly after the educational meeting and at three and nine months). The Determinants of Implementation Behavior Questionnaire was used to assess TDF hypothesized mediators corresponding to the COM-B components. Separate pathways were analyzed for each mediator. Linear Mixed Modeling was employed to test the strategy's effect on fidelity, and mediation analyses were conducted using the PROCESS Macro.</p><p><strong>Results: </strong>The multifaceted strategy led to improved fidelity at 12 months (B = 2.81, p < .001). Multifaceted schools reported higher scores for all mediators after nine months compared to schools receiving the discrete strategy. The effect of the multifaceted strategy on fidelity was partially mediated by all TDF mediators (p = < .05) except for beliefs about consequences. Capability-related mediators, including skills (Proportion-mediated = 41%, p = < .01) and behavioral regulation (Proportion-mediated = 35%, p = < .001), accounted for the largest proportion of the effect, followed by the motivation-related mediator goals (Proportion-mediated = 34%, p = < .01).</p><p><strong>Conclusions: </strong>The multifaceted strategy improved guideline fidelity by enhancing capability, opportunity, and motivation confirming the proposed function of COM-B. This study addresses calls for experimental evidence on how multifaceted implementation strategies achieve implementation outcomes.</p><p><strong>Trial registration: </strong>ClinicalTrials.org dr.nr 2020-01214.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"20 1","pages":"25"},"PeriodicalIF":8.8,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12123991/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144188527","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}