Pub Date : 2024-06-03DOI: 10.1186/s13012-024-01363-x
Laramie R Smith, Amaya Perez-Brumer, Melanie Nicholls, Jayla Harris, Qiana Allen, Alan Padilla, Autumn Yates, Eliza Samore, Rebecca Kennedy, Irene Kuo, Jordan E Lake, Cecile Denis, David Goodman-Meza, Peter Davidson, Steve Shoptaw, Nabila El-Bassel
Background: HIV burden in the US among people who inject drugs (PWID) is driven by overlapping syndemic factors such as co-occurring health needs and environmental factors that synergize to produce worse health outcomes among PWID. This includes stigma, poverty, and limited healthcare access (e.g. medication to treat/prevent HIV and for opioid use disorder [MOUD]). Health services to address these complex needs, when they exist, are rarely located in proximity to each other or to the PWID who need them. Given the shifting drug use landscapes and geographic heterogeneity in the US, we evaluate a data-driven approach to guide the delivery of such services to PWID in local communities.
Methods: We used a hybrid, type I, embedded, mixed method, data-driven approach to identify and characterize viable implementation neighborhoods for the HPTN 094 complex intervention, delivering integrated MOUD and HIV treatment/prevention through a mobile unit to PWID across five US cities. Applying the PRISM framework, we triangulated geographic and observational pre-implementation phase data (epidemiological overdose and HIV surveillance data) with two years of implementation phase data (weekly ecological assessments, study protocol meetings) to characterize environmental factors that affected the viability of implementation neighborhoods over time and across diverse settings.
Results: Neighborhood-level drug use and geographic diversity alongside shifting socio-political factors (policing, surveillance, gentrification) differentially affected the utility of epidemiological data in identifying viable implementation neighborhoods across sites. In sites where PWID are more geographically dispersed, proximity to structural factors such as public transportation and spaces where PWID reside played a role in determining suitable implementation sites. The utility of leveraging additional data from local overdose and housing response systems to identify viable implementation neighborhoods was mixed.
Conclusions: Our findings suggest that data-driven approaches provide a contextually relevant pragmatic strategy to guide the real-time implementation of integrated care models to better meet the needs of PWID and help inform the scale-up of such complex interventions. This work highlights the utility of implementation science methods that attend to the impact of local community environmental factors on the implementation of complex interventions to PWID across diverse drug use, sociopolitical, and geographic landscapes in the US.
{"title":"A data-driven approach to implementing the HPTN 094 complex intervention INTEGRA in local communities.","authors":"Laramie R Smith, Amaya Perez-Brumer, Melanie Nicholls, Jayla Harris, Qiana Allen, Alan Padilla, Autumn Yates, Eliza Samore, Rebecca Kennedy, Irene Kuo, Jordan E Lake, Cecile Denis, David Goodman-Meza, Peter Davidson, Steve Shoptaw, Nabila El-Bassel","doi":"10.1186/s13012-024-01363-x","DOIUrl":"10.1186/s13012-024-01363-x","url":null,"abstract":"<p><strong>Background: </strong>HIV burden in the US among people who inject drugs (PWID) is driven by overlapping syndemic factors such as co-occurring health needs and environmental factors that synergize to produce worse health outcomes among PWID. This includes stigma, poverty, and limited healthcare access (e.g. medication to treat/prevent HIV and for opioid use disorder [MOUD]). Health services to address these complex needs, when they exist, are rarely located in proximity to each other or to the PWID who need them. Given the shifting drug use landscapes and geographic heterogeneity in the US, we evaluate a data-driven approach to guide the delivery of such services to PWID in local communities.</p><p><strong>Methods: </strong>We used a hybrid, type I, embedded, mixed method, data-driven approach to identify and characterize viable implementation neighborhoods for the HPTN 094 complex intervention, delivering integrated MOUD and HIV treatment/prevention through a mobile unit to PWID across five US cities. Applying the PRISM framework, we triangulated geographic and observational pre-implementation phase data (epidemiological overdose and HIV surveillance data) with two years of implementation phase data (weekly ecological assessments, study protocol meetings) to characterize environmental factors that affected the viability of implementation neighborhoods over time and across diverse settings.</p><p><strong>Results: </strong>Neighborhood-level drug use and geographic diversity alongside shifting socio-political factors (policing, surveillance, gentrification) differentially affected the utility of epidemiological data in identifying viable implementation neighborhoods across sites. In sites where PWID are more geographically dispersed, proximity to structural factors such as public transportation and spaces where PWID reside played a role in determining suitable implementation sites. The utility of leveraging additional data from local overdose and housing response systems to identify viable implementation neighborhoods was mixed.</p><p><strong>Conclusions: </strong>Our findings suggest that data-driven approaches provide a contextually relevant pragmatic strategy to guide the real-time implementation of integrated care models to better meet the needs of PWID and help inform the scale-up of such complex interventions. This work highlights the utility of implementation science methods that attend to the impact of local community environmental factors on the implementation of complex interventions to PWID across diverse drug use, sociopolitical, and geographic landscapes in the US.</p><p><strong>Trial registration: </strong>ClincalTrials.gov, Registration Number: NCT04804072 . Registered 18 February 2021.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"39"},"PeriodicalIF":8.8,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11149235/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141236434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-29DOI: 10.1186/s13012-024-01367-7
Christopher W. Reynolds, Phillip J. Hsu, Dana Telem
Humanitarian assistance is hindered by a lack of strategies to optimize care delivery through research and organized networks. Distinct from global health, humanitarian assistance struggles to address its multifaceted challenges, including duplicative resources, uncoordinated communication, unregulated staff expertise and safety, financial waste, and poor-quality metrics and care delivery. Implementation science provides an exciting and underutilized approach that can be applied to address these challenges, by studying how to effectively design, implement, optimize, and scale evidence-based interventions. Though successful in well-resourced and global health systems, implementation science approaches are rare in humanitarian assistance. Adopting implementation science approaches including identifying determinants, creating accessible evidence-based intervention bundles, adapting study methodologies for the humanitarian context, and partnering with implementation experts could make these promising approaches more accessible for thousands of humanitarian actors delivering healthcare for millions of vulnerable patients worldwide.
{"title":"Implementation science in humanitarian assistance: applying a novel approach for humanitarian care optimization","authors":"Christopher W. Reynolds, Phillip J. Hsu, Dana Telem","doi":"10.1186/s13012-024-01367-7","DOIUrl":"https://doi.org/10.1186/s13012-024-01367-7","url":null,"abstract":"Humanitarian assistance is hindered by a lack of strategies to optimize care delivery through research and organized networks. Distinct from global health, humanitarian assistance struggles to address its multifaceted challenges, including duplicative resources, uncoordinated communication, unregulated staff expertise and safety, financial waste, and poor-quality metrics and care delivery. Implementation science provides an exciting and underutilized approach that can be applied to address these challenges, by studying how to effectively design, implement, optimize, and scale evidence-based interventions. Though successful in well-resourced and global health systems, implementation science approaches are rare in humanitarian assistance. Adopting implementation science approaches including identifying determinants, creating accessible evidence-based intervention bundles, adapting study methodologies for the humanitarian context, and partnering with implementation experts could make these promising approaches more accessible for thousands of humanitarian actors delivering healthcare for millions of vulnerable patients worldwide.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"12 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141166818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-28DOI: 10.1186/s13012-024-01365-9
Michael Sykes, Zahava R S Rosenberg-Yunger, Matthew Quigley, Lavanya Gupta, Owen Thomas, Lisa Robinson, Karen Caulfield, Noah Ivers, Sarah Alderson
Background: Policymakers and researchers recommend supporting the capabilities of feedback recipients to increase the quality of care. There are different ways to support capabilities. We aimed to describe the content and delivery of feedback facilitation interventions delivered alongside audit and feedback within randomised controlled trials.
Methods: We included papers describing feedback facilitation identified by the latest Cochrane review of audit and feedback. The piloted extraction proforma was based upon a framework to describe intervention content, with additional prompts relating to the identification of influences, selection of improvement actions and consideration of priorities and implications. We describe the content and delivery graphically, statistically and narratively.
Results: We reviewed 146 papers describing 104 feedback facilitation interventions. Across included studies, feedback facilitation contained 26 different implementation strategies. There was a median of three implementation strategies per intervention and evidence that the number of strategies per intervention is increasing. Theory was used in 35 trials, although the precise role of theory was poorly described. Ten studies provided a logic model and six of these described their mechanisms of action. Both the exploration of influences and the selection of improvement actions were described in 46 of the feedback facilitation interventions; we describe who undertook this tailoring work. Exploring dose, there was large variation in duration (15-1800 min), frequency (1 to 42 times) and number of recipients per site (1 to 135). There were important gaps in reporting, but some evidence that reporting is improving over time.
Conclusions: Heterogeneity in the design of feedback facilitation needs to be considered when assessing the intervention's effectiveness. We describe explicit feedback facilitation choices for future intervention developers based upon choices made to date. We found the Expert Recommendations for Implementing Change to be valuable when describing intervention components, with the potential for some minor clarifications in terms and for greater specificity by intervention providers. Reporting demonstrated extensive gaps which hinder both replication and learning. Feedback facilitation providers are recommended to close reporting gaps that hinder replication. Future work should seek to address the 'opportunity' for improvement activity, defined as factors that lie outside the individual that make care or improvement behaviour possible.
Review registration: The study protocol was published at: https://www.protocols.io/private/4DA5DE33B68E11ED9EF70A58A9FEAC02 .
{"title":"Exploring the content and delivery of feedback facilitation co-interventions: a systematic review.","authors":"Michael Sykes, Zahava R S Rosenberg-Yunger, Matthew Quigley, Lavanya Gupta, Owen Thomas, Lisa Robinson, Karen Caulfield, Noah Ivers, Sarah Alderson","doi":"10.1186/s13012-024-01365-9","DOIUrl":"10.1186/s13012-024-01365-9","url":null,"abstract":"<p><strong>Background: </strong>Policymakers and researchers recommend supporting the capabilities of feedback recipients to increase the quality of care. There are different ways to support capabilities. We aimed to describe the content and delivery of feedback facilitation interventions delivered alongside audit and feedback within randomised controlled trials.</p><p><strong>Methods: </strong>We included papers describing feedback facilitation identified by the latest Cochrane review of audit and feedback. The piloted extraction proforma was based upon a framework to describe intervention content, with additional prompts relating to the identification of influences, selection of improvement actions and consideration of priorities and implications. We describe the content and delivery graphically, statistically and narratively.</p><p><strong>Results: </strong>We reviewed 146 papers describing 104 feedback facilitation interventions. Across included studies, feedback facilitation contained 26 different implementation strategies. There was a median of three implementation strategies per intervention and evidence that the number of strategies per intervention is increasing. Theory was used in 35 trials, although the precise role of theory was poorly described. Ten studies provided a logic model and six of these described their mechanisms of action. Both the exploration of influences and the selection of improvement actions were described in 46 of the feedback facilitation interventions; we describe who undertook this tailoring work. Exploring dose, there was large variation in duration (15-1800 min), frequency (1 to 42 times) and number of recipients per site (1 to 135). There were important gaps in reporting, but some evidence that reporting is improving over time.</p><p><strong>Conclusions: </strong>Heterogeneity in the design of feedback facilitation needs to be considered when assessing the intervention's effectiveness. We describe explicit feedback facilitation choices for future intervention developers based upon choices made to date. We found the Expert Recommendations for Implementing Change to be valuable when describing intervention components, with the potential for some minor clarifications in terms and for greater specificity by intervention providers. Reporting demonstrated extensive gaps which hinder both replication and learning. Feedback facilitation providers are recommended to close reporting gaps that hinder replication. Future work should seek to address the 'opportunity' for improvement activity, defined as factors that lie outside the individual that make care or improvement behaviour possible.</p><p><strong>Review registration: </strong>The study protocol was published at: https://www.protocols.io/private/4DA5DE33B68E11ED9EF70A58A9FEAC02 .</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"37"},"PeriodicalIF":8.8,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11134935/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141162906","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-27DOI: 10.1186/s13012-024-01364-w
Yanchen Zhang, Madeline Larson, Mark G Ehrhart, Kevin King, Jill Locke, Clayton R Cook, Aaron R Lyon
Background: Integrated care involves care provided by a team of professionals, often in non-traditional settings. A common example worldwide is integrated school-based mental health (SBMH), which involves externally employed clinicians providing care at schools. Integrated mental healthcare can improve the accessibility and efficiency of evidence-based practices (EBPs) for vulnerable populations suffering from fragmented traditional care. However, integration can complicate EBP implementation due to overlapping organizational contexts, diminishing the public health impact. Emerging literature suggests that EBP implementation may benefit from the similarities in the implementation context factors between the different organizations in integrated care, which we termed inter-organizational alignment (IOA). This study quantitatively explored whether and how IOA in general and implementation context factors are associated with implementation outcomes in integrated SBMH.
Methods: SBMH clinicians from community-based organizations (CBOs; nclinician = 27) and their proximal student-support school staff (nschool = 99) rated their schools and CBOs (clinician only) regarding general (organizational culture and molar climate) and implementation context factors (Implementation Climate and Leadership), and nine common implementation outcomes (e.g., treatment integrity, service access, acceptability). The levels of IOA were estimated by intra-class correlations (ICCs). We fitted multilevel models to estimate the standalone effects of context factors from CBOs and schools on implementation outcomes. We also estimated the 2-way interaction effects between CBO and school context factors (i.e., between-setting interdependence) on implementation outcomes.
Results: The IOA in general context factors exceeded those of implementation context factors. The standalone effects of implementation context factors on most implementation outcomes were larger than those of general context factors. Similarly, implementation context factors between CBOs and schools showed larger 2-way interaction effects on implementation outcomes than general context factors.
Conclusions: This study preliminarily supported the importance of IOA in context factors for integrated SBMH. The findings shed light on how IOA in implementation and general context factors may be differentially associated with implementation outcomes across a broad array of integrated mental healthcare settings.
{"title":"Inter-organizational alignment and implementation outcomes in integrated mental healthcare for children and adolescents: a cross-sectional observational study.","authors":"Yanchen Zhang, Madeline Larson, Mark G Ehrhart, Kevin King, Jill Locke, Clayton R Cook, Aaron R Lyon","doi":"10.1186/s13012-024-01364-w","DOIUrl":"10.1186/s13012-024-01364-w","url":null,"abstract":"<p><strong>Background: </strong>Integrated care involves care provided by a team of professionals, often in non-traditional settings. A common example worldwide is integrated school-based mental health (SBMH), which involves externally employed clinicians providing care at schools. Integrated mental healthcare can improve the accessibility and efficiency of evidence-based practices (EBPs) for vulnerable populations suffering from fragmented traditional care. However, integration can complicate EBP implementation due to overlapping organizational contexts, diminishing the public health impact. Emerging literature suggests that EBP implementation may benefit from the similarities in the implementation context factors between the different organizations in integrated care, which we termed inter-organizational alignment (IOA). This study quantitatively explored whether and how IOA in general and implementation context factors are associated with implementation outcomes in integrated SBMH.</p><p><strong>Methods: </strong>SBMH clinicians from community-based organizations (CBOs; n<sub>clinician</sub> = 27) and their proximal student-support school staff (n<sub>school</sub> = 99) rated their schools and CBOs (clinician only) regarding general (organizational culture and molar climate) and implementation context factors (Implementation Climate and Leadership), and nine common implementation outcomes (e.g., treatment integrity, service access, acceptability). The levels of IOA were estimated by intra-class correlations (ICCs). We fitted multilevel models to estimate the standalone effects of context factors from CBOs and schools on implementation outcomes. We also estimated the 2-way interaction effects between CBO and school context factors (i.e., between-setting interdependence) on implementation outcomes.</p><p><strong>Results: </strong>The IOA in general context factors exceeded those of implementation context factors. The standalone effects of implementation context factors on most implementation outcomes were larger than those of general context factors. Similarly, implementation context factors between CBOs and schools showed larger 2-way interaction effects on implementation outcomes than general context factors.</p><p><strong>Conclusions: </strong>This study preliminarily supported the importance of IOA in context factors for integrated SBMH. The findings shed light on how IOA in implementation and general context factors may be differentially associated with implementation outcomes across a broad array of integrated mental healthcare settings.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"36"},"PeriodicalIF":8.8,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11129427/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141157652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-24DOI: 10.1186/s13012-024-01366-8
Halldóra Ögmundsdóttir Michelsen, Matthias Lidin, Maria Bäck, Therese Scott Duncan, Björn Ekman, Emil Hagström, Maria Hägglund, Bertil Lindahl, Mona Schlyter, Margrét Leósdóttir
Background: Providing secondary prevention through structured and comprehensive cardiac rehabilitation programmes to patients after a myocardial infarction (MI) reduces mortality and morbidity and improves health-related quality of life. Cardiac rehabilitation has the highest recommendation in current guidelines. While treatment target attainment rates at Swedish cardiac rehabilitation centres is among the highest in Europe, there are considerable differences in service delivery and variations in patient-level outcomes between centres. In this trial, we aim to study whether centre-level guideline adherence and patient-level outcomes across Swedish cardiac rehabilitation centres can be improved through a) regular audit and feedback of cardiac rehabilitation structure and processes through a national quality registry and b) supporting cardiac rehabilitation centres in implementing guidelines on secondary prevention. Furthermore, we aim to evaluate the implementation process and costs.
Methods: The study is an open-label cluster-randomized effectiveness-implementation hybrid trial including all 78 cardiac rehabilitation centres (attending to approximately 10 000 MI patients/year) that report to the SWEDEHEART registry. The centres will be randomized 1:1:1 to three clusters: 1) reporting cardiac rehabilitation structure and process variables to SWEDEHEART every six months (audit intervention) and being offered implementation support to implement guidelines on secondary prevention (implementation support intervention); 2) audit intervention only; or 3) no intervention offered. Baseline cardiac rehabilitation structure and process variables will be collected. The primary outcome is an adherence score measuring centre-level adherence to secondary prevention guidelines. Secondary outcomes include patient-level secondary prevention risk factor goal attainment at one-year after MI and major adverse coronary outcomes for up to five-years post-MI. Implementation outcomes include barriers and facilitators to guideline adherence evaluated using semi-structured focus-group interviews and relevant questionnaires, as well as costs and cost-effectiveness assessed by a comparative health economic evaluation.
Discussion: Optimizing cardiac rehabilitation centres' delivery of services to meet standards set in guidelines may lead to improvement in cardiovascular risk factors, including lifestyle factors, and ultimately a decrease in morbidity and mortality after MI.
{"title":"The effect of audit and feedback and implementation support on guideline adherence and patient outcomes in cardiac rehabilitation: a study protocol for an open-label cluster-randomized effectiveness-implementation hybrid trial.","authors":"Halldóra Ögmundsdóttir Michelsen, Matthias Lidin, Maria Bäck, Therese Scott Duncan, Björn Ekman, Emil Hagström, Maria Hägglund, Bertil Lindahl, Mona Schlyter, Margrét Leósdóttir","doi":"10.1186/s13012-024-01366-8","DOIUrl":"10.1186/s13012-024-01366-8","url":null,"abstract":"<p><strong>Background: </strong>Providing secondary prevention through structured and comprehensive cardiac rehabilitation programmes to patients after a myocardial infarction (MI) reduces mortality and morbidity and improves health-related quality of life. Cardiac rehabilitation has the highest recommendation in current guidelines. While treatment target attainment rates at Swedish cardiac rehabilitation centres is among the highest in Europe, there are considerable differences in service delivery and variations in patient-level outcomes between centres. In this trial, we aim to study whether centre-level guideline adherence and patient-level outcomes across Swedish cardiac rehabilitation centres can be improved through a) regular audit and feedback of cardiac rehabilitation structure and processes through a national quality registry and b) supporting cardiac rehabilitation centres in implementing guidelines on secondary prevention. Furthermore, we aim to evaluate the implementation process and costs.</p><p><strong>Methods: </strong>The study is an open-label cluster-randomized effectiveness-implementation hybrid trial including all 78 cardiac rehabilitation centres (attending to approximately 10 000 MI patients/year) that report to the SWEDEHEART registry. The centres will be randomized 1:1:1 to three clusters: 1) reporting cardiac rehabilitation structure and process variables to SWEDEHEART every six months (audit intervention) and being offered implementation support to implement guidelines on secondary prevention (implementation support intervention); 2) audit intervention only; or 3) no intervention offered. Baseline cardiac rehabilitation structure and process variables will be collected. The primary outcome is an adherence score measuring centre-level adherence to secondary prevention guidelines. Secondary outcomes include patient-level secondary prevention risk factor goal attainment at one-year after MI and major adverse coronary outcomes for up to five-years post-MI. Implementation outcomes include barriers and facilitators to guideline adherence evaluated using semi-structured focus-group interviews and relevant questionnaires, as well as costs and cost-effectiveness assessed by a comparative health economic evaluation.</p><p><strong>Discussion: </strong>Optimizing cardiac rehabilitation centres' delivery of services to meet standards set in guidelines may lead to improvement in cardiovascular risk factors, including lifestyle factors, and ultimately a decrease in morbidity and mortality after MI.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov. Identifier: NCT05889416 . Registered 2023-03-23.</p>","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"35"},"PeriodicalIF":8.8,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11531121/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141094622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-07DOI: 10.1186/s13012-024-01361-z
Andrea L Nevedal, Marilla A Opra Widerquist, Caitlin M Reardon, Maria Arasim, George L Jackson, Brandolyn White, Madison Burns, Gemmae M Fix, Kathryn DeLaughter, Sarah L Cutrona, Allen L Gifford, Guneet K Jasuja, Timothy P Hogan, Heather A King, Blake Henderson, Laura J Damschroder
<p><strong>Background: </strong>The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility.</p><p><strong>Methods: </strong>A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment.</p><p><strong>Results: </strong>After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a "liminal" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support.</p><p><strong>Conclusions: </strong>We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.</
{"title":"Understanding pathways from implementation to sustainment: a longitudinal, mixed methods analysis of promising practices implemented in the Veterans Health Administration.","authors":"Andrea L Nevedal, Marilla A Opra Widerquist, Caitlin M Reardon, Maria Arasim, George L Jackson, Brandolyn White, Madison Burns, Gemmae M Fix, Kathryn DeLaughter, Sarah L Cutrona, Allen L Gifford, Guneet K Jasuja, Timothy P Hogan, Heather A King, Blake Henderson, Laura J Damschroder","doi":"10.1186/s13012-024-01361-z","DOIUrl":"10.1186/s13012-024-01361-z","url":null,"abstract":"<p><strong>Background: </strong>The Veterans Health Administration (VHA) is the United States largest learning health system. The Diffusion of Excellence (DoE) program is a large-scale model of diffusion that identifies and diffuses evidence-informed practices across VHA. During the period of 2016-2021, 57 evidence-informed practices were implemented across 82 VHA facilities. This setting provides a unique opportunity to understand sustainment determinants and pathways. Our objective was to characterize the longitudinal pathways of practices as they transition from initial implementation to long-term sustainment at each facility.</p><p><strong>Methods: </strong>A longitudinal, mixed-methods evaluation of 82 VHA facilities. Eighty-two facility representatives, chosen by leadership as points-of-contact for 57 DoE practices, were eligible for post-implementation interviews and annual sustainment surveys. Primary outcomes (implementation, sustainment), and secondary outcomes (institutionalization, effectiveness, anticipated sustainment) at four time-points were collected. We performed descriptive statistics and directed content analysis using Hailemariam et al.'s factors influencing sustainment.</p><p><strong>Results: </strong>After approximately five years post-implementation (e.g., 2021 sustainment outcomes), of the 82 facilities, about one-third fully sustained their practice compared to one-third that did not fully sustain their practice because it was in a \"liminal\" stage (neither sustained nor discontinued) or permanently discontinued. The remaining one-third of facilities had missing 2021 sustainment outcomes. A higher percentage of facilities (70%) had inconsistent primary outcomes (changing over time) compared to facilities (30%) with consistent primary outcomes (same over time). Thirty-four percent of facilities with sustained practices reported resilience since they overcame implementation and sustainment barriers. Facilities with sustained practices reported more positive secondary outcomes compared to those that did not sustain their practice. Key factors facilitating practice sustainment included: demonstrating practice effectiveness/benefit, sufficient organizational leadership, sufficient workforce, and adaptation/alignment with local context. Key factors hindering practice sustainment included: insufficient workforce, not able to maintain practice fidelity/integrity, critical incidents related to the COVID-19 pandemic, organizational leadership did not support sustainment of practice, and no ongoing support.</p><p><strong>Conclusions: </strong>We identified diverse pathways from implementation to sustainment, and our data underscore that initial implementation outcomes may not determine long-term sustainment outcomes. This longitudinal evaluation contributes to understanding impacts of the DoE program, including return on investment, achieving learning health system goals, and insights into achieving high-quality healthcare in VHA.</","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"19 1","pages":"34"},"PeriodicalIF":8.8,"publicationDate":"2024-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11075255/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140877890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-26DOI: 10.1186/s13012-024-01362-y
Nathan Hodson, Byron J. Powell, Per Nilsen, Rinad S. Beidas
Implementation science in health is an interdisciplinary field with an emphasis on supporting behavior change required when clinicians and other actors implement evidence-based practices within organizational constraints. Behavioral economics has emerged in parallel and works towards developing realistic models of how humans behave and categorizes a wide range of features of choices that can influence behavior. We argue that implementation science can be enhanced by the incorporation of approaches from behavioral economics. Main body First, we provide a general overview of implementation science and ways in which implementation science has been limited to date. Second, we review principles of behavioral economics and describe how concepts from BE have been successfully applied to healthcare including nudges deployed in the electronic health record. For example, de-implementation of low-value prescribing has been supported by changing the default in the electronic health record. We then describe what a behavioral economics lens offers to existing implementation science theories, models and frameworks, including rich and realistic models of human behavior, additional research methods such as pre-mortems and behavioral design, and low-cost and scalable implementation strategies. We argue that insights from behavioral economics can guide the design of implementation strategies and the interpretation of implementation studies. Key objections to incorporating behavioral economics are addressed, including concerns about sustainment and at what level the strategies work. Scholars should consider augmenting implementation science theories, models, and frameworks with relevant insights from behavioral economics. By drawing on these additional insights, implementation scientists have the potential to boost efforts to expand the provision and availability of high quality care.
{"title":"How can a behavioral economics lens contribute to implementation science?","authors":"Nathan Hodson, Byron J. Powell, Per Nilsen, Rinad S. Beidas","doi":"10.1186/s13012-024-01362-y","DOIUrl":"https://doi.org/10.1186/s13012-024-01362-y","url":null,"abstract":"Implementation science in health is an interdisciplinary field with an emphasis on supporting behavior change required when clinicians and other actors implement evidence-based practices within organizational constraints. Behavioral economics has emerged in parallel and works towards developing realistic models of how humans behave and categorizes a wide range of features of choices that can influence behavior. We argue that implementation science can be enhanced by the incorporation of approaches from behavioral economics. Main body First, we provide a general overview of implementation science and ways in which implementation science has been limited to date. Second, we review principles of behavioral economics and describe how concepts from BE have been successfully applied to healthcare including nudges deployed in the electronic health record. For example, de-implementation of low-value prescribing has been supported by changing the default in the electronic health record. We then describe what a behavioral economics lens offers to existing implementation science theories, models and frameworks, including rich and realistic models of human behavior, additional research methods such as pre-mortems and behavioral design, and low-cost and scalable implementation strategies. We argue that insights from behavioral economics can guide the design of implementation strategies and the interpretation of implementation studies. Key objections to incorporating behavioral economics are addressed, including concerns about sustainment and at what level the strategies work. Scholars should consider augmenting implementation science theories, models, and frameworks with relevant insights from behavioral economics. By drawing on these additional insights, implementation scientists have the potential to boost efforts to expand the provision and availability of high quality care.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"33 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140800680","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-16DOI: 10.1186/s13012-024-01360-0
Ine Huybrechts, Anja Declercq, Emily Verté, Peter Raeymaeckers, Sibyl Anthierens
Although the importance of context in implementation science is not disputed, knowledge about the actual impact of external context variables on implementation processes remains rather fragmented. Current frameworks, models, and studies merely describe macro-level barriers and facilitators, without acknowledging their dynamic character and how they impact and steer implementation. Including organizational theories in implementation frameworks could be a way of tackling this problem. In this study, we therefore investigate how organizational theories can contribute to our understanding of the ways in which external context variables shape implementation processes. We use the implementation process of goal-oriented primary care in Belgium as a case. A qualitative study using in-depth semi-structured interviews was conducted with actors from a variety of primary care organizations. Data was collected and analyzed with an iterative approach. We assessed the potential of four organizational theories to enrich our understanding of the impact of external context variables on implementation processes. The organizational theories assessed are as follows: institutional theory, resource dependency theory, network theory, and contingency theory. Data analysis was based on a combination of inductive and deductive thematic analysis techniques using NVivo 12. Institutional theory helps to understand mechanisms that steer and facilitate the implementation of goal-oriented care through regulatory and policy measures. For example, the Flemish government issued policy for facilitating more integrated, person-centered care by means of newly created institutions, incentives, expectations, and other regulatory factors. The three other organizational theories describe both counteracting or reinforcing mechanisms. The financial system hampers interprofessional collaboration, which is key for GOC. Networks between primary care providers and health and/or social care organizations on the one hand facilitate GOC, while on the other hand, technology to support interprofessional collaboration is lacking. Contingent variables such as the aging population and increasing workload and complexity within primary care create circumstances in which GOC is presented as a possible answer. Insights and propositions that derive from organizational theories can be utilized to expand our knowledge on how external context variables affect implementation processes. These insights can be combined with or integrated into existing implementation frameworks and models to increase their explanatory power.
{"title":"How does the external context affect an implementation processes? A qualitative study investigating the impact of macro-level variables on the implementation of goal-oriented primary care","authors":"Ine Huybrechts, Anja Declercq, Emily Verté, Peter Raeymaeckers, Sibyl Anthierens","doi":"10.1186/s13012-024-01360-0","DOIUrl":"https://doi.org/10.1186/s13012-024-01360-0","url":null,"abstract":"Although the importance of context in implementation science is not disputed, knowledge about the actual impact of external context variables on implementation processes remains rather fragmented. Current frameworks, models, and studies merely describe macro-level barriers and facilitators, without acknowledging their dynamic character and how they impact and steer implementation. Including organizational theories in implementation frameworks could be a way of tackling this problem. In this study, we therefore investigate how organizational theories can contribute to our understanding of the ways in which external context variables shape implementation processes. We use the implementation process of goal-oriented primary care in Belgium as a case. A qualitative study using in-depth semi-structured interviews was conducted with actors from a variety of primary care organizations. Data was collected and analyzed with an iterative approach. We assessed the potential of four organizational theories to enrich our understanding of the impact of external context variables on implementation processes. The organizational theories assessed are as follows: institutional theory, resource dependency theory, network theory, and contingency theory. Data analysis was based on a combination of inductive and deductive thematic analysis techniques using NVivo 12. Institutional theory helps to understand mechanisms that steer and facilitate the implementation of goal-oriented care through regulatory and policy measures. For example, the Flemish government issued policy for facilitating more integrated, person-centered care by means of newly created institutions, incentives, expectations, and other regulatory factors. The three other organizational theories describe both counteracting or reinforcing mechanisms. The financial system hampers interprofessional collaboration, which is key for GOC. Networks between primary care providers and health and/or social care organizations on the one hand facilitate GOC, while on the other hand, technology to support interprofessional collaboration is lacking. Contingent variables such as the aging population and increasing workload and complexity within primary care create circumstances in which GOC is presented as a possible answer. Insights and propositions that derive from organizational theories can be utilized to expand our knowledge on how external context variables affect implementation processes. These insights can be combined with or integrated into existing implementation frameworks and models to increase their explanatory power.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"90 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140577769","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-12DOI: 10.1186/s13012-024-01359-7
Petra Mäkelä, Annette Boaz, Kathryn Oliver
There has been a proliferation of frameworks with a common goal of bridging the gap between evidence, policy, and practice, but few aim to specifically guide evaluations of academic-policy engagement. We present the modification of an action framework for the purpose of selecting, developing and evaluating interventions for academic-policy engagement. We build on the conceptual work of an existing framework known as SPIRIT (Supporting Policy In Health with Research: an Intervention Trial), developed for the evaluation of strategies intended to increase the use of research in health policy. Our aim was to modify SPIRIT, (i) to be applicable beyond health policy contexts, for example encompassing social, environmental, and economic policy impacts and (ii) to address broader dynamics of academic-policy engagement. We used an iterative approach through literature reviews and consultation with multiple stakeholders from Higher Education Institutions (HEIs) and policy professionals working at different levels of government and across geographical contexts in England, alongside our evaluation activities in the Capabilities in Academic Policy Engagement (CAPE) programme. Our modifications expand upon Redman et al.’s original framework, for example adding a domain of ‘Impacts and Sustainability’ to capture continued activities required in the achievement of desirable outcomes. The modified framework fulfils the criteria for a useful action framework, having a clear purpose, being informed by existing understandings, being capable of guiding targeted interventions, and providing a structure to build further knowledge. The modified SPIRIT framework is designed to be meaningful and accessible for people working across varied contexts in the evidence-policy ecosystem. It has potential applications in how academic-policy engagement interventions might be developed, evaluated, facilitated and improved, to ultimately support the use of evidence in decision-making.
{"title":"A modified action framework to develop and evaluate academic-policy engagement interventions","authors":"Petra Mäkelä, Annette Boaz, Kathryn Oliver","doi":"10.1186/s13012-024-01359-7","DOIUrl":"https://doi.org/10.1186/s13012-024-01359-7","url":null,"abstract":"There has been a proliferation of frameworks with a common goal of bridging the gap between evidence, policy, and practice, but few aim to specifically guide evaluations of academic-policy engagement. We present the modification of an action framework for the purpose of selecting, developing and evaluating interventions for academic-policy engagement. We build on the conceptual work of an existing framework known as SPIRIT (Supporting Policy In Health with Research: an Intervention Trial), developed for the evaluation of strategies intended to increase the use of research in health policy. Our aim was to modify SPIRIT, (i) to be applicable beyond health policy contexts, for example encompassing social, environmental, and economic policy impacts and (ii) to address broader dynamics of academic-policy engagement. We used an iterative approach through literature reviews and consultation with multiple stakeholders from Higher Education Institutions (HEIs) and policy professionals working at different levels of government and across geographical contexts in England, alongside our evaluation activities in the Capabilities in Academic Policy Engagement (CAPE) programme. Our modifications expand upon Redman et al.’s original framework, for example adding a domain of ‘Impacts and Sustainability’ to capture continued activities required in the achievement of desirable outcomes. The modified framework fulfils the criteria for a useful action framework, having a clear purpose, being informed by existing understandings, being capable of guiding targeted interventions, and providing a structure to build further knowledge. The modified SPIRIT framework is designed to be meaningful and accessible for people working across varied contexts in the evidence-policy ecosystem. It has potential applications in how academic-policy engagement interventions might be developed, evaluated, facilitated and improved, to ultimately support the use of evidence in decision-making.","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"18 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140577939","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-09DOI: 10.1186/s13012-024-01355-x
Christina Johnson, Jinbo Chen, Mary P. McGowan, Eric Tricou, Mary Card, Amy R. Pettit, Tamar Klaiman, Daniel J. Rader, Kevin G. Volpp, Rinad S. Beidas
Familial hypercholesterolemia (FH) is a heritable disorder affecting 1.3 million individuals in the USA. Eighty percent of people with FH are undiagnosed, particularly minoritized populations including Black or African American people, Asian or Asian American people, and women across racial groups. Family cascade screening is an evidence-based practice that can increase diagnosis and improve health outcomes but is rarely implemented in routine practice, representing an important care gap. In pilot work, we leveraged best practices from behavioral economics and implementation science—including mixed-methods contextual inquiry with clinicians, patients, and health system constituents—to co-design two patient-facing implementation strategies to address this care gap: (a) an automated health system-mediated strategy and (b) a nonprofit foundation-mediated strategy with contact from a foundation-employed care navigator. This trial will test the comparative effectiveness of these strategies on completion of cascade screening for relatives of individuals with FH, centering equitable reach. We will conduct a hybrid effectiveness-implementation type III randomized controlled trial testing the comparative effectiveness of two strategies for implementing cascade screening with 220 individuals with FH (i.e., probands) per arm identified from a large northeastern health system. The primary implementation outcome is reach, or the proportion of probands with at least one first-degree biological relative (parent, sibling, child) in the USA who is screened for FH through the study. Our secondary implementation outcomes include the number of relatives screened and the number of relatives meeting the American Heart Association criteria for FH. Our secondary clinical effectiveness outcome is post-trial proband cholesterol level. We will also use mixed methods to identify implementation strategy mechanisms for implementation strategy effectiveness while centering equity. We will test two patient-facing implementation strategies harnessing insights from behavioral economics that were developed collaboratively with constituents. This trial will improve our understanding of how to implement evidence-based cascade screening for FH, which implementation strategies work, for whom, and why. Learnings from this trial can be used to equitably scale cascade screening programs for FH nationally and inform cascade screening implementation efforts for other genetic disorders. ClinicalTrials.gov, NCT05750667. Registered 15 February 2023—retrospectively registered, https://clinicaltrials.gov/study/NCT05750667 .
{"title":"Family cascade screening for equitable identification of familial hypercholesterolemia: study protocol for a hybrid effectiveness-implementation type III randomized controlled trial","authors":"Christina Johnson, Jinbo Chen, Mary P. McGowan, Eric Tricou, Mary Card, Amy R. Pettit, Tamar Klaiman, Daniel J. Rader, Kevin G. Volpp, Rinad S. Beidas","doi":"10.1186/s13012-024-01355-x","DOIUrl":"https://doi.org/10.1186/s13012-024-01355-x","url":null,"abstract":"Familial hypercholesterolemia (FH) is a heritable disorder affecting 1.3 million individuals in the USA. Eighty percent of people with FH are undiagnosed, particularly minoritized populations including Black or African American people, Asian or Asian American people, and women across racial groups. Family cascade screening is an evidence-based practice that can increase diagnosis and improve health outcomes but is rarely implemented in routine practice, representing an important care gap. In pilot work, we leveraged best practices from behavioral economics and implementation science—including mixed-methods contextual inquiry with clinicians, patients, and health system constituents—to co-design two patient-facing implementation strategies to address this care gap: (a) an automated health system-mediated strategy and (b) a nonprofit foundation-mediated strategy with contact from a foundation-employed care navigator. This trial will test the comparative effectiveness of these strategies on completion of cascade screening for relatives of individuals with FH, centering equitable reach. We will conduct a hybrid effectiveness-implementation type III randomized controlled trial testing the comparative effectiveness of two strategies for implementing cascade screening with 220 individuals with FH (i.e., probands) per arm identified from a large northeastern health system. The primary implementation outcome is reach, or the proportion of probands with at least one first-degree biological relative (parent, sibling, child) in the USA who is screened for FH through the study. Our secondary implementation outcomes include the number of relatives screened and the number of relatives meeting the American Heart Association criteria for FH. Our secondary clinical effectiveness outcome is post-trial proband cholesterol level. We will also use mixed methods to identify implementation strategy mechanisms for implementation strategy effectiveness while centering equity. We will test two patient-facing implementation strategies harnessing insights from behavioral economics that were developed collaboratively with constituents. This trial will improve our understanding of how to implement evidence-based cascade screening for FH, which implementation strategies work, for whom, and why. Learnings from this trial can be used to equitably scale cascade screening programs for FH nationally and inform cascade screening implementation efforts for other genetic disorders. ClinicalTrials.gov, NCT05750667. Registered 15 February 2023—retrospectively registered, https://clinicaltrials.gov/study/NCT05750667 .","PeriodicalId":54995,"journal":{"name":"Implementation Science","volume":"35 1","pages":""},"PeriodicalIF":7.2,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140577938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}