Pub Date : 2022-10-22eCollection Date: 2022-01-01DOI: 10.1177/26334895221131052
Karey L O'Hara, Lindsey M Knowles, Kate Guastaferro, Aaron R Lyon
Background: The public health impact of behavioral and biobehavioral interventions to prevent and treat mental health and substance use problems hinges on developing methods to strategically maximize their effectiveness, affordability, scalability, and efficiency.
Methods: The multiphase optimization strategy (MOST) is an innovative, principled framework that guides the development of multicomponent interventions. Each phase of MOST (Preparation, Optimization, Evaluation) has explicit goals and a range of appropriate research methods to achieve them. Methods for attaining Optimization and Evaluation phase goals are well-developed. However, methods used in the Preparation phase are often highly researcher-specific, and concrete ways to achieve Preparation phase goals are a priority area for further development.
Results: We propose that the discover, design, build, and test (DDBT) framework provides a theory-driven and methods-rich roadmap for achieving the goals of the Preparation phase of MOST, including specifying the conceptual model, identifying and testing candidate intervention components, and defining the optimization objective. The DDBT framework capitalizes on strategies from the field of human-centered design and implementation science to drive its data collection methods.
Conclusions: MOST and DDBT share many conceptual features, including an explicit focus on implementation determinants, being iterative and flexible, and designing interventions for the greatest public health impact. The proposed synthesized DDBT/MOST approach integrates DDBT into the Preparation phase of MOST thereby providing a framework for rigorous and efficient intervention development research to bolster the success of intervention optimization.
Plain language summary: 1. What is already known about the topic? Optimizing behavioral interventions to balance effectiveness with affordability, scalability, and efficiency requires a significant investment in intervention development.2. What does this paper add? This paper provides a structured approach to integrating human-centered design principles into the Preparation phase of the multiphase optimization strategy (MOST).3. What are the implications for practice, research, or policy? The proposed synthesized model provides a framework for rigorous and efficient intervention development research in the Preparation phase of MOST that will ensure the success of intervention optimization and contribute to improving public health impact of mental health and substance use interventions.
{"title":"Human-centered design methods to achieve preparation phase goals in the multiphase optimization strategy framework.","authors":"Karey L O'Hara, Lindsey M Knowles, Kate Guastaferro, Aaron R Lyon","doi":"10.1177/26334895221131052","DOIUrl":"10.1177/26334895221131052","url":null,"abstract":"<p><strong>Background: </strong>The public health impact of behavioral and biobehavioral interventions to prevent and treat mental health and substance use problems hinges on developing methods to strategically maximize their effectiveness, affordability, scalability, and efficiency.</p><p><strong>Methods: </strong>The multiphase optimization strategy (MOST) is an innovative, principled framework that guides the development of multicomponent interventions. Each phase of MOST (<i>Preparation</i>, <i>Optimization</i>, <i>Evaluation</i>) has explicit goals and a range of appropriate research methods to achieve them. Methods for attaining <i>Optimization</i> and <i>Evaluation</i> phase goals are well-developed. However, methods used in the <i>Preparation</i> phase are often highly researcher-specific, and concrete ways to achieve <i>Preparation</i> phase goals are a priority area for further development.</p><p><strong>Results: </strong>We propose that the discover, design, build, and test (DDBT) framework provides a theory-driven and methods-rich roadmap for achieving the goals of the <i>Preparation</i> phase of MOST, including specifying the conceptual model, identifying and testing candidate intervention components, and defining the optimization objective. The DDBT framework capitalizes on strategies from the field of human-centered design and implementation science to drive its data collection methods.</p><p><strong>Conclusions: </strong>MOST and DDBT share many conceptual features, including an explicit focus on implementation determinants, being iterative and flexible, and designing interventions for the greatest public health impact. The proposed synthesized DDBT/MOST approach integrates DDBT into the <i>Preparation</i> phase of MOST thereby providing a framework for rigorous and efficient intervention development research to bolster the success of intervention optimization.</p><p><strong>Plain language summary: </strong>1. <i>What is already known about the topic?</i> Optimizing behavioral interventions to balance effectiveness with affordability, scalability, and efficiency requires a significant investment in intervention development.2. <i>What does this paper add?</i> This paper provides a structured approach to integrating human-centered design principles into the <i>Preparation</i> phase of the multiphase optimization strategy (MOST).3. <i>What are the implications for practice, research, or policy?</i> The proposed synthesized model provides a framework for rigorous and efficient intervention development research in the <i>Preparation</i> phase of MOST that will ensure the success of intervention optimization and contribute to improving public health impact of mental health and substance use interventions.</p>","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221131052"},"PeriodicalIF":0.0,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/d0/4d/10.1177_26334895221131052.PMC9924242.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9444874","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-07-15eCollection Date: 2022-01-01DOI: 10.1177/26334895221112693
Daša Kokole, Eva Jané-Llopis, Guillermina Natera Rey, Natalia Bautista Aguilar, Perla Sonia Medina Aguilar, Juliana Mejía-Trujillo, Katherine Mora, Natalia Restrepo, Ines Bustamante, Marina Piazza, Amy O'Donnell, Adriana Solovei, Liesbeth Mercken, Christiane Sybille Schmidt, Hugo Lopez-Pelayo, Silvia Matrai, Fleur Braddick, Antoni Gual, Jürgen Rehm, Peter Anderson, Hein de Vries
Background: Initial results from the SCALA study demonstrated that training primary health care providers is an effective implementation strategy to increase alcohol screening in Colombia, Mexico and Peru, but did not show evidence of superior performance for the standard compared to the shorter training arm. This paper elaborates on those outcomes by examining the relationship of training-related process evaluation indicators with the alcohol screening practice.
Methods: A mix of convergent and exploratory mixed-methods design was employed. Data sources included training documentation, post-training questionnaires, observation forms, self-report forms and interviews. Available quantitative data were compared on outcome measure - providers' alcohol screening.
Results: Training reach was high: three hundred fifty-two providers (72.3% of all eligible) participated in one or more training or booster sessions. Country differences in session length reflected adaptation to previous topic knowledge and experience of the providers. Overall, 49% of attendees conducted alcohol screening in practice. A higher dose received was positively associated with screening, but there was no difference between standard and short training arms. Although the training sessions were well received by participants, satisfaction with training and perceived utility for practice were not associated with screening. Profession, but not age or gender, was associated with screening: in Colombia and Mexico, doctors and psychologists were more likely to screen (although the latter represented only a small proportion of the sample) and in Peru, only psychologists.
Conclusions: The SCALA training programme was well received by the participants and led to half of the participating providers conducting alcohol screening in their primary health care practice. The dose received and the professional role were the key factors associated with conducting the alcohol screening in practice.Plain Language Summary: Primary health care providers can play an important role in detecting heavy drinkers among their consulting patients, and training can be an effective implementation strategy to increase alcohol screening and detection. Existing training literature predominantly focuses on evaluating trainings in high-income countries, or evaluating their effectiveness rather than implementation. As part of SCALA (Scale-up of Prevention and Management of Alcohol Use Disorders in Latin America) study, we evaluated training as implementation strategy to increase alcohol screening in primary health care in a middle-income context. Overall, 72.3% of eligible providers attended the training and 49% of training attendees conducted alcohol screening in practice after attending the training. Our process evaluation suggests that simple intervention with sufficient time to practice, adapted to limited provider availab
{"title":"Training primary health care providers in Colombia, Mexico and Peru to increase alcohol screening: Mixed-methods process evaluation of implementation strategy.","authors":"Daša Kokole, Eva Jané-Llopis, Guillermina Natera Rey, Natalia Bautista Aguilar, Perla Sonia Medina Aguilar, Juliana Mejía-Trujillo, Katherine Mora, Natalia Restrepo, Ines Bustamante, Marina Piazza, Amy O'Donnell, Adriana Solovei, Liesbeth Mercken, Christiane Sybille Schmidt, Hugo Lopez-Pelayo, Silvia Matrai, Fleur Braddick, Antoni Gual, Jürgen Rehm, Peter Anderson, Hein de Vries","doi":"10.1177/26334895221112693","DOIUrl":"10.1177/26334895221112693","url":null,"abstract":"<p><strong>Background: </strong>Initial results from the SCALA study demonstrated that training primary health care providers is an effective implementation strategy to increase alcohol screening in Colombia, Mexico and Peru, but did not show evidence of superior performance for the standard compared to the shorter training arm. This paper elaborates on those outcomes by examining the relationship of training-related process evaluation indicators with the alcohol screening practice.</p><p><strong>Methods: </strong>A mix of convergent and exploratory mixed-methods design was employed. Data sources included training documentation, post-training questionnaires, observation forms, self-report forms and interviews. Available quantitative data were compared on outcome measure - providers' alcohol screening.</p><p><strong>Results: </strong>Training reach was high: three hundred fifty-two providers (72.3% of all eligible) participated in one or more training or booster sessions. Country differences in session length reflected adaptation to previous topic knowledge and experience of the providers. Overall, 49% of attendees conducted alcohol screening in practice. A higher dose received was positively associated with screening, but there was no difference between standard and short training arms. Although the training sessions were well received by participants, satisfaction with training and perceived utility for practice were not associated with screening. Profession, but not age or gender, was associated with screening: in Colombia and Mexico, doctors and psychologists were more likely to screen (although the latter represented only a small proportion of the sample) and in Peru, only psychologists.</p><p><strong>Conclusions: </strong>The SCALA training programme was well received by the participants and led to half of the participating providers conducting alcohol screening in their primary health care practice. The dose received and the professional role were the key factors associated with conducting the alcohol screening in practice.<b>Plain Language Summary:</b> Primary health care providers can play an important role in detecting heavy drinkers among their consulting patients, and training can be an effective implementation strategy to increase alcohol screening and detection. Existing training literature predominantly focuses on evaluating trainings in high-income countries, or evaluating their effectiveness rather than implementation. As part of SCALA (Scale-up of Prevention and Management of Alcohol Use Disorders in Latin America) study, we evaluated training as implementation strategy to increase alcohol screening in primary health care in a middle-income context. Overall, 72.3% of eligible providers attended the training and 49% of training attendees conducted alcohol screening in practice after attending the training. Our process evaluation suggests that simple intervention with sufficient time to practice, adapted to limited provider availab","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221112693"},"PeriodicalIF":0.0,"publicationDate":"2022-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9924276/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-06-07eCollection Date: 2022-01-01DOI: 10.1177/26334895221101214
Ariel Ludwig, Laura B Monico, Thomas Blue, Michael S Gordon, Robert P Schwartz, Shannon Gwin Mitchell
Background: In light of short lengths of stay and proximity to communities of release, jails are well-positioned to intervene in opioid use disorder (OUD). However, a number of barriers have resulted in a slow and limited implementation.
Methods: This paper describes the development and testing of a Medication for Opioid Use Disorder (MOUD) Implementation Checklist developed as part of a Building Bridges project, a two-year planning grant which supported 16 US jail systems as they prepared to implement or expand MOUD services.
Results: Although initially developed to track changes within sites participating in the initiative, participants noted its utility for identifying evidence-based benchmarks through which the successful implementation of MOUDs could be tracked by correctional administrators.
Conclusions: The findings suggest that this checklist can both help guide and illustrate progress toward vital changes facilitated through established processes and supports.
Plain language summary: People incarcerated in jails are more likely to have opioid use disorder than the general population. Despite this, jails in the United States (U.S.) often offer limited or no access to Medication for Opioid Use Disorder (MOUD). The Building Bridges project was designed to address this gap in 16 U.S. jail systems as they prepared to implement or expand MOUD services. This article addresses the use of a MOUD checklist that was initially designed to help the jails track changes toward evidence-based benchmarks. The findings suggest that this checklist can both help guide and illustrate progress toward vital changes facilitated through established processes and supports.
{"title":"Development and use of a checklist for the implementation of medication for opioid use disorder in jails.","authors":"Ariel Ludwig, Laura B Monico, Thomas Blue, Michael S Gordon, Robert P Schwartz, Shannon Gwin Mitchell","doi":"10.1177/26334895221101214","DOIUrl":"10.1177/26334895221101214","url":null,"abstract":"<p><strong>Background: </strong>In light of short lengths of stay and proximity to communities of release, jails are well-positioned to intervene in opioid use disorder (OUD). However, a number of barriers have resulted in a slow and limited implementation.</p><p><strong>Methods: </strong>This paper describes the development and testing of a Medication for Opioid Use Disorder (MOUD) Implementation Checklist developed as part of a Building Bridges project, a two-year planning grant which supported 16 US jail systems as they prepared to implement or expand MOUD services.</p><p><strong>Results: </strong>Although initially developed to track changes within sites participating in the initiative, participants noted its utility for identifying evidence-based benchmarks through which the successful implementation of MOUDs could be tracked by correctional administrators.</p><p><strong>Conclusions: </strong>The findings suggest that this checklist can both help guide and illustrate progress toward vital changes facilitated through established processes and supports.</p><p><strong>Plain language summary: </strong>People incarcerated in jails are more likely to have opioid use disorder than the general population. Despite this, jails in the United States (U.S.) often offer limited or no access to Medication for Opioid Use Disorder (MOUD). The Building Bridges project was designed to address this gap in 16 U.S. jail systems as they prepared to implement or expand MOUD services. This article addresses the use of a MOUD checklist that was initially designed to help the jails track changes toward evidence-based benchmarks. The findings suggest that this checklist can both help guide and illustrate progress toward vital changes facilitated through established processes and supports.</p>","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221101214"},"PeriodicalIF":0.0,"publicationDate":"2022-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/91/6d/10.1177_26334895221101214.PMC9924266.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9393576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: There is growing interest in the lived experience of professionals who provide implementation support (i.e., implementation support practitioners). However, there remains limited knowledge about their experiences and how those experiences can contribute to the knowledge base on what constitutes successful and sustainable implementation support models. This study aimed to examine pathways of implementation support practice, as described by experienced professionals actively supporting systems' uptake and sustainment of evidence to benefit children and families. Methods: Seventeen individuals with extensive experience providing implementation support in various settings participated in semi-structured interviews. Data were analyzed using qualitative content analysis and episode profile analysis approaches. Iterative diagramming was used to visualize the various pathways of implementation support practitioners' role reflection and transformation evidenced by the interview data. Results: Findings highlighted rich pathways of implementation support practitioners' role reflection and transformation. Participants described their roots in providing implementation support as it relates to implementing and expanding the use of evidence-based programs and practices in child and family services. Almost all participants reflected on the early stages of their careers providing implementation support and described a trajectory starting with the use of "push models," which evolved into "pull models" and eventually "co-creation or exchange models" of implementation support involving both technical and relational skills. Conclusions: Developing an implementation support workforce will require a deeper understanding of this lived experience to prevent repeated use of strategies observed to be unsuccessful by those most proximal to the work. The pathways for implementation practice in this study highlight impressive leaps forward in the field of implementation over the last 15 years and speaks to the importance of the professionals leading change efforts in this growth.
Plain language summary: Over the past few years, professionals in the field of implementation science have identified a growing gap between implementation research and implementation practice. While this issue has been highlighted informally, the field is lacking a shared understanding and clear way forward to reconcile this gap. In this paper, the authors describe how professionals providing implementation support have shifted their implementation practice over time through systematic observations of what works (and what does not work) for supporting and sustaining evidence use in service systems to improve population outcomes. The authors share the impressive leaps forward made in the field of implementation practice - from didactic training to responsive and tailored implementation strategies to co-created and relationship-based
{"title":"Is implementation research out of step with implementation practice? Pathways to effective implementation support over the last decade.","authors":"Allison Metz, Todd Jensen, Amanda Farley, Annette Boaz","doi":"10.1177/26334895221105585","DOIUrl":"10.1177/26334895221105585","url":null,"abstract":"<p><p><b>Background:</b> There is growing interest in the lived experience of professionals who provide implementation support (i.e., implementation support practitioners). However, there remains limited knowledge about their experiences and how those experiences can contribute to the knowledge base on what constitutes successful and sustainable implementation support models. This study aimed to examine pathways of implementation support practice, as described by experienced professionals actively supporting systems' uptake and sustainment of evidence to benefit children and families. <b>Methods:</b> Seventeen individuals with extensive experience providing implementation support in various settings participated in semi-structured interviews. Data were analyzed using qualitative content analysis and episode profile analysis approaches. Iterative diagramming was used to visualize the various pathways of implementation support practitioners' role reflection and transformation evidenced by the interview data. <b>Results:</b> Findings highlighted rich pathways of implementation support practitioners' role reflection and transformation. Participants described their roots in providing implementation support as it relates to implementing and expanding the use of evidence-based programs and practices in child and family services. Almost all participants reflected on the early stages of their careers providing implementation support and described a trajectory starting with the use of \"push models,\" which evolved into \"pull models\" and eventually \"co-creation or exchange models\" of implementation support involving both technical and relational skills. <b>Conclusions:</b> Developing an implementation support workforce will require a deeper understanding of this lived experience to prevent repeated use of strategies observed to be unsuccessful by those most proximal to the work. The pathways for implementation practice in this study highlight impressive leaps forward in the field of implementation over the last 15 years and speaks to the importance of the professionals leading change efforts in this growth.</p><p><strong>Plain language summary: </strong>Over the past few years, professionals in the field of implementation science have identified a growing gap between implementation research and implementation practice. While this issue has been highlighted informally, the field is lacking a shared understanding and clear way forward to reconcile this gap. In this paper, the authors describe how professionals providing implementation support have shifted their implementation practice over time through systematic observations of what works (and what does not work) for supporting and sustaining evidence use in service systems to improve population outcomes. The authors share the impressive leaps forward made in the field of implementation practice - from didactic training to responsive and tailored implementation strategies to co-created and relationship-based ","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221105585"},"PeriodicalIF":0.0,"publicationDate":"2022-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9978647/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-06-06eCollection Date: 2022-01-01DOI: 10.1177/26334895221105568
Aidan G Cashin, James H McAuley, Hopin Lee
Well-conducted mediation analyses have the potential to move implementation science forward by better understanding how or why implementation strategies cause their effects on outcomes. The AGReMA statement provides authors with recommendations for reporting primary and secondary mediation analyses of randomized trials and observational studies. Improved reporting of studies that use mediation analyses could help produce publications that are complete, accurate, transparent, and reproducible.
{"title":"Advancing the reporting of mechanisms in implementation science: A guideline for reporting mediation analyses (AGReMA).","authors":"Aidan G Cashin, James H McAuley, Hopin Lee","doi":"10.1177/26334895221105568","DOIUrl":"10.1177/26334895221105568","url":null,"abstract":"<p><p>Well-conducted mediation analyses have the potential to move implementation science forward by better understanding how or why implementation strategies cause their effects on outcomes. The AGReMA statement provides authors with recommendations for reporting primary and secondary mediation analyses of randomized trials and observational studies. Improved reporting of studies that use mediation analyses could help produce publications that are complete, accurate, transparent, and reproducible.</p>","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221105568"},"PeriodicalIF":0.0,"publicationDate":"2022-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/2a/98/10.1177_26334895221105568.PMC9924271.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9393573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-04-28eCollection Date: 2022-01-01DOI: 10.1177/26334895221096289
Melina A Economou, Bonnie N Kaiser, Sara W Yoeun, Erika L Crable, Sara B McMenamin
Background: In 2016, the California Department of Healthcare Services (DHCS) released an "All Plan Letter" (APL 16-014) to its Medicaid managed care plans (MCPs) providing guidance on implementing tobacco-cessation coverage among Medicaid beneficiaries. However, implementation remains poor. We apply the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to identify barriers and facilitators to fidelity to APL 16-014 across California Medicaid MCPs.
Methods: We assessed fidelity through semi-structured interviews with MCP health educators (N = 24). Interviews were recorded, transcribed, and reviewed to develop initial themes regarding barriers and facilitators to implementation. Initial thematic summaries were discussed and mapped onto EPIS constructs.
Results: The APL (Innovation) was described as lacking clarity and specificity in its guidelines, hindering implementation. Related to the Inner Context, MCPs described the APL as beyond the scope of their resources, pointing to their own lack of educational materials, human resources, and poor technological infrastructure as implementation barriers. In the Outer Context, MCPs identified a lack of incentives for providers and beneficiaries to offer and participate in tobacco-cessation programs, respectively. A lack of communication, educational materials, and training resources between the state and MCPs (missing Bridging Factors) were barriers to preventing MCPs from identifying smoking rates or gauging success of tobacco-cessation efforts. Facilitators included several MCPs collaborating with each other and using external resources to promote tobacco cessation. Additionally, a few MCPs used fidelity monitoring staff as Bridging Factors to facilitate provider training, track providers' identification of smokers, and follow-up with beneficiaries participating in tobacco-cessation programs.
Conclusions: The release of the evidence-based APL 16-014 by California's DHCS was an important step forward in promoting tobacco-cessation services for Medicaid MCP beneficiaries. Improved communication on implementation in different environments and improved Bridging Factors such as incentives for providers and patients are needed to fully realize policy goals.
Plan language summary: In 2016, the California Department of Healthcare Services (DHCS) in California released an "All Plan Letter" (APL 16-014) to its Medicaid managed care plans (MCPs) providing guidance on implementing tobacco-cessation coverage to address tobacco use among Medicaid beneficiaries. We conducted semi-structured interviews with health educators in California Medicaid MCPs to explore the barriers and facilitators to implementing the APL using the Exploration, Preparation, Implementation, Sustainment framework. According to MCPs, barriers included a lack of clarity in the APL guidelines; a lack of resour
{"title":"Applying the EPIS framework to policy-level considerations: Tobacco cessation policy implementation among California Medicaid managed care plans.","authors":"Melina A Economou, Bonnie N Kaiser, Sara W Yoeun, Erika L Crable, Sara B McMenamin","doi":"10.1177/26334895221096289","DOIUrl":"10.1177/26334895221096289","url":null,"abstract":"<p><strong>Background: </strong>In 2016, the California Department of Healthcare Services (DHCS) released an \"All Plan Letter\" (APL 16-014) to its Medicaid managed care plans (MCPs) providing guidance on implementing tobacco-cessation coverage among Medicaid beneficiaries. However, implementation remains poor. We apply the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to identify barriers and facilitators to fidelity to APL 16-014 across California Medicaid MCPs.</p><p><strong>Methods: </strong>We assessed fidelity through semi-structured interviews with MCP health educators (<i>N</i> = 24). Interviews were recorded, transcribed, and reviewed to develop initial themes regarding barriers and facilitators to implementation. Initial thematic summaries were discussed and mapped onto EPIS constructs.</p><p><strong>Results: </strong>The APL (Innovation) was described as lacking clarity and specificity in its guidelines, hindering implementation. Related to the Inner Context, MCPs described the APL as beyond the scope of their resources, pointing to their own lack of educational materials, human resources, and poor technological infrastructure as implementation barriers. In the Outer Context, MCPs identified a lack of incentives for providers and beneficiaries to offer and participate in tobacco-cessation programs, respectively. A lack of communication, educational materials, and training resources between the state and MCPs (missing Bridging Factors) were barriers to preventing MCPs from identifying smoking rates or gauging success of tobacco-cessation efforts. Facilitators included several MCPs collaborating with each other and using external resources to promote tobacco cessation. Additionally, a few MCPs used fidelity monitoring staff as Bridging Factors to facilitate provider training, track providers' identification of smokers, and follow-up with beneficiaries participating in tobacco-cessation programs.</p><p><strong>Conclusions: </strong>The release of the evidence-based APL 16-014 by California's DHCS was an important step forward in promoting tobacco-cessation services for Medicaid MCP beneficiaries. Improved communication on implementation in different environments and improved Bridging Factors such as incentives for providers and patients are needed to fully realize policy goals.</p><p><strong>Plan language summary: </strong>In 2016, the California Department of Healthcare Services (DHCS) in California released an \"All Plan Letter\" (APL 16-014) to its Medicaid managed care plans (MCPs) providing guidance on implementing tobacco-cessation coverage to address tobacco use among Medicaid beneficiaries. We conducted semi-structured interviews with health educators in California Medicaid MCPs to explore the barriers and facilitators to implementing the APL using the Exploration, Preparation, Implementation, Sustainment framework. According to MCPs, barriers included a lack of clarity in the APL guidelines; a lack of resour","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221096289"},"PeriodicalIF":0.0,"publicationDate":"2022-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/12/9c/10.1177_26334895221096289.PMC9924244.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-04-27eCollection Date: 2022-01-01DOI: 10.1177/26334895221096295
Holly A Hills, Rebecca Lengnick-Hall, Kimberly A Johnson, Wouter Vermeer, C Hendricks Brown, Mark McGovern
<p><strong>Background: </strong>Adaptation is an accepted part of implementing evidence-based practices. COVID-19 presented a unique opportunity to examine adaptation in evolving contexts. Delivering service to people with opioid use disorder during the pandemic required significant adaptation due to revised regulations and limited service access. This report evaluated changes to addiction medication services caused by the pandemic, challenges encountered in rapidly adapting service delivery, and initial impressions of which changes might be sustainable over time.</p><p><strong>Methods: </strong>Qualitatively-evaluated structured interviews (N = 20) were conducted in late 2020 with key informants in Pinellas County (FL) to assess the pandemic's impact. Interviewees represented a cross-section of the professional groups including direct SUD/HIV service providers, and sheriff's office, Department of Health, and regional clinical program administrative staff. The interview questions examined significant changes necessitated by the pandemic, challenges encountered in adapting to this evolving context, and considerations for sustained change.</p><p><strong>Results: </strong>The most significant changes to service delivery identified were rapid adaptation to a telehealth format, and modifying service consistent with SAMHSA guidance, to allow for 'take-home' doses of methadone. Limitations imposed by access to technology, and the retraining of staff and patients to give and receive service differently were the most common themes identified as challenging adaptation efforts. Respondents saw shifts towards telehealth as most likely to being sustained.</p><p><strong>Conclusions: </strong>COVID-19 provided an unprecedented opportunity to examine adaptation in a fast-paced, dynamic, and evolving context. Adaptations identified will only be sustained through multisystem collaboration and validation. Results suggest that additional components could be added to implementation frameworks to assess rapid adaptation during unplanned events, such as access to additional resources or local decision-making that impacts service delivery. Findings will also be integrated with quantitative data to help inform local policy decisions.</p><p><strong>Plain language summary: </strong>Adaptation is an accepted part of implementing evidencebased practices. COVID-19 presented a unique opportunity to examine rapid adaptation necessitated within evolving contexts. Delivering services to people with opioid use disorder required significant adaptation due to changing regulations and limited access to lifesaving services. This study examined changes in service delivery due to the pandemic, challenges encountered in rapid adaptation, and initial impressions of which changes might be sustainable over time. Qualitatively-evaluated structured interviews were conducted with a cross-section of professional groups (direct substance use disorder (SUD) and human immunodeficiency virus (HIV
{"title":"Rapid adaptation during the COVID crisis: Challenges experienced in delivering service to those with Opioid Use Disorders.","authors":"Holly A Hills, Rebecca Lengnick-Hall, Kimberly A Johnson, Wouter Vermeer, C Hendricks Brown, Mark McGovern","doi":"10.1177/26334895221096295","DOIUrl":"10.1177/26334895221096295","url":null,"abstract":"<p><strong>Background: </strong>Adaptation is an accepted part of implementing evidence-based practices. COVID-19 presented a unique opportunity to examine adaptation in evolving contexts. Delivering service to people with opioid use disorder during the pandemic required significant adaptation due to revised regulations and limited service access. This report evaluated changes to addiction medication services caused by the pandemic, challenges encountered in rapidly adapting service delivery, and initial impressions of which changes might be sustainable over time.</p><p><strong>Methods: </strong>Qualitatively-evaluated structured interviews (N = 20) were conducted in late 2020 with key informants in Pinellas County (FL) to assess the pandemic's impact. Interviewees represented a cross-section of the professional groups including direct SUD/HIV service providers, and sheriff's office, Department of Health, and regional clinical program administrative staff. The interview questions examined significant changes necessitated by the pandemic, challenges encountered in adapting to this evolving context, and considerations for sustained change.</p><p><strong>Results: </strong>The most significant changes to service delivery identified were rapid adaptation to a telehealth format, and modifying service consistent with SAMHSA guidance, to allow for 'take-home' doses of methadone. Limitations imposed by access to technology, and the retraining of staff and patients to give and receive service differently were the most common themes identified as challenging adaptation efforts. Respondents saw shifts towards telehealth as most likely to being sustained.</p><p><strong>Conclusions: </strong>COVID-19 provided an unprecedented opportunity to examine adaptation in a fast-paced, dynamic, and evolving context. Adaptations identified will only be sustained through multisystem collaboration and validation. Results suggest that additional components could be added to implementation frameworks to assess rapid adaptation during unplanned events, such as access to additional resources or local decision-making that impacts service delivery. Findings will also be integrated with quantitative data to help inform local policy decisions.</p><p><strong>Plain language summary: </strong>Adaptation is an accepted part of implementing evidencebased practices. COVID-19 presented a unique opportunity to examine rapid adaptation necessitated within evolving contexts. Delivering services to people with opioid use disorder required significant adaptation due to changing regulations and limited access to lifesaving services. This study examined changes in service delivery due to the pandemic, challenges encountered in rapid adaptation, and initial impressions of which changes might be sustainable over time. Qualitatively-evaluated structured interviews were conducted with a cross-section of professional groups (direct substance use disorder (SUD) and human immunodeficiency virus (HIV","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221096295"},"PeriodicalIF":0.0,"publicationDate":"2022-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/00/af/10.1177_26334895221096295.PMC9924287.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9387747","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-04-24eCollection Date: 2022-01-01DOI: 10.1177/26334895221094297
Casey P Balio, Sean R Riley, Debbie Grammer, Chris Weathington, Colleen Barclay, Daniel E Jonas
<p><p><b>Background:</b> The COVID-19 pandemic has brought widespread change to health care practice and research. With heightened stress in the general population, increased unhealthy alcohol use, and added pressures on primary care practices, comes the need to better understand how we can continue practice-based research and address public health priorities amid the ongoing pandemic. The current study considers barriers and facilitators to conducting such research, especially during the COVID-19 pandemic, within the context of recruiting practices for the STop UNhealthy (STUN) Alcohol Use Now trial. The STUN trial uses practice facilitation to implement screening and interventions for unhealthy alcohol use in primary care practices across the state of North Carolina. <b>Methods:</b> Semistructured interviews were conducted with a purposive sample of 15 practice coaches to discuss their recruitment experiences before and after recruitment was paused due to the pandemic. An inductive thematic analysis was used to identify themes and subthemes. <b>Results:</b> Pandemic-related barriers, including challenges in staffing, finances, and new COVID-19-related workflows, were most prominent. Competing priorities, such as quality improvement measures, North Carolina's implementation of Medicaid managed care, and organizational structures hampered recruitment efforts. Coaches also described barriers specific to the project and to the topic of alcohol. Several facilitators were identified, including the rising importance of behavioral health due to the pandemic, as well as existing relationships between practice coaches and practices. <b>Conclusions:</b> Difficulty managing competing priorities and obstacles within existing practice infrastructure inhibit the ability to participate in practice-based research and implementation of evidence-based practices. Lessons learned from this trial may inform strategies to recruit practices into research and to gain buy-in from practices in adopting evidence-based practices more generally.</p><p><strong>Plain language summary: </strong><i>What is known:</i> Unhealthy alcohol use is a significant public health issue, which has been exacerbated during the COVID-19 pandemic. Screening and brief intervention for unhealthy alcohol use is an evidence-based practice shown to help reduce drinking-related behaviors, yet it remains rare in practice. <i>What this study adds:</i> Using a qualitative approach, we identify barriers and facilitators to recruiting primary care practices into a funded trial that uses practice facilitation to address unhealthy alcohol use. We identify general insights as well as those specific to the COVID-19 pandemic. Barriers are primarily related to competing priorities, incentives, and lack of infrastructure. Facilitators are related to framing of the project and the anticipated level and type of resources needed to address unhealthy alcohol use especially as the pandemic wanes. <i>Implications:</i
{"title":"Barriers to recruiting primary care practices for implementation research during COVID-19: A qualitative study of practice coaches from the Stop Unhealthy (STUN) Alcohol Use Now trial.","authors":"Casey P Balio, Sean R Riley, Debbie Grammer, Chris Weathington, Colleen Barclay, Daniel E Jonas","doi":"10.1177/26334895221094297","DOIUrl":"10.1177/26334895221094297","url":null,"abstract":"<p><p><b>Background:</b> The COVID-19 pandemic has brought widespread change to health care practice and research. With heightened stress in the general population, increased unhealthy alcohol use, and added pressures on primary care practices, comes the need to better understand how we can continue practice-based research and address public health priorities amid the ongoing pandemic. The current study considers barriers and facilitators to conducting such research, especially during the COVID-19 pandemic, within the context of recruiting practices for the STop UNhealthy (STUN) Alcohol Use Now trial. The STUN trial uses practice facilitation to implement screening and interventions for unhealthy alcohol use in primary care practices across the state of North Carolina. <b>Methods:</b> Semistructured interviews were conducted with a purposive sample of 15 practice coaches to discuss their recruitment experiences before and after recruitment was paused due to the pandemic. An inductive thematic analysis was used to identify themes and subthemes. <b>Results:</b> Pandemic-related barriers, including challenges in staffing, finances, and new COVID-19-related workflows, were most prominent. Competing priorities, such as quality improvement measures, North Carolina's implementation of Medicaid managed care, and organizational structures hampered recruitment efforts. Coaches also described barriers specific to the project and to the topic of alcohol. Several facilitators were identified, including the rising importance of behavioral health due to the pandemic, as well as existing relationships between practice coaches and practices. <b>Conclusions:</b> Difficulty managing competing priorities and obstacles within existing practice infrastructure inhibit the ability to participate in practice-based research and implementation of evidence-based practices. Lessons learned from this trial may inform strategies to recruit practices into research and to gain buy-in from practices in adopting evidence-based practices more generally.</p><p><strong>Plain language summary: </strong><i>What is known:</i> Unhealthy alcohol use is a significant public health issue, which has been exacerbated during the COVID-19 pandemic. Screening and brief intervention for unhealthy alcohol use is an evidence-based practice shown to help reduce drinking-related behaviors, yet it remains rare in practice. <i>What this study adds:</i> Using a qualitative approach, we identify barriers and facilitators to recruiting primary care practices into a funded trial that uses practice facilitation to address unhealthy alcohol use. We identify general insights as well as those specific to the COVID-19 pandemic. Barriers are primarily related to competing priorities, incentives, and lack of infrastructure. Facilitators are related to framing of the project and the anticipated level and type of resources needed to address unhealthy alcohol use especially as the pandemic wanes. <i>Implications:</i","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221094297"},"PeriodicalIF":0.0,"publicationDate":"2022-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/0e/16/10.1177_26334895221094297.PMC9924268.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9381858","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-04-19eCollection Date: 2022-01-01DOI: 10.1177/26334895221087477
Hannah Kassab, Kelli Scott, Meredith R Boyd, Ajeng Puspitasari, David Endicott, Cara C Lewis
<p><p><b>Background:</b> Brief educational trainings are often used for disseminating and implementing evidence-based practices (EBPs). However, many accessible trainings are ubiquitously standardized. Tailored training focused on modifying individual or contextual factors that may hinder EBP implementation is recommended, but there is a dearth of research comparing standardized versus tailored training. This study sought to: (a) assess the impact of MBC training on clinician intention to use measurement-based care (MBC); (b) compare the effect of standardized versus tailored training on clinician intention to MBC; and (c) identify clinician-level predictors of intention. <b>Methods:</b> Clinicians (<i>n</i> = 152) treating adult clients with depression at 12 community mental health clinics were randomized to either tailored or standardized MBC training. Clinic-specific barriers and facilitators were used to inform training content and structure tailoring. Linear mixed modeling tested the association between training condition and post-training intention to use MBC, as well as hypothesized individual-level predictors of post-training intention (e.g., age, gender). <b>Results:</b> Clinician intention pre- and post-training increased across training conditions (<i>B</i> = 0.38, <i>t</i> = -5.95, <i>df</i> = 36.99, <i>p </i>< .01, Cohen's <i>d</i> = 0.58). Results of linear mixed modeling procedures suggest no significant difference in clinician intention between conditions post-training (<i>B</i> = -0.03, <i>SE</i> = .19, <i>p </i>> .05, Cohen's <i>d</i> = .15). Only baseline intention emerged as a predictor of post-training intention (<i>B</i> = 0.39, <i>SE</i> = .05, <i>p </i>< .05). <b>Conclusions:</b> These findings suggest the additional effort to tailor training may not yield incremental benefit over standardized training, at least in the short term. As a result, implementation efforts may be able to reserve time and finances for other elements of implementation beyond the training component.</p><p><strong>Plain language summary: </strong>Educational training is a common approach for enhancing knowledge about research-supported mental health treatments. However, these trainings are often not tailored to meet the needs of the trainees, and there is insufficient evidence about whether tailoring might improve the impact of training compared to a one-size-fits-all, standard version. This study compared the impact of a tailored versus standard training on mental health clinician's intentions to use measurement-based (MBC) care for monitoring treatment progress for clients with depression. Study results indicated that intention to use MBC improved for clinicians receiving both the tailored and standard training after training completion. There were no differences in intention to use MBC care when the two types of training were compared. These study findings suggest that tailoring, which may require substantial time and effort, may not be a necessar
背景:简短的教育培训通常用于传播和实施循证实践(EBPs)。 然而,许多可获得的培训都是标准化的。我们建议进行有针对性的培训,重点是改变可能阻碍 EBP 实施的个人或环境因素,但目前还缺乏对标准化培训与有针对性培训进行比较的研究。本研究旨在(a) 评估测量为基础的护理(MBC)培训对临床医生使用测量为基础的护理(MBC)的意向的影响;(b) 比较标准化培训与量身定制的培训对临床医生使用测量为基础的护理(MBC)的意向的影响;以及 (c) 确定临床医生层面的意向预测因素。方法:在 12 个社区心理健康诊所治疗成年抑郁症患者的临床医生(n = 152)被随机分配接受定制或标准化 MBC 培训。诊所特有的障碍和促进因素被用来指导培训内容和结构的定制。线性混合模型检验了培训条件与培训后使用 MBC 的意向之间的关联,以及培训后意向的假设个体水平预测因素(如年龄、性别)。结果:在不同的培训条件下,临床医生在培训前和培训后的意向都有所提高(B = 0.38,t = -5.95,df = 36.99,p d = 0.58)。线性混合建模程序的结果表明,培训后不同条件下的临床医生意向没有显著差异(B = -0.03,SE = .19,P > .05,Cohen's d = .15)。只有基线意向是培训后意向的预测因素(B = 0.39,SE = .05,p 结论):这些研究结果表明,至少在短期内,为定制培训所付出的额外努力可能不会比标准化培训带来更多益处。因此,实施工作可以为培训部分以外的其他实施要素预留时间和资金。白话摘要:教育培训是增进对研究支持的心理健康治疗方法的了解的常用方法。然而,这些培训往往不是根据受训者的需求量身定制的,与 "一刀切 "的标准版培训相比,量身定制的培训是否能提高培训效果,目前还没有足够的证据。本研究比较了定制培训与标准培训对心理健康临床医生使用基于测量的护理(MBC)来监控抑郁症患者治疗进展的意向的影响。研究结果表明,接受定制培训和标准培训的临床医生在培训结束后使用 MBC 的意愿都有所提高。比较两种类型的培训,使用 MBC 护理的意向没有差异。这些研究结果表明,量身定制可能需要花费大量的时间和精力,但这并不是提高教育培训短期效果的必要步骤。
{"title":"Tailored isn't always better: Impact of standardized versus tailored training on intention to use measurement-based care.","authors":"Hannah Kassab, Kelli Scott, Meredith R Boyd, Ajeng Puspitasari, David Endicott, Cara C Lewis","doi":"10.1177/26334895221087477","DOIUrl":"10.1177/26334895221087477","url":null,"abstract":"<p><p><b>Background:</b> Brief educational trainings are often used for disseminating and implementing evidence-based practices (EBPs). However, many accessible trainings are ubiquitously standardized. Tailored training focused on modifying individual or contextual factors that may hinder EBP implementation is recommended, but there is a dearth of research comparing standardized versus tailored training. This study sought to: (a) assess the impact of MBC training on clinician intention to use measurement-based care (MBC); (b) compare the effect of standardized versus tailored training on clinician intention to MBC; and (c) identify clinician-level predictors of intention. <b>Methods:</b> Clinicians (<i>n</i> = 152) treating adult clients with depression at 12 community mental health clinics were randomized to either tailored or standardized MBC training. Clinic-specific barriers and facilitators were used to inform training content and structure tailoring. Linear mixed modeling tested the association between training condition and post-training intention to use MBC, as well as hypothesized individual-level predictors of post-training intention (e.g., age, gender). <b>Results:</b> Clinician intention pre- and post-training increased across training conditions (<i>B</i> = 0.38, <i>t</i> = -5.95, <i>df</i> = 36.99, <i>p </i>< .01, Cohen's <i>d</i> = 0.58). Results of linear mixed modeling procedures suggest no significant difference in clinician intention between conditions post-training (<i>B</i> = -0.03, <i>SE</i> = .19, <i>p </i>> .05, Cohen's <i>d</i> = .15). Only baseline intention emerged as a predictor of post-training intention (<i>B</i> = 0.39, <i>SE</i> = .05, <i>p </i>< .05). <b>Conclusions:</b> These findings suggest the additional effort to tailor training may not yield incremental benefit over standardized training, at least in the short term. As a result, implementation efforts may be able to reserve time and finances for other elements of implementation beyond the training component.</p><p><strong>Plain language summary: </strong>Educational training is a common approach for enhancing knowledge about research-supported mental health treatments. However, these trainings are often not tailored to meet the needs of the trainees, and there is insufficient evidence about whether tailoring might improve the impact of training compared to a one-size-fits-all, standard version. This study compared the impact of a tailored versus standard training on mental health clinician's intentions to use measurement-based (MBC) care for monitoring treatment progress for clients with depression. Study results indicated that intention to use MBC improved for clinicians receiving both the tailored and standard training after training completion. There were no differences in intention to use MBC care when the two types of training were compared. These study findings suggest that tailoring, which may require substantial time and effort, may not be a necessar","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221087477"},"PeriodicalIF":0.0,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/07/fa/10.1177_26334895221087477.PMC9924248.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9387745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2022-04-18eCollection Date: 2022-01-01DOI: 10.1177/26334895221087475
JoAnn E Kirchner, Katherine M Dollar, Jeffrey L Smith, Jeffery A Pitcock, Nyssa D Curtis, Krissi K Morris, Terri L Fletcher, David R Topor
<p><p><b>Background:</b> Implementation scientists are identifying evidence-based implementation strategies that support the uptake of evidence-based practices and other clinical innovations. However, there is limited information regarding the development of training methods to educate implementation practitioners on the use of implementation strategies and help them sustain these competencies. <b>Methods:</b> To address this need, we developed, implemented, and evaluated a training program for one strategy, implementation facilitation (IF), that was designed to maximize applicability in diverse clinical settings. Trainees included implementation practitioners, clinical managers, and researchers. From May 2017 to July 2019, we sent trainees an electronic survey via email and asked them to complete the survey at three-time points: approximately 2 weeks before and 2 weeks and 6 months after each training. Participants ranked their knowledge of and confidence in applying IF skills using a 4-point Likert scale. We compared scores at baseline to post-training and at 6 months, as well as post-training to 6 months post-training (nonparametric Wilcoxon signed-rank tests). <b>Results:</b> Of the 102 participants (76 in-person, 26 virtual), there was an increase in perceived knowledge and confidence in applying IF skills across all learning objectives from pre- to post-training (95% response rate) and pre- to 6-month (35% response rate) follow-up. There was no significant difference in results between virtual and in-person trainees. When comparing post-training to 6 months (30% response rate), perceptions of knowledge increase remained unchanged, although participants reported reduced perceived confidence in applying IF skills for half of the learning objectives at 6 months. <b>Conclusions:</b> Findings indicated that we have developed a promising IF training program. Lack of differences in results between virtual and in-person participants indicated the training can be provided to a remote site without loss of knowledge/skills transfer but ongoing support may be needed to help sustain perceived confidence in applying these skills.</p><p><strong>Plain language summary: </strong>While implementation scientists are documenting an increasing number of implementation strategies that support the uptake of evidence-based practices and other clinical innovations, little is known about how to transfer this knowledge to those who conduct implementation efforts in the frontline clinical practice settings. We developed, implemented, and conducted a preliminary evaluation of a training program for one strategy, implementation facilitation (IF). The training program targets facilitation practitioners, clinical managers, and researchers. This paper describes the development of the training program, the program components, and the results from an evaluation of IF knowledge and skills reported by a subset of people who participated in the training. Findings from the evalu
{"title":"Development and Preliminary Evaluation of an Implementation Facilitation Training Program.","authors":"JoAnn E Kirchner, Katherine M Dollar, Jeffrey L Smith, Jeffery A Pitcock, Nyssa D Curtis, Krissi K Morris, Terri L Fletcher, David R Topor","doi":"10.1177/26334895221087475","DOIUrl":"10.1177/26334895221087475","url":null,"abstract":"<p><p><b>Background:</b> Implementation scientists are identifying evidence-based implementation strategies that support the uptake of evidence-based practices and other clinical innovations. However, there is limited information regarding the development of training methods to educate implementation practitioners on the use of implementation strategies and help them sustain these competencies. <b>Methods:</b> To address this need, we developed, implemented, and evaluated a training program for one strategy, implementation facilitation (IF), that was designed to maximize applicability in diverse clinical settings. Trainees included implementation practitioners, clinical managers, and researchers. From May 2017 to July 2019, we sent trainees an electronic survey via email and asked them to complete the survey at three-time points: approximately 2 weeks before and 2 weeks and 6 months after each training. Participants ranked their knowledge of and confidence in applying IF skills using a 4-point Likert scale. We compared scores at baseline to post-training and at 6 months, as well as post-training to 6 months post-training (nonparametric Wilcoxon signed-rank tests). <b>Results:</b> Of the 102 participants (76 in-person, 26 virtual), there was an increase in perceived knowledge and confidence in applying IF skills across all learning objectives from pre- to post-training (95% response rate) and pre- to 6-month (35% response rate) follow-up. There was no significant difference in results between virtual and in-person trainees. When comparing post-training to 6 months (30% response rate), perceptions of knowledge increase remained unchanged, although participants reported reduced perceived confidence in applying IF skills for half of the learning objectives at 6 months. <b>Conclusions:</b> Findings indicated that we have developed a promising IF training program. Lack of differences in results between virtual and in-person participants indicated the training can be provided to a remote site without loss of knowledge/skills transfer but ongoing support may be needed to help sustain perceived confidence in applying these skills.</p><p><strong>Plain language summary: </strong>While implementation scientists are documenting an increasing number of implementation strategies that support the uptake of evidence-based practices and other clinical innovations, little is known about how to transfer this knowledge to those who conduct implementation efforts in the frontline clinical practice settings. We developed, implemented, and conducted a preliminary evaluation of a training program for one strategy, implementation facilitation (IF). The training program targets facilitation practitioners, clinical managers, and researchers. This paper describes the development of the training program, the program components, and the results from an evaluation of IF knowledge and skills reported by a subset of people who participated in the training. Findings from the evalu","PeriodicalId":73354,"journal":{"name":"Implementation research and practice","volume":"3 ","pages":"26334895221087475"},"PeriodicalIF":0.0,"publicationDate":"2022-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/d5/a3/10.1177_26334895221087475.PMC9924286.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9388978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}