Evaluation & the Health Professions最新文献

Generalized linear mixed models (GLMMs) have great potential to deal with count and rate data in single-case experimental designs (SCEDs). However, applied researchers face challenges to apply such an advanced approach in their own studies. Hence, our study aimed to provide a tutorial and demonstrate a step-by-step procedure of using GLMMs to handle SCED count and rate outcomes. We utilized an empirical examplewith a purpose to examine the effect of prelinguistic milieu teaching (PMT) on prelinguistic intentional communication for six school-age children with autism. The outcomes were sustained intentional communication (frequency count) and initiated intentional communication (rate). A step-by-step analytical approach with GLMMs was illustrated and associated R and SAS code was provided. The results overall supported the original conclusions of the effectiveness of PMT, whereas additional evidence regarding the precise estimate of the individual treatment effect and between-case variation of the treatment effect were also interpreted. The implications of the similarities and differences between the findings based on GLMMs and from the original study were discussed.

Parents with borderline personality disorder (BPD) experience deficiencies in parenting skills leading to increased family burden, stress, mental health problems in children and even family violence. The present study evaluated a Dutch version of the parenting training based on Dialectical Behavior Therapy (DBT) for mothers with BPD. A multiple baseline single-case experimental design study was conducted with standardized and idiosyncratic assessments of parenting behavior and parental stress before, biweekly during, and after training. Participants (N = 10) were mothers with a BPD diagnosis with a child under the age of 6. Four participants discontinued the training. Among six training completers, clinically reliable improvements in parenting skills were most pronounced for inconsistent discipline, involvement, positive parenting and corporal punishment. Frequent, idiosyncratic assessments showed that for six mothers training had a positive effect on parenting skills, while for five mothers this effect was large. Overall, less improvement was found for parenting stress. DBT parenting training seems to have clinical value for mothers with BPD struggling with raising their children. Most prominent improvement was found in relation to mothers disciplining their child in a more consistent manner. The complexity and heterogeneity of mothers with BPD requires a more idiosyncratic, patient-centered approach. This study was registered (retrospectively) in ISRCTN (ID ISRCTN74447767). https://www.isrctn.com/ISRCTN74447767, March 2022.

There are many ways proposed to achieve better societal outcomes (e.g., in health, education, and well-being) including: (1) bridging research and practice, (2) building the motivation and capacity of service delivery organizations (e.g., schools, hospitals, clinics, and community-based organizations) to innovate, and (c) providing service delivery systems with high-quality support via training and technical assistance. The Interactive Systems Framework for Dissemination and Implementation (ISF) was developed to describe how relevant systems, organizations, and processes can interact and work toward these goals. Stimulated by the 13 articles contained in the two special issues of Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers, we describe several enhancements to the ISF including: how service delivery systems can operate better, how motivation and capacity can be built, and how training and technical assistance centers can provide more evidence-informed technical assistance and other promising innovations. ISF 2.0 incorporates these and other enhancements with the goal of achieving better outcomes. We conclude that the actions and accountability of funders and of organizations and systems to funders would accelerate progress in the systems to achieve outcomes-and result in improving the science and practice of implementation support.

Despite a growing body of research demonstrating the value of using evidence-based programs and practices (EBPPs) to address health and education issues, the gap between research evidence and practice in education and human services continues to be a vexing problem. Technical assistance (TA) is widely accepted as a key strategy to support evidence-based programs and practices (EBPP) uptake and implementation. However, little is known about how TA practices are used in TA delivery. Moreover, little attention has been paid to building the capacity of TA providers and assessing the fidelity of the implementation of TA practices. The case example presented in this article describes one organization's efforts to develop common language and definitions of TA services, core principles, and methods, and to standardize the delivery of TA by enhancing the capacity and retention of TA providers. We conclude with recommendations about how like organizations can employ similar efforts to improve the quality and consistency of TA delivery, thereby establishing a foundation for building a strong evidence base.

In low- and middle-income countries (LMICs), barriers such as low system readiness, contextual mismatches, and resource limitations impede effective implementation of evidence-based interventions. This commentary offers insights into overcoming these challenges with a case study of the PRISM project, designed to reduce behavioral and psychological symptoms of dementia in older adults living in Thailand. The case highlights how combining two evidence-based models - the Reducing Disability in Alzheimer's Disease clinical intervention and the Getting To Outcomes implementation science process enhances program success. Using interviews with stakeholders across various health system levels, we identify factors critical to successful program implementation: (1) integrating interventions into policy frameworks, (2) empowering local implementers, (3) fostering collaborative learning, and (4) adapting interventions to local contexts. The case demonstrates that building system readiness through local engagement and ownership is central to scaling up health programs in LMICs. This commentary's contribution lies in its emphasis on the role of implementation science as a vehicle for translating research into practice. It presents a practical, adaptive model for embedding interventions into routine health systems, thereby offering a pathway for successfully scaling up evidence-based programs in LMICs. Such findings provide lessons for overcoming barriers to implementation in resource-limited environments.

This article describes (a) key elements of a high-quality technical assistance (TA) system; (b) the operationalization of a high-quality TA system (Getting To Outcomes-Technical Assistance; GTO-TA) being implemented in a training and TA center (TTAC) interested in transforming its support services to include an evidence-informed approach to TA; and (c) key lessons learned in successfully transitioning from "TA-as-usual" to an evidence-informed TA system. GTO-TA is one operationalization of a systematic, proactive, evidence-informed approach to TA. GTO-TA includes best practices and core elements for a comprehensive TA system; it aims to increase the readiness (reduce barriers and increase facilitators) of an organization to deliver an innovation (program, policy, practice, and process new to an organization) with quality. We describe the collaboration between the Wandersman Center and the Geographic Health Equity Alliance team to co-design and implement the GTO-TA system. Data from surveys, interviews, and consensus conversations led to important lessons learned, which are applicable to other TTACs seeking to develop a more proactive and systematic approach to TA. Lessons include: changing internal operations to facilitate TA providers making necessary changes in providing TA and understanding the relative advantage perceptions about a new TA system that influence adoption and must be considered.

The Department of Defense (DoD) remains committed to mitigating harmful behaviors that harm personnel and hinder military readiness. DoD's Sexual Assault Prevention and Response Office (SAPRO) and the Division of Violence Prevention (DVP) within the Centers for Disease Control and Prevention (CDC) established a partnership to build capacity for primary prevention though a wide-ranging training and technical assistance (TTA) system, The Integrated Prevention Technical Assistance Center (IPTAC). The system serves as a support system within the Interactive Systems Framework (ISF). The goal for IPTAC's TTA support is to build capacity for integrated primary prevention and build sustainability for prevention in complex military environments. To assess the effectiveness of IPTAC, the system is evaluated on what TTA is delivered, the skills and knowledge increase in TTA participants, participant satisfaction with TTA received, and participant application or intent for application of skills. Early results are positive; however, these results could be improved partly through ensuring a larger focus on tailoring to military contexts within all TTA activities. This article describes the creation of IPTAC, the role of the ISF in the implementation of TTA, and the evaluation of IPTAC. Implications for TTA delivery in the military and civilian sectors are discussed.

The benefits of training and technical assistance (TTA) have been well documented. There is limited literature that explores how complex systems of TTA are implemented and evaluated particularly in the violence prevention field. The Violence Prevention Practice and Translation Branch (VPPTB) within the Centers for Disease Control and Prevention's (CDC) Division of Violence Prevention funds multiple technical assistance providers who are tasked with building the capacity of program recipients to implement comprehensive approaches to prevent multiple forms of violence. VPPTB designed the Violence Prevention Technical Assistance Center (VPTAC) with the goal of implementing and evaluating comprehensive TTA efforts that integrates the work of multiple TTA providers to build the capacity of recipients to plan, implement, and evaluate violence prevention efforts. The VPTAC evaluation incorporates data from program recipients, TTA providers, and TTA modalities enabling the VPPTB staff to show improvement in technical knowledge, gather examples of enhanced implementation, and facilitate proactive TTA planning. An important step in the process of evaluating VPTAC from a system-level perspective required an expansion beyond evaluating a single TTA event, provider, or engagement. This is essential to understand how a diverse set of TTA activities and partners work together in their efforts to build capacity.

We introduce the second of two special issues that examine the science and practice of implementation support with takeaways for training and technical centers (TTACs). Major goals of both issues were to provide: rationale, concepts, and tools for evaluating training and technical assistance (TTA); an evidence-base for TTACs; and greater understanding of what is required to close the research-practice gap. To achieve these ambitious goals, we encouraged submissions from a broad array of individuals and groups involved in TTA. The seven articles in this second issue were written by a diverse mix of individuals affiliated with TTACs, federal agencies, research-oriented think tanks, and implementation scientists whose focus is on advancing the TTA literature. We felt that the collective wisdom garnered from their experiences would complement the first issue (June 2024) and collectively forge ahead and provide a vision of what is to come. We also thought it would be useful to provide perspectives on what it looks like when readers could examine both issues as a whole. Therefore, we included five commentaries-from the two editors and esteemed colleagues-who help provide a holistic perspective on the present and future of the science and practice of implementation support.