Evaluation and Program Planning最新文献

Creating sustainable change and fostering collaborative relationships between researchers and stakeholders is a recognized challenge in the field of evaluation. Identifying programme purpose, cultural context, potential challenges, and engaging stakeholders before an evaluation can produce responsive and impactful evaluations. This paper discusses implementing a targeted scoping study within the framework of rapid qualitative research and evaluation. A scoping study enables collaborative decision-making on evaluation priorities, and functions as an evaluability assessment in time-sensitive contexts. In our experience, a scoping study can be carried out in as little as five days or as long as six weeks. It is timely to revisit the question of what factors influence evaluation outcomes, a scoping study can be used to support an evaluation, address access to data and research, and strengthen communication channels. The methodological approach was used to co-produce an evaluation with an NGO that accurately reflected their needs, recognizing possible challenges and solutions.

Arts-based evaluation is an effective and fun way to engage people and uncover meaningful, valid results. In this project, an arts-based approach was used to gain an understanding of the effects the Communities ChooseWell Program has had according to the Champions’ experiences. We wanted to identify what changes, if any, has Communities ChooseWell fostered through the past 10 years? This evaluation was completed using an arts-based approach which allowed us to explore varied long-term effects in different contexts. The creative process allowed for an open approach not predetermining the nature of potential effects. It also gave the participants space to identify what matters the most according to the ChooseWell Champions. This evaluation was in addition to evaluation requirements from the ChooseWell programs funder. In this article we will first present the context of evaluation and state our positionality. We will then present the methodology and methods. Finally, we will present and discuss the results and recommendations.

Challenging behaviors (CB) are a frequent co-occurring problem in children with autism spectrum disorder (ASD) and hinder their response to recommended interventions such as early intensive behavioral intervention (EIBI). The Prevent-Teach-Reinforce for young children (PTR-YC) program was implemented to meet community-based EIBI educators’ training and support needs in managing CB in their day-to-day work with families. Although this positive behavior support program has a strong empirical basis, its implementation by community-based educators has yet to be assessed from a systematic and structured program evaluation perspective. Using Chen’s (2015) theoretical framework for program evaluation, this study assessed the quality of implementation of PTR-YC as perceived by 17 educators who received training and supervision on applying PTR-YC among families of children with ASD receiving EIBI services. Educators’ post-intervention interviews and questionnaires were analyzed using the logical model for program evaluation to identify obstacles and facilitators to the implementation of PTR-YC.

The present study aims at ideating a quantitative protocol to evaluate effectiveness of training programmes especially meant for farmers, farm women, and rural youth. The specific objective was to develop a robust framework for measuring the effectiveness of rural training programmes organized by the Farmers Training Centres (FTCs) of India. Kirkpatrick’s training evaluation model provides us the foundation to design a four-dimensional composite framework based on range-based indicator normalization, principal component analysis based indicator weight estimation, and rank correlation based framework sensitivity testing. We used cross-sectional primary data generated through household survey and personal interviews with randomly selected one thousand trainees to test and validate our proposed protocol. Applying it on our evaluation target we find that the degree of effectiveness of the training programmes varies; one in every four training programmes may not be effective. Trainees’ reactions on various aspects of the training programmes may have positive and significant influence on learning. Training outcomes may be linked with the trainees’ post-training changes in behaviour. A sensitivity test confirms that the proposed framework is not susceptible to changes in weighting schemes, implying robustness of indicator selection. The findings offer dissection of individual training programmes guiding policy decisions for a training organization. The proposed framework enriches the Kirkpatrick’s training evaluation model by offering standardized indicators for training effectiveness evaluation.

Health service need refers to the essential care required to achieve optimal health outcomes within resource constraints. When necessary services to address identified health issues are not received, unmet needs arise. This research focuses on the determinants of unmet healthcare needs across the 34 countries within the European region from 2011 to 2019, focusing on Andersen's Behavioral Model's enabling factors. We employed a static and robust panel regression model using Stata 14.0 software. Key determinants analyzed include GDP per capita, urbanization rate, and physicians per capita. Findings reveal that lower GDP per capita and lower urbanization rates are significantly correlated with higher levels of unmet healthcare needs, highlighting income level and geographical accessibility as critical factors. Additionally, a higher number of physicians per capita is associated with reduced unmet healthcare needs, indicating the importance of healthcare resources in addressing healthcare access gaps. These findings underscore the importance of targeted healthcare policies that address income level, improve healthcare accessibility, and enhance healthcare resource allocation to reduce unmet healthcare needs effectively. These findings equip policymakers and administrators with empirically grounded insights to comprehend the factors contributing to unmet healthcare needs and to develop policies aimed at addressing this challenge.