Evaluation and Program Planning最新文献

This paper delves into the utility of Outcome Harvesting as an effective methodology for evaluating development projects that seek to cultivate and advance social enterprises within intricate and multifaceted contexts. Amidst the ever-evolving socio-economic, political, and cultural dynamics characterizing complex environments, traditional evaluation approaches often fall short in capturing the nuanced outcomes of such projects. By adopting Outcome Harvesting, this study argues that evaluators gain a robust tool to systematically collect, analyze, and interpret the intended and unintended impacts of development initiatives in complex and changing contexts. The utilization of mixed methods in the gathering of both primary and secondary data to effectively implement the Outcome Harvesting method has been influenced by overarching theoretical frameworks in the realm of social enterprises. This approach resulted in a comprehensive research methodology that seeks to synergize the strengths of the Outcome Harvesting method within the broader context of understanding and advancing the concept of social entrepreneurship.

This study aims to evaluate the technical efficiency levels of healthcare systems in underdeveloped countries and to reveal the impact of COVID-19 along with some other factors on the efficiency levels via a two-stage data envelopment analysis. The study covers panel data from 2013 to 2020. The results show that technical efficiency scores decreased during the pandemic period. It is also understood from the results that immunization and the ratio of population ages 65 and above have significant and negative effects on inefficiency scores while carbon dioxide emissions have significant and positive effects. It is thought that the results of this study can guide decision-makers regarding efficiency gains in healthcare systems.

In response to China's incentive for "connotative development" in doctoral education, universities are actively fostering creative and innovative PhD candidates with enhanced research productivity and superior educational quality. A Chinese university, aligning with this objective, has initiated significant reforms in its doctoral admission methods, introducing a new type of student and altering the proportion of existing ones. Recognizing the complexity and uncertainty inherent in the doctoral admission process, this theory-based study employs a Theory of Change framework to systematically evaluate the immediate, intermediate, and long-term outcomes of this university's interventions. It assesses the transformative impact of these changes by integrating secondary data with qualitative insights, including focus group discussions with twelve students and semi-structured interviews with three supervisors. The study reveals that while this university has made substantial progress in achieving short-term goals, these reforms have not uniformly benefited all student categories, presenting distinct challenges and opportunities for stakeholders. Consequently, it advocates for diversifying the student composition and emphasizes inclusive pedagogical strategies to facilitate high-quality doctoral education. Importantly, this research extends beyond this university, promoting a balanced mix of student profiles and a holistic approach to shaping effective policies and practices within doctoral admission, essential for navigating global competition.

The number of applications for National Virtual Simulation Experimental Teaching Projects (NVSETPs) in China has seen a significant increase. Consequently, the influence of contextual factors and their potential personal connections on the evaluation results, whether for national or non-national NVSETPs, has become a prominent concern. In this study, we employed a modified back-chaining method using logistic regression to examine whether contextual factors in NVSETP applications could explain the evaluation outcomes. Our analysis was based on data available on the open platform of China's Ministry of Education (MOE). We identified several significant influencing factors, including the score on a five-point rating system, the number of clicks on the application page, school quality, school region, and the gender, title, and position of the applicants. Our results shed light on the impact of contextual factors on the evaluation results of NVSETPs in the fields of biology and medicine, using a modified back-chaining method. We conclude that enhancing the transparency of the assessment process and implementing standardized, detailed scoring guidelines for NVSETPs would mitigate the negative influence of contextual factors.

Introduction

Currently, no reporting guidelines exist for observational and qualitative study protocols. In an effort to enhance the quality of research protocols, we introduce two study protocol reporting checklists that we have developed.

Main recommendations

These checklists include educational components and examples intended to assist novice researchers. Through the analysis of 333 study protocols submitted for ethical review, our checklists have been developed and validated, demonstrating their applicability across various observational and qualitative study designs.

Changes in management

We provide insights into the systematic implementation of these checklists alongside complementary elements that support their effectiveness. We recommend longitudinal monitoring and evaluation of checklist utilization.

The policymaking process is largely opaque, especially regarding the actual writing of the policy. To attempt to better understand this complex process, we utilized mixed methods in our evaluation of an intervention. However, the process of mixing methods can be messy, and thus may require recalibration during the evaluation itself. Yet, in comparison to reporting results, relatively little attention is paid to the effects of mixing methods on the evaluation process. In this article, we take a reflexive approach to reporting a mixed methods evaluation of an intervention on the use of research evidence in U.S. federal policymaking. We focus on the research process in a qualitative coding team, and the effects of mixing methods on that process. Additionally, we report in general terms how to interpret multinomial logistic regressions, an underused analysis type applicable to many evaluations. Thus, this reflexive piece contributes (1) findings from evaluation of the intervention on the policymaking process, (2) an example of mixing methods leading to unexpected findings and future directions, (3) a report about the evaluation process itself, and (4) a tutorial for those new to multinomial logistic regressions.

In involuntary distance education, like during epidemics and wars, students often feel heightened learning anxiety, impacting outcomes. Despite innovative teaching methods, many face hurdles in distance learning. We want to propose specific strategies to solve learning difficulties in distance education.

Aim

This study explored whether using digital concept maps (DCM) in physiology courses can reduce learning anxiety among nursing students.

Design

The study was quasi-experimental, including a pre-and post-test control group.

Methods

71 nursing students aged 16–18 enrolled in a physiology course were recruited in the study. DCM was the intervention as a tool for in-person learning (first 12 weeks) and distant learning (final six weeks). Each student was required to complete the assignments independently to compare learning outcomes. Questionnaires were administered, and an assignment evaluation was completed before and after the course's different formats.

Results

DCM using software using mobile vehicles (mobile, notebook, pad) is digital learning to help nursing students learn difficult subjects. DCM improved the students’ learning motivation and effectiveness more in distance learning than in-person learning, decreasing learning anxiety in both face-to-face and distance learning.

Conclusions

DCM promoted students’ self-regulated learning and positively affected learning outcomes by increasing motivation and reducing stress. This study offers a tailored teaching framework for international settings to reduce student anxiety and improve learning effectiveness.

Professional Development (PD) programs in Pakistan typically follow a standardized approach, often overlooking the diverse strengths and weaknesses of various teacher groups, which may not adequately address their specific needs. This study aims to evaluate teacher competencies among different groups from the perspective of school principals in Pakistan's public schools, with the goal of enhancing the effectiveness of PD programs. Initially, the study identifies three key themes of 21st-century teacher competencies through an extensive review of recent literature. An interview guide, based on these competencies, was used to gather data from seven public school principals via structured interviews. The data were analyzed using a deductive content analysis approach, with MAXQDA software employed for theme coding. The findings revealed notable differences in teacher competencies from the principals' perspectives. Female and younger teachers exhibited more competencies compared to their male and senior counterparts. These insights provide crucial information for planning and customizing Teacher Professional Development (TPD) programs, emphasizing an objective evaluation of teachers rather than self-assessment. Tailored PD programs based on these findings can more effectively enhance teachers' professional growth and competence."

The absence of comprehensive risk analysis in residential development within certain regions often leads to substantial human and material losses during natural disasters. The Mediterranean region, particularly susceptible to the impacts of climate change, is projected to witness an upsurge in the frequency of natural calamities like floods, landslides, and forest fires. Consequently, meticulous risk assessment during the selection of residential areas becomes paramount in this context. This study is dedicated to the evaluation of suitable residential zones in Manavgat, a pivotal location in the Mediterranean region with a progressively growing population. The findings indicate that approximately 4.26 % of the research area is deemed appropriate for residential establishment. The identification of these locations is crucial for ensuring human and material safety, as well as enhancing overall biocomfort. Moreover, this study provides a foundation for long-term planning initiatives within the region and makes a significant contribution to the international evaluation literature by demonstrating the application of integrated risk assessment methodologies in urban planning.

The need for effective approaches to support aging and homebound adults is recognized internationally and domestically. This exploratory study sought to understand the proximal benefits of an intergenerational program in Delaware, USA that connected homebound individuals with college students. The primary goal was to describe program impacts on home-bound community residents to inform future research, program planning, and implementation. Outcomes of interest included quality of life, well-being, and independence. Semi-structured interviews were conducted with 19 participants recruited from a nonprofit partner. Findings yielded seven unique themes: emotional fulfillment, special feelings of support from a rare “unconditional” relationship, assistance with tasks, close connection with someone not ordinarily met, intergenerational understanding, someone to talk to, and appreciation. Additionally, the research team applied the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, to contextualize the approach and findings. Results inform future evaluation efforts of homebound visiting programs, which may seek to incorporate outcome indicators aligned with these themes and serve as a foundation for future quantitative measures of impact.