Evaluation Review最新文献

This study used daily experimental data from smart bands worn by 142 respondents to investigate the relationship between the number of minutes slept and self-reported mood. The results showed that more minutes of sleep were associated with improved mood. Time preferences, altruism, and trust were also associated with mood. Finally, our analysis revealed that the only mechanism through which sleep affects mood is positive reciprocity. This study contributes to the existing literature by examining the connections among healthy habits, sleep quality, economic preferences, and their effects on mood.

Performance management in university-based scientific research institutions is essential for driving reform, advancing education quality, and fostering innovation. However, current performance evaluation models often focus solely on research indicators, neglecting the critical interdependence between the education and research systems. This oversight leads to inefficiencies in resource allocation and an underestimation of overall institutional performance, particularly in universities with varying development levels. To address these deficiencies, this study introduces two innovative two-stage data envelopment analysis models: the group-frontier and meta-frontier evaluation models. The findings are validated using data from 144 universities across China. They demonstrate that the proposed models effectively mitigate the underestimation of efficiency in traditional models and accurately reflect the intertwined nature of university subsystems and the disparities in university development. These results offer valuable insights for improving the performance of scientific research institutions and informing the strategic decisions of university administrators and government education departments.

This paper presents a methodological advancement by integrating Qualitative Comparative Analysis (QCA) and Process Tracing (PT) in the evaluation of training transfer effectiveness in Flemish SMEs. This multimethod approach leverages the strengths of both QCA and PT to enhance internal and external validity, offering a robust framework for capturing the conditions and causal mechanisms underlying policy interventions. By sequentially applying QCA to identify necessary and sufficient conditions and PT to unpack the causal processes, the study provides a comprehensive analysis that addresses both "what works" and "how it works." Our findings demonstrate that combining these methods allows for more nuanced insights into the effectiveness of training programs, ultimately contributing to the empirical validation of policy theories and the development of evidence-based interventions. This research underscores the potential of multimethod evaluations to produce more reliable and generalizable results, thereby offering valuable guidance for evaluators and policymakers seeking to enhance the impact of their programs.

This study examined the impact of ITV intervention on reduction in the propensity to abuse substances and engage in drug trafficking. The researcher conducted this study using an experiment of 517 vulnerable adolescents aged 10-19 years. The participants were randomly assigned to control (n = 258) and treatment (n = 259) groups. The researchers found a significant main effect of treatment conditions on reduction in the propensity to engage in substance abuse and drug trafficking among vulnerable adolescents. That is, before the intervention, there was no significant statistical difference between the control and treatment groups on the propensity to engage in substance abuse and drug trafficking. However, vulnerable children who received the intervention reported a significant reduction in propensity after the intervention. The results highlight the usefulness of ITV as a behaviour change strategy for vulnerable children.

As ecological globalization intensifies, rural waste recycling and management has become a global concern. China's proactive efforts are significant for revitalizing domestic rural ecosystems, offering valuable insights into global environmental governance. The rampant dumping and informal processing of hazardous waste in rural China pose severe threats to local ecological balance and public safety. Thus, efficiently recycling hazardous rural and agricultural waste is pivotal for China's rural ecological and environmental governance. This study adopts a participatory governance perspective and establishes a theoretical framework for dual principal-agent relationships. This framework examined 22 cases of rural governance spanning Eastern, Central, and Western China. This study evaluated governance mechanisms in four dimensions: policy, material, human, and social capital, using the fuzzy-set qualitative comparative analysis method. The key findings include: (1) The adverse orientation and behavior of hazardous waste recycling governance in rural areas stem from the combined impacts of multiple complex factors. (2) The synergistic interplay between policy, human, and social capital is crucial for advancing hazardous waste recycling governance in rural settings. (3) Three pathway mechanisms--socially driven, market-oriented, and system participation--facilitate the effective governance of hazardous waste recycling. Innovative practices in hazardous waste recycling and management within rural China yielded positive domestic impacts and profoundly influenced global environmental governance. China's experiences and approaches motivate other nations and regions, showcasing responsibility and dedication to international environmental governance and bolstering Chinese contributions to creating a cleaner, beautiful world.

This study tested a 'wise' intervention (quick prompt of a specific psychological mec) in acute care hospital units to improve nurses' hand hygiene compliance (HHC). A multiple baseline design in two medical-surgical teaching hospitals in the United States. Hand hygiene data was collected using an electronic compliance monitoring system with sensors placed in doorways and on corresponding soap and alcohol-based hand rub dispensers. The outcome measure was the proportion of opportunities in which HH was undertaken by staff per week in each unit. A quick-and-easy psychological prime to reinvigorate professional identity. Interrupted time series analysis using a quasi-Poisson regression model with statistical process control charts for each unit. A statistically significant increase in HHC rates that was sustained for months post-intervention. However, the patterns by unit were not statistically significant once temporal trends were considered. Other factors, such as the unit type and the use of incentives could have impacted the results. These analyses suggest that the aggregate impact should not be taken as evidence of intervention effectiveness. This study therefore cannot be considered to have provided a strong foundation for use of a 'wise' intervention, despite its relatively small financial, logistical and psychological cost.

In the modern educational landscape, the integration of gamification into hybrid learning environments has emerged as a promising approach to enhance student outcomes. However, there remains a lack of comprehensive frameworks for designing gamified hybrid courses and validating their impact on student outcomes. This paper proposes a design science-based approach to gamified course design in hybrid learning contexts. Drawing on the principles of design science research, we developed a framework for designing a gamified hybrid course curriculum that incorporates course content, activities, and assessments based on four elements of gamification (achievement elements, utilitarian value, hedonic benefits, and competition). To validate the effectiveness of our approach, we conducted a study with 294 students enrolled in a hybrid business course that implemented the proposed gamification framework. Our findings indicate that all gamification elements of our proposed gamified hybrid courses positively enhance student engagement, achievement, and satisfaction. Ultimately, this paper not only contributes to the 'gamification in education' literature by providing a comprehensive framework for designing engaging and effective hybrid courses but also proposes a roadmap for the application of design science to embed gamification in business course curriculum design within the context of modern hybrid learning environments.

The frequency and richness of the theories developed, tested, and used by researchers in an academic discipline exemplify several pertinent factors, namely, the growth, the maturity, the independence, the legitimacy, and the influence of the discipline. Although organizations have been working on projects for centuries, Project Management (PM) is a considerably new academic discipline with emerging research themes, models, methodologies, frameworks, and paradigms. These PM concepts are anchored on or reinforced by new or existing theories. This exploratory study aims to add to the existing PM body of knowledge by investigating the prevalence of theory use in PM research. A systematic content analysis of 9200 PM research articles published from 2000 to 2019 (20 years) in the leading PM journals identified 248 unique theories. These results reveal that the PM discipline is increasingly embracing the use of theories with game theory, fuzzy theory, agency theory, contingency theory, and stakeholder theory emerging as the most dominant theories in the reviewed research articles. Also, although PM is developing its theories, the results revealed that PM researchers continue to heavily use theories borrowed from other academic disciplines such as psychology, sociology, mathematics, and economics.

This study focuses on the second round of Taiwanese teacher preparation program (TPP) evaluation (2012-2017) to analyze how evaluation policy shapes TPPs. In-depth interviews were conducted with 13 stakeholders, which included professors, administrators, researchers, and staff involved in TPP evaluation. First, the findings revealed that neoliberalism influences evaluation policy and restricts the diversity of TPP development. Second, different evaluation approaches may be used to bring more inclusiveness and flexibility to evaluation standards. Third, evaluation plays an important role in TPP development, and a professional organization responsible for evaluation should be established in Taiwan in the future. To conclude, it is significant for TPP evaluation policy to consider policy ideology, evaluation standards, and program diversity to aid in improving the quality of teacher education not only in Taiwan but also internationally.

Strategies for ensuring the generalizability of evaluation results often focus on building methodologically sound research designs. However, these strategies may fall short when the challenge lies as much in uncovering causal patterns than in applying them to uncertain contexts. This article proposes a set of pragmatic strategies to address generalizability issues in complex evaluations. These strategies address important questions such as: What needs to be generalized, for whom and for what purpose? What assumptions underlying the intervention could be generalized? How can approaches and methods be selected to support a generalization objective? How can potential users be involved to support the process of generalization? We illustrate these strategies using the example of a series of evaluations of bottom-up socio-ecological transition initiatives in France between 2013 and 2020. We suggest that these strategies can enhance policy learning and better equip policy stakeholders to navigate complex situations.