Evaluation Review最新文献

When planning a cluster randomized trial, evaluators often have access to an enumerated cohort representing the target population of clusters. Practicalities of conducting the trial, such as the need to oversample clusters with certain characteristics in order to improve trial economy or support inferences about subgroups of clusters, may preclude simple random sampling from the cohort into the trial, and thus interfere with the goal of producing generalizable inferences about the target population. We describe a nested trial design where the randomized clusters are embedded within a cohort of trial-eligible clusters from the target population and where clusters are selected for inclusion in the trial with known sampling probabilities that may depend on cluster characteristics (e.g., allowing clusters to be chosen to facilitate trial conduct or to examine hypotheses related to their characteristics). We develop and evaluate methods for analyzing data from this design to generalize causal inferences to the target population underlying the cohort. We present identification and estimation results for the expectation of the average potential outcome and for the average treatment effect, in the entire target population of clusters and in its non-randomized subset. In simulation studies, we show that all the estimators have low bias but markedly different precision. Cluster randomized trials where clusters are selected for inclusion with known sampling probabilities that depend on cluster characteristics, combined with efficient estimation methods, can precisely quantify treatment effects in the target population, while addressing objectives of trial conduct that require oversampling clusters on the basis of their characteristics.

Although scholars have discussed in depth about the evaluation content and the construction of evaluation index system of emergency management and crisis management, a unified and standardized interpretation of system construction concepts and empirical research on the performance evaluation of urban emergency management is still lacking. In view of this, this paper is based on the theory of the  crisis life cycle, with the four phases of urban emergency management and the content of the task as a clue, constructed a performance evaluation index system containing 12 primary indicators and 44 secondary indicators, and centered on the emergency management work situation of S city. The study reveals that emergency management underperforms in S city, with a score of 5.948, qualifying as the "defined level". The "prevention and preparedness stage" receives poor evaluation, indicating a significant bias for crisis response instead of prevention. The report suggests the improvement of emergency material stockpile planning, the formation of grassroots emergency response teams, the emergency management publicity, and special emergency drill plans, etc., with a view to providing reference for city managers to comprehensively review and evaluate the emergency management system, and to promote the construction of a more systematic, complete and scientific urban emergency management system.

The slowdown in economic development caused by traffic accidents in Spain, together with the disparity in the risk of death or injury due to traffic accidents in its provinces, makes it necessary to evaluate their road safety performance. Therefore, the objectives of the present research are, on the one hand, to find out the level of road safety efficiency of Spanish provinces in the period 2014-2018. On the other hand, it is also aimed to determine to what extent the annual efficiency change is originated by pure changes in efficiency or by technological changes. To achieve both objectives, the nonparametric technique of Data Envelopment Analysis and the Malmquist Index have been used based on the consideration of the Safety Performance Indicators (SPI) as the inputs of the process. The research findings show changes in the level of road safety efficiency in each of the years of the study period. Thus, it is possible to identify a geographical delimitation of the causes that generate changes in efficiency in recent years. A contraction in efficiency and technological progress is identified in part of the Spanish provinces in the north, northeast, and south of Spain.

Although considerable discussion has been devoted to the macro determinants of labor market variables across genders, comparatively little attention has been given to the contribution of the informal economy to this market. This study was aimed at empirically investigating the impact of the size of the shadow or informal economy (IE) on labor market variables across genders in 12 Middle Eastern countries. The study used quarterly time series data on each country under investigation, covering 1991 to 2015. Phillips-Perron unit root tests were carried out to verify the stationarity of the examined economic series. An autoregressive distributed lag approach was adopted to conduct cointegration tests and estimate long-run regression coefficients and error correction terms. The results indicated that the IE served men and women differently across countries. Whereas this economy had a long-run positive relationship with men's employment rates in Bahrain, Iran, Qatar, and Turkey, this relationship existed among women only in Israel. IE activities matter in the employment of men and women in Middle Eastern countries. The sizes of IEs in the labor market are a significant factor that favors men's employment rather than that of women.

The digital economy, which boasts general technology, intense penetration, platform ecology, and low marginal cost, is a product of advanced digital technology. This new engine has become a driving force for high-quality economic development. From the three aspects of development momentum, efficiency, and structure, this paper profoundly explores internal mechanisms to lead the high-quality growth of the regional economy. By constructing an econometric model, the influence effect and means of the digital economy on the high-quality development of the regional economy are empirically tested. The digital economy and its three sub-dimensions can significantly promote the high-quality development of the regional economy. However, industrial digitalization has the most vital role in promoting it. The digital economy has shown a more vital promotion role in the central and western regions and provinces with low total factor productivity, and it can indirectly impact high-quality economic development by promoting dynamic, efficient, and structural changes.

Limited research on diabetes education and support implementation in Appalachia, which is a critical knowledge gap considering barriers to care, and high prevalence rates. The aim was to understand what each facility is providing regarding diabetes education and services within West Virginia. This study reports cognitive interview qualitative findings from a multi-methods study. Individuals were recruited through an online search to identify clinics, organizations, and hospital staff that provided diabetes education in the state of West Virginia. Eligible participants were individuals who facilitated and managed diabetes education and support in counties of West Virginia. The interviews followed an 11-item interview guide, approved, and reviewed by a practicing Registered Dietitian and Certified Diabetes Care Education Specialist in West Virginia. All qualitative data from the interviews were hand-coded using grounded theory, by two researchers. 15 participating organizations from the state of West Virginia were included and described three phenomena: Diabetes Education Implementation (differences in: evaluation measures, modality, delivery format, topical areas); Barriers to Care (staffing, lack of training, evaluation, loss of research partnerships and funding); and Facilitators to Care (community-based involvement, interdisciplinary collaboration, capacity building (trainings). There are concerns with program drift and "risky" adaptations such as inconsistent evaluative measures, lack of training for program facilitators, variety of delivery formats, and content material. Findings recommend more alignment in program delivery to better implementation. Further studies should assess patient experiences with implemented diabetes education programs in West Virginia to further support the current research findings.

This paper presents the process of conducting a community-wide needs assessment that initially focused on soliciting information about childcare needs of families with school-aged children. The researchers were interested in understanding whether the method designed to conduct the needs assessment helped to foster collaboration, trust, and increased participation amongst multiple levels of stakeholders and subcommunities. Utilizing community-based participatory research principles, the authors will present a 3-phase approach to gaining community support through multiple levels of stakeholder engagement. While initially the needs assessment was focused on childcare, the scope broadened to learning about other needs that families with school-aged children faced. The strategic use of Survey Ambassadors throughout the community who could access families that were typically underrepresented and could provide feedback to the researchers in real time regarding modifications to the process was vital. Lessons learned included the need for further investigation into strategic methods for gaining family voices in underrepresented populations.

With an educational issue that has caught the attention of many countries in the world (study load), a population of 8th graders from a typical Chinese metropolitan city (40,536 from 118 schools), and an advanced statistical strategy (multilevel piecewise regression), we examined whether there was a turning point in terms of the effects of study load on science achievement. We did identify a turning point for each and every measure of study load. For weekday learning on science achievement, we identified a turning point of 22.50 hr for the effects of in-school learning, 7.50 hr for the effects of homework, and 12 hr for the effects of after-school learning. For weekend learning on science achievement, we identified a turning point of 1.50 hr for the effects of in-school learning, 5 hr for the effects of homework, and 1 hr for the effects of after-school learning. In each case, the difference in effects before and after the turning point was statistically significant, indicating that the effects of study load on science achievement were nonlinear. All of these turning points offered important implications for science education.

Intelligence-led policing (ILP) was introduced in the 1990s as a proactive approach to policing, but to date, there is a lack of studies that have synthesized and summarized the central characteristics and insights of (quasi-)experimental studies related to ILP. This study aims to address this gap by synthesizing and characterizing the central characteristics of 38 quasi-experimental and experimental studies related to ILP. In this study, a scoping review is conducted on different quasi-experimental and experimental studies that relate to the framework of ILP. It was found that most studies within the domain of ILP focus on testing the crime reduction effects of using spatio-temporal crime intelligence to deploy police resources more efficiently and effectively. However, some studies have combined different types of crime intelligence or used solely offender-related intelligence. Several statistical-methodological challenges were also identified that should be considered when designing experimental research within the domain of ILP. Additionally, most studies focused solely on measuring crime reduction, with few focusing on secondary effects of interventions. The review concludes that future evaluation studies should consider evaluating the use of different types of crime intelligence and establish specific, objective, and realistic criteria for measuring specific performance measures such as crime disruption. Future experimental research within the domain of ILP should consider applying the 3-i model, evaluating each leg of ILP thoroughly. The limitations of the study are also discussed. This review provides valuable insights for future research and development of ILP-related approaches.