Evaluation Review最新文献

When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this paper, we leverage highly similar surveys, one conducted face-to-face (FTF) and the other via phone, to examine variation in interviewer effects across survey modality and question type. We find that while there are no cross-modality differences for simple questions, interviewer effects are markedly higher for sensitive questions asked over the phone. These findings are likely explained by the enhanced ability of in-person interviewers to foster rapport and engagement with respondents. We conclude with a thought experiment that illustrates the potential implications for power calculations, namely, that using FTF data to inform phone surveys may substantially underestimate the necessary sample size for sensitive questions.

Behaviour change communication (BCC) remains a central component of the interventions used in the fight against malaria in Ghana. However, there is limited evidence of its effectiveness. This study evaluated the effects of BCC strategies on knowledge (symptoms, causes and prevention) and overall knowledge of malaria among Ghanaian women aged 15-49 years. The propensity score matching (PSM) approach and logistic regression were used to analyse data from the 2016 edition of the Malaria Indicator Survey (MIS). Women who participated in community-level education or heard/saw media messages on malaria, or both, had significantly more knowledge of the disease than women who lacked access to any of these mediums of communication. The effect of these strategies on women's overall knowledge of malaria is about 2% to 4% and is higher on their knowledge of the symptoms (3% to 6%) and prevention (2% to 4%) than the causes (2%). The combined effects of both mediums of communication are relatively higher than the effect of either of them as a single medium of communication. Further analysis showed that improved knowledge of the disease is associated with higher preventive measures taken by women for themselves and for their children. The results are more significant in rural and poor households than in urban and non-poor households. These findings underscore the need for the Ministry of Health and its partner institutions to adopt an innovative approach which combines the two strategies in intensively educating Ghanaians, and women in particular, on the symptoms and prevention of malaria, giving due cognisance to households' socioeconomic status and geographical location.

Unfolding item response theory (IRT) models are important alternatives to dominance IRT models in describing the response processes on self-report tests. Their usage is common in personality measures, since they indicate potential differentiations in test score interpretation. This paper aims to gain a better insight into the structure of trait personality, by investigating whether the dominance or alternatively the unfolding IRT model are better descriptors of the response processes on a personality measure constructed under the dominance response theorem. For the assessment of the dominant model, the Graded Response Model (GRM) is used; while for the unfolding model, the Generalized Graded Unfolding Model (GGUM) was examined. All analyses are conducted with the freely available R. A sample of 1340 Greek adults, employed in private and public organizations, fulfilled the Trait Personality Questionnaire 5 short-form (TPQue5). Findings contradict previous research on trait personality. In accordance to the construction method employed, the TPQue5 items are best understood by monotonically increasing item response functions (IRFs). Individuals responding to the TPQue5 increase their probability of endorsing its items as their trait level increases; this stands for all personality dimensions, although Openness to Experience exhibited mixed type of item response patterns. Further research directions, implications and limitations are also discussed.

When planning a cluster randomized trial, evaluators often have access to an enumerated cohort representing the target population of clusters. Practicalities of conducting the trial, such as the need to oversample clusters with certain characteristics in order to improve trial economy or support inferences about subgroups of clusters, may preclude simple random sampling from the cohort into the trial, and thus interfere with the goal of producing generalizable inferences about the target population. We describe a nested trial design where the randomized clusters are embedded within a cohort of trial-eligible clusters from the target population and where clusters are selected for inclusion in the trial with known sampling probabilities that may depend on cluster characteristics (e.g., allowing clusters to be chosen to facilitate trial conduct or to examine hypotheses related to their characteristics). We develop and evaluate methods for analyzing data from this design to generalize causal inferences to the target population underlying the cohort. We present identification and estimation results for the expectation of the average potential outcome and for the average treatment effect, in the entire target population of clusters and in its non-randomized subset. In simulation studies, we show that all the estimators have low bias but markedly different precision. Cluster randomized trials where clusters are selected for inclusion with known sampling probabilities that depend on cluster characteristics, combined with efficient estimation methods, can precisely quantify treatment effects in the target population, while addressing objectives of trial conduct that require oversampling clusters on the basis of their characteristics.

This research aims to investigate information asymmetry in e-commerce supply chain channels and the impact of the fair preference model on the behavior and returns of channel members. Therefore, by contrasting it with the model in the completely rational case, this research establishes a more realistic principal-agent model and incorporates the fair preference model into the e-commerce supply chain channel. According to the model's analysis, the effort level of the retailer at each stage is positively correlated with the e-commerce efficiency coefficient, and the incentive coefficient of manufacturers is positively correlated with the e-commerce efficiency coefficient in the case where all rationality is assumed. Manufacturing companies' anticipated profits are positively correlated with the e-commerce efficiency coefficient. According to the fair preference model, retailers will put forth more effort to sell products when their fixed income from manufacturers is higher and their optimal effort level is positively correlated with that income. When e-commerce's efficiency coefficient is higher than 1, the retailer's revenue and effort exceeded those of traditional channels. Manufacturers and retailers both experience Pareto improvements in their earnings after the fair preference model is introduced.

In the modern educational landscape, the integration of gamification into hybrid learning environments has emerged as a promising approach to enhance student outcomes. However, there remains a lack of comprehensive frameworks for designing gamified hybrid courses and validating their impact on student outcomes. This paper proposes a design science-based approach to gamified course design in hybrid learning contexts. Drawing on the principles of design science research, we developed a framework for designing a gamified hybrid course curriculum that incorporates course content, activities, and assessments based on four elements of gamification (achievement elements, utilitarian value, hedonic benefits, and competition). To validate the effectiveness of our approach, we conducted a study with 294 students enrolled in a hybrid business course that implemented the proposed gamification framework. Our findings indicate that all gamification elements of our proposed gamified hybrid courses positively enhance student engagement, achievement, and satisfaction. Ultimately, this paper not only contributes to the 'gamification in education' literature by providing a comprehensive framework for designing engaging and effective hybrid courses but also proposes a roadmap for the application of design science to embed gamification in business course curriculum design within the context of modern hybrid learning environments.

The slowdown in economic development caused by traffic accidents in Spain, together with the disparity in the risk of death or injury due to traffic accidents in its provinces, makes it necessary to evaluate their road safety performance. Therefore, the objectives of the present research are, on the one hand, to find out the level of road safety efficiency of Spanish provinces in the period 2014-2018. On the other hand, it is also aimed to determine to what extent the annual efficiency change is originated by pure changes in efficiency or by technological changes. To achieve both objectives, the nonparametric technique of Data Envelopment Analysis and the Malmquist Index have been used based on the consideration of the Safety Performance Indicators (SPI) as the inputs of the process. The research findings show changes in the level of road safety efficiency in each of the years of the study period. Thus, it is possible to identify a geographical delimitation of the causes that generate changes in efficiency in recent years. A contraction in efficiency and technological progress is identified in part of the Spanish provinces in the north, northeast, and south of Spain.

Although scholars have discussed in depth about the evaluation content and the construction of evaluation index system of emergency management and crisis management, a unified and standardized interpretation of system construction concepts and empirical research on the performance evaluation of urban emergency management is still lacking. In view of this, this paper is based on the theory of the  crisis life cycle, with the four phases of urban emergency management and the content of the task as a clue, constructed a performance evaluation index system containing 12 primary indicators and 44 secondary indicators, and centered on the emergency management work situation of S city. The study reveals that emergency management underperforms in S city, with a score of 5.948, qualifying as the "defined level". The "prevention and preparedness stage" receives poor evaluation, indicating a significant bias for crisis response instead of prevention. The report suggests the improvement of emergency material stockpile planning, the formation of grassroots emergency response teams, the emergency management publicity, and special emergency drill plans, etc., with a view to providing reference for city managers to comprehensively review and evaluate the emergency management system, and to promote the construction of a more systematic, complete and scientific urban emergency management system.

Although considerable discussion has been devoted to the macro determinants of labor market variables across genders, comparatively little attention has been given to the contribution of the informal economy to this market. This study was aimed at empirically investigating the impact of the size of the shadow or informal economy (IE) on labor market variables across genders in 12 Middle Eastern countries. The study used quarterly time series data on each country under investigation, covering 1991 to 2015. Phillips-Perron unit root tests were carried out to verify the stationarity of the examined economic series. An autoregressive distributed lag approach was adopted to conduct cointegration tests and estimate long-run regression coefficients and error correction terms. The results indicated that the IE served men and women differently across countries. Whereas this economy had a long-run positive relationship with men's employment rates in Bahrain, Iran, Qatar, and Turkey, this relationship existed among women only in Israel. IE activities matter in the employment of men and women in Middle Eastern countries. The sizes of IEs in the labor market are a significant factor that favors men's employment rather than that of women.

The digital economy, which boasts general technology, intense penetration, platform ecology, and low marginal cost, is a product of advanced digital technology. This new engine has become a driving force for high-quality economic development. From the three aspects of development momentum, efficiency, and structure, this paper profoundly explores internal mechanisms to lead the high-quality growth of the regional economy. By constructing an econometric model, the influence effect and means of the digital economy on the high-quality development of the regional economy are empirically tested. The digital economy and its three sub-dimensions can significantly promote the high-quality development of the regional economy. However, industrial digitalization has the most vital role in promoting it. The digital economy has shown a more vital promotion role in the central and western regions and provinces with low total factor productivity, and it can indirectly impact high-quality economic development by promoting dynamic, efficient, and structural changes.