{"title":"Impact of contextual factors on the evaluation outcomes of national virtual simulation experimental teaching projects in biology and medicine","authors":"Zhengmei Zhou , Shidi Zhao , Ye Lin , Yan Li","doi":"10.1016/j.evalprogplan.2024.102470","DOIUrl":null,"url":null,"abstract":"<div><p>The number of applications for National Virtual Simulation Experimental Teaching Projects (NVSETPs) in China has seen a significant increase. Consequently, the influence of contextual factors and their potential personal connections on the evaluation results, whether for national or non-national NVSETPs, has become a prominent concern. In this study, we employed a modified back-chaining method using logistic regression to examine whether contextual factors in NVSETP applications could explain the evaluation outcomes. Our analysis was based on data available on the open platform of China's Ministry of Education (MOE). We identified several significant influencing factors, including the score on a five-point rating system, the number of clicks on the application page, school quality, school region, and the gender, title, and position of the applicants. Our results shed light on the impact of contextual factors on the evaluation results of NVSETPs in the fields of biology and medicine, using a modified back-chaining method. We conclude that enhancing the transparency of the assessment process and implementing standardized, detailed scoring guidelines for NVSETPs would mitigate the negative influence of contextual factors.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"106 ","pages":"Article 102470"},"PeriodicalIF":1.5000,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation and Program Planning","FirstCategoryId":"90","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0149718924000727","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
The number of applications for National Virtual Simulation Experimental Teaching Projects (NVSETPs) in China has seen a significant increase. Consequently, the influence of contextual factors and their potential personal connections on the evaluation results, whether for national or non-national NVSETPs, has become a prominent concern. In this study, we employed a modified back-chaining method using logistic regression to examine whether contextual factors in NVSETP applications could explain the evaluation outcomes. Our analysis was based on data available on the open platform of China's Ministry of Education (MOE). We identified several significant influencing factors, including the score on a five-point rating system, the number of clicks on the application page, school quality, school region, and the gender, title, and position of the applicants. Our results shed light on the impact of contextual factors on the evaluation results of NVSETPs in the fields of biology and medicine, using a modified back-chaining method. We conclude that enhancing the transparency of the assessment process and implementing standardized, detailed scoring guidelines for NVSETPs would mitigate the negative influence of contextual factors.
期刊介绍:
Evaluation and Program Planning is based on the principle that the techniques and methods of evaluation and planning transcend the boundaries of specific fields and that relevant contributions to these areas come from people representing many different positions, intellectual traditions, and interests. In order to further the development of evaluation and planning, we publish articles from the private and public sectors in a wide range of areas: organizational development and behavior, training, planning, human resource development, health and mental, social services, mental retardation, corrections, substance abuse, and education.