Studies in Educational Evaluation最新文献

Beliefs about the future, instantiated as a learner’s future time perspective, have been largely overlooked in the research on the connection between feedback and motivation. Because feedback statements vary in their level of specificity and friendliness (a commonly reported distinction between peer-provided and instructor-provided feedback), we were interested in the interplay between such feedback characteristics and learners’ future time perspective. With 392 U.S. undergraduates, we investigated how future time perspective (specifically, its valence and connectedness) affected whether learners perceived as constructive feedback statements that varied in specificity and friendliness, and whether gender and academic discipline would influence these perceptions. Future time perspective connectedness was positively associated with perceptions of feedback constructiveness for specific statements but was negatively related to constructiveness for unspecific statements. Valence was positively correlated with feedback constructiveness for unspecific statements. Although no differences in academic discipline were found, gender effects emerged. Implications for peer feedback are discussed.

This article presents a commentary on articles in the special issue entitled “Instructional Tools and Curricular Structures to Facilitate Students’ Generation of Self-feedback.” The articles explored the value of a diverse range of potential sources of feedback from the student perspective. Collectively, these articles highlight the potential of instructional tools and assessment resources in supporting students to generate self-feedback. Studies in this special issue also contribute innovative solutions to enable sustainable and effective feedback practices at scale, capitalising on technological advances. Overall, the findings amplify the importance of explicitly providing appropriate frames of reference such as rubrics, exemplars, and annotated exemplars, to support the generation of meaningful self-feedback. However, further research that makes the nature of self-feedback visible is needed. To progress research on self-feedback, I highlight the need for a strategic research agenda, as well as more sophisticated theoretical frameworks and fit-for-purpose methods.

The literature on the effects of teaching behavior on student competence and motivation has primarily focused on single teaching facets, with limited attention to multiple components simultaneously. To address this gap, this study examined a model of teaching and learning by investigating 10 teaching quality components reported by both students and teachers. The study used a sample of 3067 students in 150 schools in Germany and regressed reading competence and attitudes towards reading in grade 7 on these 10 variables. The study controlled for prior reading competence and attitudes towards reading in grade 5, as well as other student background characteristics, and estimated school-fixed effects. The results did not identify significant associations between the investigated teaching quality components and the reading competence and attitudes towards reading measures when considered simultaneously in one model, after taking into account previous competence and attitudes. The study discusses limitations and implications of these findings.

Under increasing pressure from quality assurance and other accountability concerns, it is easy to fall into the trap of assessing students only for the sake of assessment. This review aims to help educators rethink assessment in work-integrated learning (WIL) courses with purpose in mind by identifying the assessment methods used to assess student learning in such courses over the last 20 years, together with the underlying purposes of assessment. Based on the analysis of 103 selected articles from four databases and additional searching, 22 assessment methods and seven broad categories of assessment purposes were identified. One key finding is that the assessment of student learning in WIL courses outlined in the results was mainly implemented as assessment for learning to support students’ development as self-regulated, lifelong learners. Based on this finding, we propose three assessment design principles for self-regulated learning with recommendations on how to utilize different assessment methods to their fullest potential in preparing students for their futures.

To enhance the teaching-learning process and protect all concerned during COVID-19, a blended learning approach—comprising online learning as well as offline personal and collaborative learning—was used to impart a strengths intervention to foster personal growth initiative (PGI) among Pakistan’s university students. The sample comprised 176 students randomly allocated to a treatment (n = 88) and a wait-list control (n = 88) group. Growth curve modeling analyzed the developmental changes in participants’ PGI scores over time. PGI increased to a greater extent in the treatment group than in the control group immediately after the intervention as well as four and eight months later. There were also significant changes in students’ initial status (intercepts) and rates of changes over time (slopes). Moreover, students with high initial PGI scores had a slower linear increase, whereas those with low initial PGI scores had a faster increase in linear growth over time.

The development of children’s non-cognitive abilities is crucial for both individuals and society as a whole. In this study, using a follow-up survey on 5369 primary students in rural ethnic regions of northwest China, we aim to examine the levels of parental involvement in rural ethnic regions and investigate its effect on students’ non-cognitive abilities. Our results show the following: first, parental involvement in rural ethnic regions of northwest China is quite low. Parents pay more attention to their children’s academic performance than to their non-cognitive abilities and the personal involvement is seriously lacking. Second, students from families with more favorable economic status, high parental education levels, non-migrant parents, and primary caregivers who are parents experience higher levels of parental involvement. Though Han students generally have higher maternal involvement and lower paternal involvement than minorities, the ethnic differences are reduced after controlling the covariates. Third, using the value-added model, after controlling for individual, family, class, county and baseline variables, we find that maternal behavioral and personal involvement and paternal cognitive and behavioral involvement have significant positive effects on children’s non-cognitive abilities. We use causal identification methods including propensity score matching and Mahalanobis distance matching to do the robustness test.

With a sample of 2274 teachers from 181 lower-secondary schools in China, this study examined the principal instructional leadership effects on the rural-urban instructional quality gap, with a particular inquiry into the mechanism of teacher professional learning. The results show that there were significant gaps in three aspects of instructional quality (i.e., supportive climate, effective management, and cognitive activation) between rural and urban schools. Principal instructional leadership had significant total mediating effects on the rural-urban instructional disparities; however, its effects on the disparities between rural and urban teachers’ cognitive activation were partially suppressed. Particularly, the mechanism of teacher professional learning was identified through which principal instructional leadership explained the rural-urban instructional disparities. Research implications are also discussed.

This paper describes the development and initial validation of the Cognition and Emotion/Motivation Regulation (CEMOR) questionnaire, a task-specific questionnaire for upper elementary school students that measures self-regulated learning (SRL). Using a multistep procedure, 22 items were developed, divided over five theory-informed dimensions (Planning, Monitoring, Cognition Control, Emotion/Motivation Control, and Reflecting). The CEMOR was applied in a math context. Children from grades 3–6 (N = 547, 54.7 % females) completed the CEMOR. Confirmatory factor analyses indicated that the five proposed scales have adequate to good model fit, with factor loadings ranging from .54 to .83, and acceptable to good composite reliability (ρ range = .75–.85). To find further validity support, the SRL scales were correlated with students’ performance on a math task, experienced emotions, and level of motivation during the task. Most correlations were statistically significant and in the expected direction. Hence, the CEMOR questionnaire shows promise as a new SRL instrument for elementary education.

Learning losses during the COVID-19 pandemic have been well documented. In this paper, we attempt to learn more about the determinants of the magnitude of the adverse effects of the emergency shift to remote learning in Polish upper secondary schools. Because of concerns that differences in access to and quality of local internet would disadvantage lower socio-economic status children, the analysis focuses on local internet speed and the structure of remote classes. We adopt a value-added framework to account for differences among students, families, and prior school quality and find that local internet speed and the structure of remote classes are strongly related to the achievement of vocational school students. Those in communities with internet speed in the lowest decile fare particularly poorly in mathematics, highlighting the adverse effects of deficiencies in infrastructure and access to higher-quality internet services.

Numerous studies have highlighted the significant role of Student Evaluations of Teaching (SETs) as a key metric for assessing teaching quality in Higher Education (HE). Building upon these insights, our study introduces an innovative four-tiered model, derived from diverse research, to examine the reliability of SETs. This model addresses biases associated with SETs, delving into both statistical anomalies and cognitive biases, with particular emphasis on often-overlooked hidden context and timing factors. We reveal that these biases can distort SET scores, leading to potentially inaccurate representations of both individual and comparative academic performances. The implications of our research are significant for those influencing HE policy-making and performance evaluation. We echo previous calls for a more expansive approach to teaching effectiveness, essential for genuine insight into teaching quality. By adopting this perspective, HE can design better-informed strategies, ensuring policies and practices reflect the diverse nature of teaching excellence.