首页 > 最新文献

Studies in Educational Evaluation最新文献

英文 中文
Implementing educational innovations through facilitators: Cascade model works, yet school contexts matter 通过促进者实施教育创新:级联模式有效,但学校环境很重要
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-03-24 DOI: 10.1016/j.stueduc.2025.101456
Rebekka Stahnke , Dilan Şahin-Gür , Corinna Hankeln , Susanne Prediger
The cascade model, in which facilitators provide professional development to teachers who then implement innovations, can result in diluted impact along the cascades. Effectiveness has rarely been shown for the level of student outcomes and supportive conditions, such as teacher collaboration and principal leadership, are needed. This study examines whether implementing a research-based, language-responsive mathematics innovation through a cascade model impacts student outcomes and whether teacher collaboration and principal leadership support implementation. Student outcomes were assessed before and after the teaching unit in view in an intervention group and a control group (n = 479), with school context conditions reported by teachers. Multilevel models revealed that implementation in the cascade model was effective in improving student outcomes. Principal leadership positively predicted outcomes, especially in the control group providing mathematics instruction as usual, while teacher collaboration was a negative predictor. Implications for future research and the design of professional development programs are discussed.
在梯级模型中,辅导员为教师提供专业发展,然后教师实施创新,这可能导致梯级效应减弱。在学生成绩水平和支持性条件(如教师合作和校长领导)方面,很少显示出有效性。本研究考察了通过级联模型实施基于研究、语言响应的数学创新是否会影响学生的成绩,以及教师合作和校长领导是否支持实施。在干预组和对照组(n = 479)中,在教师报告的学校环境条件下,评估了教学单元前后的学生成绩。多层次模型表明,级联模型的实施在提高学生成绩方面是有效的。校长领导正向预测结果,特别是在照常提供数学教学的对照组,而教师合作是负向预测因子。对未来研究的启示和专业发展计划的设计进行了讨论。
{"title":"Implementing educational innovations through facilitators: Cascade model works, yet school contexts matter","authors":"Rebekka Stahnke ,&nbsp;Dilan Şahin-Gür ,&nbsp;Corinna Hankeln ,&nbsp;Susanne Prediger","doi":"10.1016/j.stueduc.2025.101456","DOIUrl":"10.1016/j.stueduc.2025.101456","url":null,"abstract":"<div><div>The cascade model, in which facilitators provide professional development to teachers who then implement innovations, can result in diluted impact along the cascades. Effectiveness has rarely been shown for the level of student outcomes and supportive conditions, such as teacher collaboration and principal leadership, are needed. This study examines whether implementing a research-based, language-responsive mathematics innovation through a cascade model impacts student outcomes and whether teacher collaboration and principal leadership support implementation. Student outcomes were assessed before and after the teaching unit in view in an intervention group and a control group (<em>n</em> = 479), with school context conditions reported by teachers. Multilevel models revealed that implementation in the cascade model was effective in improving student outcomes. Principal leadership positively predicted outcomes, especially in the control group providing mathematics instruction as usual, while teacher collaboration was a negative predictor. Implications for future research and the design of professional development programs are discussed.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101456"},"PeriodicalIF":2.6,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143685790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
“Due to the composition of the feedback, I think it’s a girl”: The effects of gender and peer feedback content on essay revisions and perceptions of peer feedback “由于反馈的构成,我认为这是一个女孩”:性别和同伴反馈内容对论文修改和同伴反馈看法的影响
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-03-13 DOI: 10.1016/j.stueduc.2025.101455
José Carlos G. Ocampo , Ernesto Panadero , Iván Sánchez-Iglesias , Fernando Díez Ruiz
This study explores the impact of peer feedback content (concise general vs elaborated specific), assessee gender (male vs female), and fictitious assessor gender (male vs female vs anonymous) on essay revisions and perceptions of peer feedback. A total of 284 undergraduate students (nMen = 138, nWomen = 146) from two private universities in the Philippines participated in this study. Participants submitted an argumentative essay draft (pre-test), received concise general or elaborate specific peer feedback from a fictitious male or female or anonymous peer assessor, and submitted a revised argumentative essay (post-test). We found that the pre-test and post-test essay scores were unaffected by feedback content, assessee, or assessor gender. However, a significant triple interaction emerged between assessee gender, feedback content, and assessment time. Similarly, triple interactions were found for trust in peers as assessors and perceived adequacy of feedback. No interactions were observed for perceptions of (dis)comfort and motivation.
本研究探讨了同行反馈内容(简明概括vs详细阐述)、评估者性别(男性vs女性)和虚构评估者性别(男性vs女性vs匿名)对论文修改和对同行反馈的看法的影响。来自菲律宾两所私立大学的284名本科生(nMen = 138, nWomen = 146)参与了本研究。参与者提交一篇议论文草稿(预测试),从一个虚构的男性或女性或匿名的同行评议员那里收到简明概括或详细具体的同行反馈,并提交一篇修改后的议论文(后测试)。我们发现测试前和测试后的作文分数不受反馈内容、被评估者或评估者性别的影响。然而,在被评估者性别、反馈内容和评估时间之间出现了显著的三重交互作用。同样地,在同伴作为评估者的信任和反馈的感知充分性方面发现了三重交互作用。没有观察到(不适)舒适感和动机之间的相互作用。
{"title":"“Due to the composition of the feedback, I think it’s a girl”: The effects of gender and peer feedback content on essay revisions and perceptions of peer feedback","authors":"José Carlos G. Ocampo ,&nbsp;Ernesto Panadero ,&nbsp;Iván Sánchez-Iglesias ,&nbsp;Fernando Díez Ruiz","doi":"10.1016/j.stueduc.2025.101455","DOIUrl":"10.1016/j.stueduc.2025.101455","url":null,"abstract":"<div><div>This study explores the impact of peer feedback content (concise general vs elaborated specific), assessee gender (male vs female), and fictitious assessor gender (male vs female vs anonymous) on essay revisions and perceptions of peer feedback. A total of 284 undergraduate students (n<sub>Men</sub> = 138, n<sub>Women</sub> = 146) from two private universities in the Philippines participated in this study. Participants submitted an argumentative essay draft (pre-test), received concise general or elaborate specific peer feedback from a fictitious male or female or anonymous peer assessor, and submitted a revised argumentative essay (post-test). We found that the pre-test and post-test essay scores were unaffected by feedback content, assessee, or assessor gender. However, a significant triple interaction emerged between assessee gender, feedback content, and assessment time. Similarly, triple interactions were found for trust in peers as assessors and perceived adequacy of feedback. No interactions were observed for perceptions of (dis)comfort and motivation.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101455"},"PeriodicalIF":2.6,"publicationDate":"2025-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143609492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond basic skills: An effective foundation intervention for low-achieving fifth graders’ understanding of basic concepts 超越基本技能:对成绩较差的五年级学生基本概念理解的有效基础干预
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-02-27 DOI: 10.1016/j.stueduc.2025.101452
Susanne Prediger , Kim-Alexandra Rösike , Anke Wischgoll
Low-achieving students need targeted interventions to remediate the critical foundational knowledge required for successful further learning trajectories. For Grade 5, critical basic concepts (e.g., place-value understanding and meaning of multiplication) and basic skills (e.g., counting in steps and multiplication facts) have been identified as equally important and highly intertwined. However, evidence for the effectiveness of foundation intervention programs has mainly been provided for basic skills and for younger children’s understanding of basic concepts but has not yet been sufficiently provided for fifth graders’ understanding of basic concepts. In this paper, we present a quasi-experimental implementation trial (n = 295) on the effectiveness of the Mastering Math foundation intervention program that aims at fostering understanding of basic concepts in arithmetic. Teachers in the intervention group were prepared in professional development courses and supported by detailed formative assessment and teaching materials to foster low-achieving students’ understanding in small-group interventions supplemental to the regular mathematics classrooms. Teachers in the control classes received assessment feedback on students’ achievement and the suggestion to work on basic skills and basic concepts, but no professional development or teaching materials for their regular mathematics classrooms. The intervention group was compared to a control group (selected by propensity score matching) by analyses of variances with repeated measures, applying gender, socioeconomic status, immigrant background, and reading proficiency as co-variates. The intervention group significantly outperformed the control group in the explicitly covered basic concepts. No transfer effect was found for basic skills. Further analyses showed that the intervention group learned significantly more than their higher-achieving classmates. Most interesting was a positive spillover effect that all students in the Mastering Math schools learned significantly more basic concepts of below-grade content, so the teachers’ professional experiences in the small-group foundation intervention seem to also have diffused into their regular classrooms. The results show that, when teachers gain additional expertise on fostering understanding of basic concepts, conceptually focused foundation intervention programs targeting understanding of basic concepts can be effectively implemented and can even have an impact on the learning of those students who did not attend the small-group intervention.
成绩差的学生需要有针对性的干预,以弥补成功进一步学习所需的关键基础知识。对于五年级,关键的基本概念(例如,对数位的理解和乘法的含义)和基本技能(例如,步数和乘法事实)被确定为同等重要且高度交织的。然而,基础干预项目有效性的证据主要是针对基本技能和幼儿对基本概念的理解提供的,但尚未为五年级学生对基本概念的理解提供充分的证据。在本文中,我们提出了一项准实验实施试验(n = 295),旨在促进对算术基本概念的理解的掌握数学基础干预计划的有效性。干预组的教师接受了专业发展课程的培训,并得到了详细的形成性评估和教材的支持,以促进成绩差的学生在常规数学课堂的补充小组干预中理解。控制班的老师收到了学生成绩的评估反馈,以及在基本技能和基本概念方面的建议,但他们的常规数学课堂没有专业发展或教材。通过重复测量的方差分析,将性别、社会经济地位、移民背景和阅读能力作为协变量,将干预组与对照组(通过倾向评分匹配选择)进行比较。干预组在明确涵盖的基本概念上明显优于对照组。基本技能未发现迁移效应。进一步的分析表明,干预组比他们成绩更好的同学学得更多。最有趣的是一个积极的溢出效应,所有的学生在精通数学学校学习到的低年级内容的基本概念明显更多,所以教师在小组基础干预中的专业经验似乎也扩散到他们的常规课堂。结果表明,当教师在培养对基本概念的理解方面获得额外的专业知识时,以理解基本概念为目标的以概念为重点的基础干预计划可以有效地实施,甚至可以对那些没有参加小组干预的学生的学习产生影响。
{"title":"Beyond basic skills: An effective foundation intervention for low-achieving fifth graders’ understanding of basic concepts","authors":"Susanne Prediger ,&nbsp;Kim-Alexandra Rösike ,&nbsp;Anke Wischgoll","doi":"10.1016/j.stueduc.2025.101452","DOIUrl":"10.1016/j.stueduc.2025.101452","url":null,"abstract":"<div><div>Low-achieving students need targeted interventions to remediate the critical foundational knowledge required for successful further learning trajectories. For Grade 5, critical basic concepts (e.g., place-value understanding and meaning of multiplication) and basic skills (e.g., counting in steps and multiplication facts) have been identified as equally important and highly intertwined. However, evidence for the effectiveness of foundation intervention programs has mainly been provided for basic skills and for younger children’s understanding of basic concepts but has not yet been sufficiently provided for fifth graders’ understanding of basic concepts. In this paper, we present a quasi-experimental implementation trial (<em>n</em> = 295) on the effectiveness of the Mastering Math foundation intervention program that aims at fostering understanding of basic concepts in arithmetic. Teachers in the intervention group were prepared in professional development courses and supported by detailed formative assessment and teaching materials to foster low-achieving students’ understanding in small-group interventions supplemental to the regular mathematics classrooms. Teachers in the control classes received assessment feedback on students’ achievement and the suggestion to work on basic skills and basic concepts, but no professional development or teaching materials for their regular mathematics classrooms. The intervention group was compared to a control group (selected by propensity score matching) by analyses of variances with repeated measures, applying gender, socioeconomic status, immigrant background, and reading proficiency as co-variates. The intervention group significantly outperformed the control group in the explicitly covered basic concepts. No transfer effect was found for basic skills. Further analyses showed that the intervention group learned significantly more than their higher-achieving classmates. Most interesting was a positive spillover effect that all students in the Mastering Math schools learned significantly more basic concepts of below-grade content, so the teachers’ professional experiences in the small-group foundation intervention seem to also have diffused into their regular classrooms. The results show that, when teachers gain additional expertise on fostering understanding of basic concepts, conceptually focused foundation intervention programs targeting understanding of basic concepts can be effectively implemented and can even have an impact on the learning of those students who did not attend the small-group intervention.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101452"},"PeriodicalIF":2.6,"publicationDate":"2025-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143510757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Longitudinal relations among perceived autonomy support, time management, completion, and achievement 感知自主支持、时间管理、完成与成就的纵向关系
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-02-08 DOI: 10.1016/j.stueduc.2025.101454
Jianzhong Xu
Informed by self-determination and self-regulation frameworks, this study aims to examine the longitudinal relations among autonomy support, time management, homework completion, and mathematics achievement. Middle school in China encompasses grades 6–8, and this study specifically examines 8th graders. Data from these students at two time points (Time 1[T1] and Time 2 [T2]) over one school year showed a bidirectional positive association between autonomy support and time management. Moreover, higher levels of autonomy support at T1 led to higher T2 achievement. Finally, higher levels of time management at T1 resulted in higher T2 homework completion and achievement. This study extends previous research by integrating self-regulation and self-determination frameworks to examine homework behavior and performance with longitudinal data, offering far-reaching implications for research and practice, particularly emphasizing the dual importance of promoting autonomy support and time management.
在自我决定和自我调节框架下,本研究旨在探讨自主支持、时间管理、作业完成与数学成绩之间的纵向关系。中国的中学涵盖6-8年级,本研究专门调查了8年级学生。这些学生在一个学年的两个时间点(时间1[T1]和时间2 [T2])的数据显示,自主支持与时间管理之间存在双向正相关。此外,较高的T1自主支持水平会导致更高的T2成就。最后,T1阶段的时间管理水平越高,T2阶段的作业完成度和成绩也越高。本研究通过整合自我调节和自我决定框架,以纵向数据考察家庭作业行为和绩效,对研究和实践具有深远的意义,特别强调了促进自主支持和时间管理的双重重要性。
{"title":"Longitudinal relations among perceived autonomy support, time management, completion, and achievement","authors":"Jianzhong Xu","doi":"10.1016/j.stueduc.2025.101454","DOIUrl":"10.1016/j.stueduc.2025.101454","url":null,"abstract":"<div><div>Informed by self-determination and self-regulation frameworks, this study aims to examine the longitudinal relations among autonomy support, time management, homework completion, and mathematics achievement. Middle school in China encompasses grades 6–8, and this study specifically examines 8th graders. Data from these students at two time points (Time 1[T1] and Time 2 [T2]) over one school year showed a bidirectional positive association between autonomy support and time management. Moreover, higher levels of autonomy support at T1 led to higher T2 achievement. Finally, higher levels of time management at T1 resulted in higher T2 homework completion and achievement. This study extends previous research by integrating self-regulation and self-determination frameworks to examine homework behavior and performance with longitudinal data, offering far-reaching implications for research and practice, particularly emphasizing the dual importance of promoting autonomy support and time management.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101454"},"PeriodicalIF":2.6,"publicationDate":"2025-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143350861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring factors contributing to feedback-seeking strategies in L2 writing: An extended cost-value framework 探讨第二语言写作中反馈寻求策略的影响因素:一个扩展的成本-价值框架
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-02-06 DOI: 10.1016/j.stueduc.2025.101453
Huiyuan Gu
L2 writing research has primarily focused on motivation to write as an antecedent of feedback-seeking behavior (FSB). To date, few studies have considered L2 learners’ perceived costs and values of the feedback per se. To address this research gap, this study applies an extended cost-value framework to explore the predictive effects of L2 learners’ perceptions of the costs and values associated with teacher feedback on their strategies to seek teacher feedback (i.e., feedback monitoring and inquiry). Data were collected from 294 Chinese tertiary English learners using structured questionnaires and processed using partial least squares structural equation modeling. It was found that interest and utility values positively predicted both feedback monitoring and feedback inquiry. Effort cost negatively predicted feedback monitoring, whereas self-presentation cost negatively predicted feedback inquiry. The study also showed that interest value mediated the relationships between utility value and feedback strategies. The results of the study lend support to the postulations of the cost-value framework, establishing feedback perceptions as a proximal antecedent of feedback-seeking strategies in L2 writing. Practical implications on how to enhance feedback practices are discussed.
二语写作研究主要集中在写作动机作为反馈寻求行为(FSB)的前因。迄今为止,很少有研究考虑到二语学习者对反馈本身的感知成本和价值。为了解决这一研究缺口,本研究采用了一个扩展的成本-价值框架来探讨二语学习者对与教师反馈相关的成本和价值的感知对他们寻求教师反馈的策略(即反馈监控和查询)的预测作用。采用结构化问卷法对294名中国大专英语学习者进行数据收集,并采用偏最小二乘结构方程模型对数据进行处理。研究发现,兴趣值和效用值对反馈监测和反馈查询均有正向预测作用。努力成本负向预测反馈监控,而自我呈现成本负向预测反馈查询。研究还发现,兴趣价值在效用价值与反馈策略之间起中介作用。研究结果支持了成本-价值框架的假设,将反馈感知作为二语写作中反馈寻求策略的近前因。讨论了如何加强反馈实践的实际意义。
{"title":"Exploring factors contributing to feedback-seeking strategies in L2 writing: An extended cost-value framework","authors":"Huiyuan Gu","doi":"10.1016/j.stueduc.2025.101453","DOIUrl":"10.1016/j.stueduc.2025.101453","url":null,"abstract":"<div><div>L2 writing research has primarily focused on motivation to write as an antecedent of feedback-seeking behavior (FSB). To date, few studies have considered L2 learners’ perceived costs and values of the feedback <em>per se</em>. To address this research gap, this study applies an extended cost-value framework to explore the predictive effects of L2 learners’ perceptions of the costs and values associated with teacher feedback on their strategies to seek teacher feedback (i.e., feedback monitoring and inquiry). Data were collected from 294 Chinese tertiary English learners using structured questionnaires and processed using partial least squares structural equation modeling. It was found that interest and utility values positively predicted both feedback monitoring and feedback inquiry. Effort cost negatively predicted feedback monitoring, whereas self-presentation cost negatively predicted feedback inquiry. The study also showed that interest value mediated the relationships between utility value and feedback strategies. The results of the study lend support to the postulations of the cost-value framework, establishing feedback perceptions as a proximal antecedent of feedback-seeking strategies in L2 writing. Practical implications on how to enhance feedback practices are discussed.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101453"},"PeriodicalIF":2.6,"publicationDate":"2025-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143195482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Network, school, and student demographic level effects of a networked improvement community on student reading outcomes 网络、学校和学生人口统计水平对网络改进社区对学生阅读结果的影响
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-01-28 DOI: 10.1016/j.stueduc.2025.101451
Anna E. Premo , Christian Schunn
Networked Improvement Communities, or NICs, are a type of research-practice partnership that have become a popular approach to large-scale educational change. Despite the growing prevalence of NICs in education, however, there is little research on their effects on student outcomes, particularly with attention to their multi-level complexity and whether they lead to more equitable outcomes. In this study, we test an approach for evaluating the effects of network participation on the growth of student reading outcomes in a large NIC relative to a set of matched non-network schools. Overall, schools participating in the NIC showed growth in reading outcomes that outpaced matched schools in the state by an additional 5 %. Benefits varied by school, which could be explained by levels of teacher participation and depth of implementation. In addition, historically disadvantaged students especially benefited from NIC participation.
网络改进社区(nic)是一种研究与实践的伙伴关系,已经成为大规模教育变革的一种流行方法。然而,尽管NICs在教育中越来越普遍,但关于其对学生成绩的影响的研究却很少,特别是关注其多层次的复杂性以及它们是否会导致更公平的结果。在本研究中,我们测试了一种评估网络参与对大型NIC中学生阅读结果增长的影响的方法,而不是一组匹配的非网络学校。总体而言,参加NIC的学校在阅读成绩方面的增长速度比该州的同类学校高出5% %。效益因学校而异,这可以通过教师参与程度和实施深度来解释。此外,历史上处于不利地位的学生尤其受益于NIC的参与。
{"title":"Network, school, and student demographic level effects of a networked improvement community on student reading outcomes","authors":"Anna E. Premo ,&nbsp;Christian Schunn","doi":"10.1016/j.stueduc.2025.101451","DOIUrl":"10.1016/j.stueduc.2025.101451","url":null,"abstract":"<div><div>Networked Improvement Communities, or NICs, are a type of research-practice partnership that have become a popular approach to large-scale educational change. Despite the growing prevalence of NICs in education, however, there is little research on their effects on student outcomes, particularly with attention to their multi-level complexity and whether they lead to more equitable outcomes. In this study, we test an approach for evaluating the effects of network participation on the growth of student reading outcomes in a large NIC relative to a set of matched non-network schools. Overall, schools participating in the NIC showed growth in reading outcomes that outpaced matched schools in the state by an additional 5 %. Benefits varied by school, which could be explained by levels of teacher participation and depth of implementation. In addition, historically disadvantaged students especially benefited from NIC participation.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101451"},"PeriodicalIF":2.6,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143096966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating text quality: Teachers’ perceptions about pupils’ writing 评价文本质量:教师对学生写作的看法
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-01-22 DOI: 10.1016/j.stueduc.2025.101444
Anat Stavans , Sara Zadunaisky Ehrlich
This study provides a view of elementary school experienced and novice teachers’ perceptions on text quality evaluation of written products in Israel. Questionnaires explored: the perceptions of general elements adjudicated to text quality, a holistic textbased teachers’ evaluation concomitant with experts’ evaluation, and texts quality textual and linguistic indicators concordant with the experts’ ranking of the same texts. Questionnaires were collected from 204 participants (101 teacher-trainees of Elementary Education (TT), and 103 in-service teachers (T) in Elementary schools in Central Israel). The findings show that experienced (T) and novice (TT) teachers share knowledge about text quality when incipient writers are concerned. T’s evaluations diverged from the experts’ evaluations because they evaluate both process and product grounded in their knowledge and experience with writing stages of development underlying text production at different grade levels. TT converge with the experts’ “objective” evaluation because they focus on the text product.
本研究提供以色列小学经验教师与新手教师对书面产品文本质量评价的看法。问卷调查探讨了对文本质量判定的一般要素的感知,基于文本的教师评价与专家评价相结合的整体评价,以及与专家对同一文本的排名一致的文本质量、文本和语言指标。问卷共收集204名参与者(101名基础教育培训教师和103名以色列中部小学在职教师)。研究结果表明,当初出茅庐的写作者关注文本质量时,经验丰富的教师和新手教师对文本质量的认识是相同的。T的评估与专家的评估不同,因为他们基于他们的知识和经验来评估过程和产品,这些知识和经验是基于不同年级水平的文本生产的发展阶段。TT与专家的“客观”评价趋于一致,因为他们关注的是文本产品。
{"title":"Evaluating text quality: Teachers’ perceptions about pupils’ writing","authors":"Anat Stavans ,&nbsp;Sara Zadunaisky Ehrlich","doi":"10.1016/j.stueduc.2025.101444","DOIUrl":"10.1016/j.stueduc.2025.101444","url":null,"abstract":"<div><div>This study provides a view of elementary school experienced and novice teachers’ perceptions on text quality evaluation of written products in Israel. Questionnaires explored: the perceptions of general elements adjudicated to text quality, a holistic textbased teachers’ evaluation concomitant with experts’ evaluation, and texts quality textual and linguistic indicators concordant with the experts’ ranking of the same texts. Questionnaires were collected from 204 participants (101 teacher-trainees of Elementary Education (TT), and 103 in-service teachers (T) in Elementary schools in Central Israel). The findings show that experienced (T) and novice (TT) teachers share knowledge about text quality when incipient writers are concerned. T’s evaluations diverged from the experts’ evaluations because they evaluate both process and product grounded in their knowledge and experience with writing stages of development underlying text production at different grade levels. TT converge with the experts’ “objective” evaluation because they focus on the text product.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101444"},"PeriodicalIF":2.6,"publicationDate":"2025-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143096894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Checkbox grading of large-scale mathematics exams with multiple assessors: Field study on assessors’ inter-rater reliability, time investment and usage experience 多审核员的大规模数学考试的复选框评分:对审核员间可靠性、时间投入和使用经验的实地研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-01-16 DOI: 10.1016/j.stueduc.2024.101443
Filip Moons , Ellen Vandervieren , Jozef Colpaert
Assessing exams with multiple assessors is challenging regarding inter-rater reliability and feedback. This paper presents ‘checkbox grading,’ a digital method where exam designers have predefined checkboxes with both feedback and associated partial grades. Assessors then tick the checkboxes relevant to a student solution. Dependencies between checkboxes ensure consistency among assessors in following the grading scheme. Moreover, the approach supports ‘blind grading’ by hiding the grades associated with the checkboxes, thus focusing assessors on the criteria rather than the scores. The approach was studied during a large-scale mathematics state exam. Results show that assessors perceived checkbox grading as very useful. However, compared to traditional grading—where assessors follow a correction scheme and communicate the resulting grade—more time is spent on checkbox grading, while both approaches are equally reliable. Blind grading improved inter-rater reliability for some tasks. Overall, checkbox grading might lead to a smoother process where feedback, not solely grades, is communicated to students.
评估多名评估员的考试在评估员之间的可靠性和反馈方面具有挑战性。本文提出了“复选框评分”,这是一种数字方法,其中考试设计者预定义了带有反馈和相关部分分数的复选框。然后,评估员在与学生解决方案相关的复选框中打勾。复选框之间的依赖关系确保评估人员遵循评分方案的一致性。此外,该方法通过隐藏与复选框相关的分数来支持“盲目评分”,从而将评估人员集中在标准而不是分数上。在一次大型数学国家考试中对该方法进行了研究。结果表明,评估人员认为复选框评分非常有用。然而,与传统的评分方式相比,在传统的评分方式中,审核员遵循一个修正方案并传达结果的分数,更多的时间花在复选框评分上,而这两种方法同样可靠。盲评分提高了某些任务的评分者之间的可靠性。总的来说,复选框评分可能会导致一个更顺畅的过程,反馈,而不仅仅是分数,传达给学生。
{"title":"Checkbox grading of large-scale mathematics exams with multiple assessors: Field study on assessors’ inter-rater reliability, time investment and usage experience","authors":"Filip Moons ,&nbsp;Ellen Vandervieren ,&nbsp;Jozef Colpaert","doi":"10.1016/j.stueduc.2024.101443","DOIUrl":"10.1016/j.stueduc.2024.101443","url":null,"abstract":"<div><div>Assessing exams with multiple assessors is challenging regarding inter-rater reliability and feedback. This paper presents ‘checkbox grading,’ a digital method where exam designers have predefined checkboxes with both feedback and associated partial grades. Assessors then tick the checkboxes relevant to a student solution. Dependencies between checkboxes ensure consistency among assessors in following the grading scheme. Moreover, the approach supports ‘blind grading’ by hiding the grades associated with the checkboxes, thus focusing assessors on the criteria rather than the scores. The approach was studied during a large-scale mathematics state exam. Results show that assessors perceived checkbox grading as very useful. However, compared to traditional grading—where assessors follow a correction scheme and communicate the resulting grade—more time is spent on checkbox grading, while both approaches are equally reliable. Blind grading improved inter-rater reliability for some tasks. Overall, checkbox grading might lead to a smoother process where feedback, not solely grades, is communicated to students.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"85 ","pages":"Article 101443"},"PeriodicalIF":2.6,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143096893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A study on the effect of peer assessment on children's knowledge construction processes based on Epistemic Network Analysis 基于认知网络分析的同伴评价对儿童知识建构过程的影响研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-01-08 DOI: 10.1016/j.stueduc.2024.101441
Xia Zhang, Yan Wang, Hao Chen
Peer assessment promotes the development of children's higher-order cognitive skills.This study used epistemic network analysis to implement a 12-week peer assessment teaching strategy in a first-grade art course at an elementary school in China. It aimed to explore the impact of peer assessment on children's knowledge construction process in an art course from a time-series perspective. The results show that:(1)Peer assessment is effective in enhancing children's deeper knowledge construction and helping them to construct knowledge on higher-order cognitive structures.(2)Children with different levels of metacognitive self-regulation focused on different elements of knowledge, and peer assessment had a more pronounced effect on the integrated and deeper construction of cognitive structures in children with high levels of metacognitive self-regulation.(3)There were differences in the elements of knowledge that children of different genders focused on at different stages of the curriculum process. However, the overall process of knowledge construction progressed from shallow to deep learning, with no significant gender differences in this progression. Our findings not only enrich the process of constructing knowledge through peer assessment for first-grade students in the art program, but also provide insights for art teachers and educators to carry out educational activities.
同伴评价促进儿童高阶认知技能的发展。本研究采用认知网络分析法,在中国一所小学的一年级艺术课程中实施为期12周的同伴评估教学策略。本研究旨在从时间序列的角度探讨同伴评价对美术课儿童知识建构过程的影响。结果表明:(1)同伴评价能够有效地促进幼儿的深层知识建构,帮助幼儿在高阶认知结构上构建知识;(2)不同元认知自我调节水平的幼儿对知识要素的关注程度不同;(3)不同性别儿童在课程过程的不同阶段所关注的知识要素存在差异。然而,知识建构的整体过程从浅学习到深度学习,在这个过程中没有显著的性别差异。我们的研究结果不仅丰富了艺术专业一年级学生通过同伴评估构建知识的过程,而且为艺术教师和教育工作者开展教育活动提供了见解。
{"title":"A study on the effect of peer assessment on children's knowledge construction processes based on Epistemic Network Analysis","authors":"Xia Zhang,&nbsp;Yan Wang,&nbsp;Hao Chen","doi":"10.1016/j.stueduc.2024.101441","DOIUrl":"10.1016/j.stueduc.2024.101441","url":null,"abstract":"<div><div>Peer assessment promotes the development of children's higher-order cognitive skills.This study used epistemic network analysis to implement a 12-week peer assessment teaching strategy in a first-grade art course at an elementary school in China. It aimed to explore the impact of peer assessment on children's knowledge construction process in an art course from a time-series perspective. The results show that:(1)Peer assessment is effective in enhancing children's deeper knowledge construction and helping them to construct knowledge on higher-order cognitive structures.(2)Children with different levels of metacognitive self-regulation focused on different elements of knowledge, and peer assessment had a more pronounced effect on the integrated and deeper construction of cognitive structures in children with high levels of metacognitive self-regulation.(3)There were differences in the elements of knowledge that children of different genders focused on at different stages of the curriculum process. However, the overall process of knowledge construction progressed from shallow to deep learning, with no significant gender differences in this progression. Our findings not only enrich the process of constructing knowledge through peer assessment for first-grade students in the art program, but also provide insights for art teachers and educators to carry out educational activities.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"84 ","pages":"Article 101441"},"PeriodicalIF":2.6,"publicationDate":"2025-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143158305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The impacts of self-monitoring prompt on provision and uptake of peer feedback and on revision performance: A mixed methods study 自我监控提示对同伴反馈的提供和吸收以及对复习成绩的影响:一项混合方法研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2025-01-03 DOI: 10.1016/j.stueduc.2024.101442
Yi Zhang , Hui Chen , Jingran Wang , Zhongling Pi , Jiumin Yang
In the context of online formative peer assessment (FPA), both the provision of quality peer feedback and critical implementation of received feedback are intellectually demanding tasks that require cognitive and metacognitive effort from students. To facilitate these processes, this study designed a self-monitoring prompt (SMP) as a metacognitive scaffold and examined its impact on students’ provision of peer feedback and its uptake, as well as students’ revision performance in an undergraduate course titled “Modern Educational Technology”. Adopting a mixed-methods research design, 116 junior undergraduates from China participated in an online FPA task over three weeks, with 68 students in the experimental group (with SMP support; SMP+) and 48 students in the control group (without SMP support; SMP-). However, due to specific data exclusion criteria, not all participants were included in each analysis: 90 students for the provision of peer feedback, and 97 students for both the uptake of peer feedback and the chain mediation analysis. The results indicated that SMP did not significantly change feedback quantity (p = .950), but it did enhance its quality (p = .019). The SMP+ group showed a greater tendency to apply the received peer feedback (p = .002), were less likely to ignore it (p = .014), and achieved better revision performance than the students in the SMP- group (p = .003). Further chain mediation analyses revealed the complex ways SMP influenced revision performance. Overall, the study underscores the potential of SMP to improve the quality and effectiveness of online FPA.
在在线形成性同伴评价(FPA)的背景下,提供高质量的同伴反馈和批判性地实施收到的反馈都是智力要求很高的任务,需要学生的认知和元认知努力。为了促进这些过程,本研究设计了一个自我监控提示(SMP)作为元认知支架,并研究了它对学生提供同伴反馈及其吸收的影响,以及学生在本科课程“现代教育技术”中的复习表现。采用混合方法的研究设计,116名来自中国的大三本科生参与了为期三周的在线FPA任务,其中68名学生为实验组(SMP支持;对照组48人(无SMP支持;SMP -)。然而,由于特定的数据排除标准,并不是所有的参与者都被包括在每个分析中:90名学生提供同伴反馈,97名学生接受同伴反馈和链中介分析。结果表明,SMP对反馈数量的影响不显著(p = .950),但对反馈质量的影响显著(p = .019)。SMP+ 组更倾向于应用收到的同伴反馈(p = .002),更不容易忽视(p = .014),并且比SMP-组(p = .003)取得了更好的复习成绩。进一步的链式中介分析揭示了SMP影响复习绩效的复杂方式。总体而言,该研究强调了SMP在提高在线FPA的质量和有效性方面的潜力。
{"title":"The impacts of self-monitoring prompt on provision and uptake of peer feedback and on revision performance: A mixed methods study","authors":"Yi Zhang ,&nbsp;Hui Chen ,&nbsp;Jingran Wang ,&nbsp;Zhongling Pi ,&nbsp;Jiumin Yang","doi":"10.1016/j.stueduc.2024.101442","DOIUrl":"10.1016/j.stueduc.2024.101442","url":null,"abstract":"<div><div>In the context of online formative peer assessment (FPA), both the provision of quality peer feedback and critical implementation of received feedback are intellectually demanding tasks that require cognitive and metacognitive effort from students. To facilitate these processes, this study designed a self-monitoring prompt (SMP) as a metacognitive scaffold and examined its impact on students’ provision of peer feedback and its uptake, as well as students’ revision performance in an undergraduate course titled “Modern Educational Technology”. Adopting a mixed-methods research design, 116 junior undergraduates from China participated in an online FPA task over three weeks, with 68 students in the experimental group (with SMP support; SMP+) and 48 students in the control group (without SMP support; SMP-). However, due to specific data exclusion criteria, not all participants were included in each analysis: 90 students for the provision of peer feedback, and 97 students for both the uptake of peer feedback and the chain mediation analysis. The results indicated that SMP did not significantly change feedback quantity (<em>p</em> = .950), but it did enhance its quality (<em>p</em> = .019). The SMP+ group showed a greater tendency to apply the received peer feedback (<em>p</em> = .002), were less likely to ignore it (<em>p</em> = .014), and achieved better revision performance than the students in the SMP- group (<em>p</em> = .003). Further chain mediation analyses revealed the complex ways SMP influenced revision performance. Overall, the study underscores the potential of SMP to improve the quality and effectiveness of online FPA.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"84 ","pages":"Article 101442"},"PeriodicalIF":2.6,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143157886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Studies in Educational Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1