首页 > 最新文献

Studies in Educational Evaluation最新文献

英文 中文
Predicting the Mathematics Literacy of Resilient Students from High‐performing Economies: A Machine Learning Approach 预测来自绩优经济体的适应性强的学生的数学素养:机器学习方法
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-11-04 DOI: 10.1016/j.stueduc.2024.101412
Yimei Zhang, Maria Cutumisu
Mathematics is a crucial yet challenging subject for all students. Therefore, it is important to understand the role of academic resilience in mathematics, which enables students to overcome academic challenges. This study applied two machine learning algorithms, Lasso Regression (LR) and Random Forest (RF), to predict the mathematics literacy of resilient students from high-performing economies across cultures in PISA 2022. The findings indicated both RF and LR performed better in Western cultures than in Eastern cultures. Furthermore, in Eastern cultures, mathematics self-efficacy for 21st-century skills played an important role in predicting resilient students’ mathematics literacy, followed by self-efficacy towards mathematics, and mathematics anxiety. In Western cultures, self-efficacy towards mathematics was the predominant predictor, followed by mathematics self-efficacy for 21st-century skills. Theoretically, this study identifies key factors in predicting resilient students’ mathematics literacy across cultures. Methodologically, it is the first to apply ML in exploring resilient students’ mathematics literacy. Practically, it guides educators interested in developing interventions to improve resilient students’ mathematics literacy.
数学对所有学生来说都是一门重要而又充满挑战的学科。因此,了解学业适应力在数学中的作用非常重要,它能帮助学生克服学业挑战。本研究应用了两种机器学习算法--拉索回归(LR)和随机森林(RF)--来预测 2022 年国际学生评估项目(PISA)中来自不同文化背景的高绩效经济体学生的数学素养。研究结果表明,RF 和 LR 在西方文化中的表现均优于东方文化。此外,在东方文化中,21 世纪技能的数学自我效能感在预测抗挫折学生的数学素养方面发挥了重要作用,其次是数学自我效能感和数学焦虑。在西方文化中,对数学的自我效能感是最主要的预测因素,其次是对 21 世纪技能的数学自我效能感。从理论上讲,本研究确定了预测不同文化背景下弹性学生数学素养的关键因素。在方法论上,本研究首次将 ML 应用于探究具有适应力的学生的数学素养。在实践中,它为有兴趣制定干预措施以提高有适应力学生数学素养的教育工作者提供了指导。
{"title":"Predicting the Mathematics Literacy of Resilient Students from High‐performing Economies: A Machine Learning Approach","authors":"Yimei Zhang,&nbsp;Maria Cutumisu","doi":"10.1016/j.stueduc.2024.101412","DOIUrl":"10.1016/j.stueduc.2024.101412","url":null,"abstract":"<div><div>Mathematics is a crucial yet challenging subject for all students. Therefore, it is important to understand the role of academic resilience in mathematics, which enables students to overcome academic challenges. This study applied two machine learning algorithms, Lasso Regression (LR) and Random Forest (RF), to predict the mathematics literacy of resilient students from high-performing economies across cultures in PISA 2022. The findings indicated both RF and LR performed better in Western cultures than in Eastern cultures. Furthermore, in Eastern cultures, mathematics self-efficacy for 21st-century skills played an important role in predicting resilient students’ mathematics literacy, followed by self-efficacy towards mathematics, and mathematics anxiety. In Western cultures, self-efficacy towards mathematics was the predominant predictor, followed by mathematics self-efficacy for 21st-century skills. Theoretically, this study identifies key factors in predicting resilient students’ mathematics literacy across cultures. Methodologically, it is the first to apply ML in exploring resilient students’ mathematics literacy. Practically, it guides educators interested in developing interventions to improve resilient students’ mathematics literacy.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101412"},"PeriodicalIF":2.6,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142578077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What value do standardized observation systems add to summative teacher evaluation systems? 标准化观察系统对终结性教师评价系统有何价值?
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-30 DOI: 10.1016/j.stueduc.2024.101414
Mark White , Bridget Maher
Teacher evaluation systems work to balance summative and formative goals. Instructional observations are an important part of such systems, allowing evaluation to directly impact instruction. Research shows that summative and formative goals can conflict with each other. This paper examines whether the summative usage of observation scores contributes to summative evaluation. We find that, after accounting for traditional principal ratings, observation scores provide little predictive validity for identifying high quality teachers. Given the reviewed negative impacts of summative uses of observation scores in teacher evaluation, teacher evaluation systems should reconsider the summative usage of observation scores.
教师评价体系努力平衡终结性目标和形成性目标。教学观察是此类系统的重要组成部分,可使评价直接影响教学。研究表明,终结性目标和形成性目标可能相互冲突。本文研究了观察评分的终结性使用是否有助于终结性评价。我们发现,在考虑了传统的校长评级后,观察评分对识别优质教师的预测效力很小。鉴于观察评分在教师评价中的终结性使用所产生的负面影响,教师评价体系应重新考虑观察评分的终结性使用。
{"title":"What value do standardized observation systems add to summative teacher evaluation systems?","authors":"Mark White ,&nbsp;Bridget Maher","doi":"10.1016/j.stueduc.2024.101414","DOIUrl":"10.1016/j.stueduc.2024.101414","url":null,"abstract":"<div><div>Teacher evaluation systems work to balance summative and formative goals. Instructional observations are an important part of such systems, allowing evaluation to directly impact instruction. Research shows that summative and formative goals can conflict with each other. This paper examines whether the summative usage of observation scores contributes to summative evaluation. We find that, after accounting for traditional principal ratings, observation scores provide little predictive validity for identifying high quality teachers. Given the reviewed negative impacts of summative uses of observation scores in teacher evaluation, teacher evaluation systems should reconsider the summative usage of observation scores.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101414"},"PeriodicalIF":2.6,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring factors influencing teacher self-efficacy in implementing inclusive education in Cambodia: A two-level hierarchical linear model 探索影响柬埔寨教师实施全纳教育自我效能感的因素:两级分层线性模型
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-30 DOI: 10.1016/j.stueduc.2024.101415
Sokunrith Pov , Norimune Kawai , Rie Murakami
This study examined teachers’ self-efficacy for inclusive practices and identified factors influencing it. The study involved 1008 primary school teachers from 236 schools across Cambodia. It was guided by a conceptual framework grounded in Bandura’s Theory of Self-Efficacy, addressing existing research gaps and incorporating empirical insights into the factors shaping teachers’ self-efficacy for inclusive practices. Using descriptive statistics, exploratory factor analysis, reliability tests, and the two-level hierarchical linear model (HLM), the study found that teachers reported the highest self-efficacy in managing behaviours and the lowest in collaboration, especially with parents. Factors such as gender, interaction experience, inclusive education training, knowledge of disabilities, and the implementation of inclusive education programmes significantly influenced their self-efficacy. The study’s findings provide valuable insights for improving teacher education in the context of inclusive practices.
本研究考察了教师在全纳实践中的自我效能感,并确定了影响因素。柬埔寨全国 236 所学校的 1008 名小学教师参与了这项研究。研究以班杜拉的 "自我效能理论"(Theory of Self-Efficacy)为基础的概念框架为指导,填补了现有研究的空白,并将经验性见解融入影响教师全纳实践自我效能感的因素中。通过描述性统计、探索性因素分析、可靠性测试和两级分层线性模型(HLM),研究发现,教师在行为管理方面的自我效能感最高,而在合作方面,尤其是与家长合作方面的自我效能感最低。性别、互动经验、全纳教育培训、残疾知识和全纳教育计划的实施情况等因素对教师的自我效能感有很大影响。研究结果为在全纳实践中改进教师教育提供了宝贵的启示。
{"title":"Exploring factors influencing teacher self-efficacy in implementing inclusive education in Cambodia: A two-level hierarchical linear model","authors":"Sokunrith Pov ,&nbsp;Norimune Kawai ,&nbsp;Rie Murakami","doi":"10.1016/j.stueduc.2024.101415","DOIUrl":"10.1016/j.stueduc.2024.101415","url":null,"abstract":"<div><div>This study examined teachers’ self-efficacy for inclusive practices and identified factors influencing it. The study involved 1008 primary school teachers from 236 schools across Cambodia. It was guided by a conceptual framework grounded in Bandura’s Theory of Self-Efficacy, addressing existing research gaps and incorporating empirical insights into the factors shaping teachers’ self-efficacy for inclusive practices. Using descriptive statistics, exploratory factor analysis, reliability tests, and the two-level hierarchical linear model (HLM), the study found that teachers reported the highest self-efficacy in managing behaviours and the lowest in collaboration, especially with parents. Factors such as gender, interaction experience, inclusive education training, knowledge of disabilities, and the implementation of inclusive education programmes significantly influenced their self-efficacy. The study’s findings provide valuable insights for improving teacher education in the context of inclusive practices.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101415"},"PeriodicalIF":2.6,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating anonymity in formative and summative peer assessment: Effects on university students’ social-affective factors, perceptions and preference 调查形成性和终结性同行评估中的匿名性:对大学生社会情感因素、认知和偏好的影响
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-25 DOI: 10.1016/j.stueduc.2024.101410
Juan Fraile , Meritxell Monguillot , Carles González-Arévalo , Paula Lehane , Ernesto Panadero
This study examines the impact of anonymity on students’ social-affective processes, as well as their perceptions and preferences regarding peer assessment and grading for both formative and summative purposes. 177 higher education students participated in this quasi-experimental study. They participated in two peer assessment activities after receiving training on the provision of effective feedback. The first peer assessment activity was formative in nature, while the second was summative. The study had two conditions: anonymous peer assessment and non-anonymous peer assessment. Results indicate that although 73.6 % of all students (90.5 % in the anonymous condition and 56.5 % in the non-anonymous condition) preferred anonymous peer assessment, this preference did not significantly impact perceptions of fairness or peer pressure. This challenges assumptions around the effects of anonymity. Interestingly, non-anonymous settings were still favourably viewed, with the open-ended responses indicating the value of face-to-face dialogue. This suggests that non-anonymous, highly formative peer assessment requiring more interaction may lead to better social and interpersonal outcomes.
本研究探讨了匿名对学生社会情感过程的影响,以及他们对形成性和终结性同伴评价和评分的看法和偏好。177 名高校学生参与了这项准实验研究。他们在接受了提供有效反馈的培训后,参加了两次同伴互评活动。第一项同伴互评活动是形成性的,第二项是总结性的。研究分为两种情况:匿名同伴互评和非匿名同伴互评。结果表明,尽管 73.6% 的学生(匿名条件下为 90.5%,非匿名条件下为 56.5%)更喜欢匿名同伴互评,但这种偏好并没有对公平性或同伴压力的感知产生重大影响。这对有关匿名影响的假设提出了挑战。有趣的是,非匿名环境仍然受到好评,开放式回答显示了面对面对话的价值。这表明,需要更多互动的非匿名、高度形成性同伴评价可能会带来更好的社会和人际关系结果。
{"title":"Investigating anonymity in formative and summative peer assessment: Effects on university students’ social-affective factors, perceptions and preference","authors":"Juan Fraile ,&nbsp;Meritxell Monguillot ,&nbsp;Carles González-Arévalo ,&nbsp;Paula Lehane ,&nbsp;Ernesto Panadero","doi":"10.1016/j.stueduc.2024.101410","DOIUrl":"10.1016/j.stueduc.2024.101410","url":null,"abstract":"<div><div>This study examines the impact of anonymity on students’ social-affective processes, as well as their perceptions and preferences regarding peer assessment and grading for both formative and summative purposes. 177 higher education students participated in this quasi-experimental study. They participated in two peer assessment activities after receiving training on the provision of effective feedback. The first peer assessment activity was formative in nature, while the second was summative. The study had two conditions: anonymous peer assessment and non-anonymous peer assessment. Results indicate that although 73.6 % of all students (90.5 % in the anonymous condition and 56.5 % in the non-anonymous condition) preferred anonymous peer assessment, this preference did not significantly impact perceptions of fairness or peer pressure. This challenges assumptions around the effects of anonymity. Interestingly, non-anonymous settings were still favourably viewed, with the open-ended responses indicating the value of face-to-face dialogue. This suggests that non-anonymous, highly formative peer assessment requiring more interaction may lead to better social and interpersonal outcomes.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101410"},"PeriodicalIF":2.6,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142532759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Re-imagining educational quality. The need for a multidimensional approach in evaluating educational quality through TIMSS data 重新认识教育质量。通过 TIMSS 数据评估教育质量需要多维方法
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-22 DOI: 10.1016/j.stueduc.2024.101409
Lies Appels , Sven De Maeyer , Peter Van Petegem
In recent years, international assessments have significantly impacted the discourse pivoting educational quality, often simplifying it to a single achievement continuum. With literature emphasizing quality’s multidimensional nature, this unidimensional view challenges the concept’s complexity. Although research with international datasets has identified multiple dimensions of educational quality, they are often considered in isolation. This paper seeks to expand current state of research by advocating a multidimensional approach using cluster analysis. Employing TIMSS data, six distinct clusters are portrayed, representing diverse quality configurations across global educational systems. This nuanced evaluation enhances our understanding of quality patterns and informs recommendations for future research.
近年来,国际评估对有关教育质量的讨论产生了重大影响,往往将教育质量简化为单一的成绩连续体。有文献强调教育质量的多维性,这种单维观点对教育质量概念的复杂性提出了挑战。尽管利用国际数据集进行的研究已经确定了教育质量的多个维度,但这些维度往往被孤立地考虑。本文试图通过使用聚类分析来倡导一种多维方法,从而拓展当前的研究现状。利用国际教育质量监测系统(TIMSS)的数据,描绘了六个不同的聚类,代表了全球教育系统中不同的质量配置。这种细致入微的评估增强了我们对质量模式的理解,并为今后的研究提出了建议。
{"title":"Re-imagining educational quality. The need for a multidimensional approach in evaluating educational quality through TIMSS data","authors":"Lies Appels ,&nbsp;Sven De Maeyer ,&nbsp;Peter Van Petegem","doi":"10.1016/j.stueduc.2024.101409","DOIUrl":"10.1016/j.stueduc.2024.101409","url":null,"abstract":"<div><div>In recent years, international assessments have significantly impacted the discourse pivoting educational quality, often simplifying it to a single achievement continuum. With literature emphasizing quality’s multidimensional nature, this unidimensional view challenges the concept’s complexity. Although research with international datasets has identified multiple dimensions of educational quality, they are often considered in isolation. This paper seeks to expand current state of research by advocating a multidimensional approach using cluster analysis. Employing TIMSS data, six distinct clusters are portrayed, representing diverse quality configurations across global educational systems. This nuanced evaluation enhances our understanding of quality patterns and informs recommendations for future research.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101409"},"PeriodicalIF":2.6,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142532758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing the reliability of performance task scores obtained from rating scale and analytic rubric using the generalizability theory 利用概括性理论比较评分表和分析评分表得出的绩效任务分数的可靠性
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-19 DOI: 10.1016/j.stueduc.2024.101413
Funda Nalbantoğlu Yılmaz
In the performance assessment, unbiased and accurate scorings depend not only on raters but also on accuracy of scoring keys. It could be confusing to choose the type of scoring key for educators in most situations. The study aims to find whether there is a difference between ratings with rating scale and analytic rubric and to compare reliability of scores given by the same raters with both scoring keys to the same performance tasks using generalizability theory. The results of this study would be a guide for implementers to determine the type of scoring keys for scoring performances. By the analyses, results reveal that scores obtained with the rating scale have higher reliability compared to scores obtained from the analytic rubric. Interviews related to both scoring keys reveal that for the scoring of performance tasks of teacher candidates, the rating scale is economic in terms of time.
在成绩评估中,公正准确的评分不仅取决于评分者,还取决于评分标准的准确性。在大多数情况下,教育工作者在选择评分标准类型时可能会感到困惑。本研究的目的是找出使用等级量表和分析评分标准进行评分之间是否存在差异,并利用概括性理论比较同一评分者使用这两种评分标准对相同的绩效任务进行评分的可靠性。本研究的结果将为实施者确定表演评分的评分标准类型提供指导。分析结果表明,与分析评分标准相比,使用评分量表获得的分数具有更高的可靠性。与两种评分标准有关的访谈显示,在对师范生的绩效任务进行评分时,等级量表在时间上比较经济。
{"title":"Comparing the reliability of performance task scores obtained from rating scale and analytic rubric using the generalizability theory","authors":"Funda Nalbantoğlu Yılmaz","doi":"10.1016/j.stueduc.2024.101413","DOIUrl":"10.1016/j.stueduc.2024.101413","url":null,"abstract":"<div><div>In the performance assessment, unbiased and accurate scorings depend not only on raters but also on accuracy of scoring keys. It could be confusing to choose the type of scoring key for educators in most situations. The study aims to find whether there is a difference between ratings with rating scale and analytic rubric and to compare reliability of scores given by the same raters with both scoring keys to the same performance tasks using generalizability theory. The results of this study would be a guide for implementers to determine the type of scoring keys for scoring performances. By the analyses, results reveal that scores obtained with the rating scale have higher reliability compared to scores obtained from the analytic rubric. Interviews related to both scoring keys reveal that for the scoring of performance tasks of teacher candidates, the rating scale is economic in terms of time.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101413"},"PeriodicalIF":2.6,"publicationDate":"2024-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142532757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interconnecting peer feedback literacy: Exploring the relationship between providing and acting on peer feedback 相互联系的同伴反馈素养:探索提供同伴反馈与根据同伴反馈采取行动之间的关系
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-15 DOI: 10.1016/j.stueduc.2024.101411
Yi Zhang , Christian D. Schunn , Yong Wu
Recent research highlights the concept of feedback literacy, focusing on students’ active engagement in feedback processes, including giving and receiving peer feedback. However, most studies rely on self-assessments through surveys and interviews, with few examining actual feedback behaviors. This study explores the behavioral aspects of peer feedback literacy among 844 high school students using an online system for peer feedback and revisions. Multiple measures related to provided ratings and comments as well as use in revisions were extracted using systematic coding. Factor analysis and structural equation modeling identified two distinct elements of high-quality feedback provision—providing features and rating validity—and confirmed a moderate correlation between the ability to provide quality feedback and the use of feedback. These skills were weakly correlated with writing ability. This research contributes to the emerging literature of peer feedback literacy and supports the development of more effective peer feedback training approaches.
最近的研究强调了反馈素养的概念,重点是学生积极参与反馈过程,包括给予和接受同伴反馈。然而,大多数研究都是通过调查和访谈进行自我评估,很少有研究对实际反馈行为进行考察。本研究探讨了 844 名使用在线系统进行同伴反馈和修改的高中生的同伴反馈素养的行为方面。通过系统编码提取了与所提供的评分和评论以及在修改中的使用相关的多个测量指标。因子分析和结构方程模型确定了提供高质量反馈的两个不同要素--提供特征和评分有效性,并证实了提供高质量反馈的能力与反馈的使用之间存在适度的相关性。这些技能与写作能力的相关性较弱。这项研究为同伴反馈素养的新兴文献做出了贡献,并为开发更有效的同伴反馈培训方法提供了支持。
{"title":"Interconnecting peer feedback literacy: Exploring the relationship between providing and acting on peer feedback","authors":"Yi Zhang ,&nbsp;Christian D. Schunn ,&nbsp;Yong Wu","doi":"10.1016/j.stueduc.2024.101411","DOIUrl":"10.1016/j.stueduc.2024.101411","url":null,"abstract":"<div><div>Recent research highlights the concept of feedback literacy, focusing on students’ active engagement in feedback processes, including giving and receiving peer feedback. However, most studies rely on self-assessments through surveys and interviews, with few examining actual feedback behaviors. This study explores the behavioral aspects of peer feedback literacy among 844 high school students using an online system for peer feedback and revisions. Multiple measures related to provided ratings and comments as well as use in revisions were extracted using systematic coding. Factor analysis and structural equation modeling identified two distinct elements of high-quality feedback provision—providing features and rating validity—and confirmed a moderate correlation between the ability to provide quality feedback and the use of feedback. These skills were weakly correlated with writing ability. This research contributes to the emerging literature of peer feedback literacy and supports the development of more effective peer feedback training approaches.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101411"},"PeriodicalIF":2.6,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Self-regulated learning in secondary school: Students’ self-feedback in a peer observation programme 中学的自我调节学习:学生在同伴观察计划中的自我反馈
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-14 DOI: 10.1016/j.stueduc.2024.101407
Ana Cristina Torres , Marina Duarte , Daniela Pinto , Ana Mouraz
Self-regulated learning (SRL) is crucial for fostering learner autonomy and lifelong learning skills. The article focuses on observation as a trigger of student self-feedback and self-reflection towards the development of SRL. A student peer observation programme, co-designed and piloted by teachers and researchers in two Portuguese public secondary schools is introduced, including its theoretical and methodological framework, observation scheme, and supporting observation guides. A qualitative study of self-reported effects by participating students was performed with the objectives of identifying strong aspects and possible improvements to the programme but also to gain a deeper understanding of how observation and self-feedback mediate between the performance and self-reflection phases of SRL. The results reveal an increased appreciation for feedback from various sources, and of the reflection it enables, with students emphasizing seeking help from teachers and peers. Implications for designing collaborative and student-centred learning environments with observational strategies to promote SRL are included.
自律学习(SRL)对于培养学习者的自主性和终身学习技能至关重要。这篇文章的重点是观察作为学生自我反馈和自我反思的触发器,以促进自律学习的发展。文章介绍了由葡萄牙两所公立中学的教师和研究人员共同设计和试点的学生同伴观察计划,包括其理论和方法框架、观察计划和辅助观察指南。对参与学生自我报告的效果进行了定性研究,目的是找出该计划的优点和可能的改进之处,同时更深入地了解观察和自我反馈如何在自学学习的表现和自我反思阶段之间起到中介作用。研究结果表明,学生对来自各种渠道的反馈以及反馈所带来的反思有了更多的了解,他们强调向教师和同学寻求帮助。这对设计协作式和以学生为中心的学习环境、采用观察策略促进自学学习具有重要意义。
{"title":"Self-regulated learning in secondary school: Students’ self-feedback in a peer observation programme","authors":"Ana Cristina Torres ,&nbsp;Marina Duarte ,&nbsp;Daniela Pinto ,&nbsp;Ana Mouraz","doi":"10.1016/j.stueduc.2024.101407","DOIUrl":"10.1016/j.stueduc.2024.101407","url":null,"abstract":"<div><div>Self-regulated learning (SRL) is crucial for fostering learner autonomy and lifelong learning skills. The article focuses on observation as a trigger of student self-feedback and self-reflection towards the development of SRL. A student peer observation programme, co-designed and piloted by teachers and researchers in two Portuguese public secondary schools is introduced, including its theoretical and methodological framework, observation scheme, and supporting observation guides. A qualitative study of self-reported effects by participating students was performed with the objectives of identifying strong aspects and possible improvements to the programme but also to gain a deeper understanding of how observation and self-feedback mediate between the performance and self-reflection phases of SRL. The results reveal an increased appreciation for feedback from various sources, and of the reflection it enables, with students emphasizing seeking help from teachers and peers. Implications for designing collaborative and student-centred learning environments with observational strategies to promote SRL are included.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101407"},"PeriodicalIF":2.6,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Peer feedback in higher education: How students’ roles affect providing and receiving feedback 高等教育中的同伴反馈:学生的角色如何影响反馈的提供和接收
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-05 DOI: 10.1016/j.stueduc.2024.101408
Milan Stančić, Vladeta Milin, Andrea Gašić
In this study, we aimed to explore the impact of different roles of feedback providers on their experience of providing feedback, as well as their influence on the feedback receivers’ responses to feedback. The students who performed the assignment (creating learning material) assumed the role of peer experts (N=22) in providing feedback. The other students (N=22) took on the role of peer users as they used the developed learning materials. The data on the students’ experiences were collected using the Intrinsic Motivation Inventory. The response to feedback was explored via interviews with the peer experts. Findings indicate that the peer experts exhibited a higher sense of competence than the peer users. Their feedback was perceived as more clear, specific, and useful than that provided by the peer users. According to the Self-Determination Theory, we highlight the importance of different task design features for students’ sense of competence, relatedness, and autonomy.
在这项研究中,我们旨在探索反馈提供者的不同角色对其反馈经验的影响,以及他们对反馈接收者对反馈的反应的影响。完成作业(创建学习材料)的学生在提供反馈时扮演了同伴专家的角色(22 人)。其他学生(22 人)在使用开发的学习材料时则扮演同伴用户的角色。使用内在动机量表收集了学生的体验数据。通过对同伴专家的访谈,探讨了他们对反馈的反应。研究结果表明,同伴专家比同伴用户表现出更高的能力感。他们的反馈被认为比同伴用户提供的反馈更清晰、更具体、更有用。根据 "自我决定理论",我们强调了不同任务设计特征对学生能力感、相关性和自主性的重要性。
{"title":"Peer feedback in higher education: How students’ roles affect providing and receiving feedback","authors":"Milan Stančić,&nbsp;Vladeta Milin,&nbsp;Andrea Gašić","doi":"10.1016/j.stueduc.2024.101408","DOIUrl":"10.1016/j.stueduc.2024.101408","url":null,"abstract":"<div><div>In this study, we aimed to explore the impact of different roles of feedback providers on their experience of providing feedback, as well as their influence on the feedback receivers’ responses to feedback. The students who performed the assignment (creating learning material) assumed the role of peer experts (N=22) in providing feedback. The other students (N=22) took on the role of peer users as they used the developed learning materials. The data on the students’ experiences were collected using the Intrinsic Motivation Inventory. The response to feedback was explored via interviews with the peer experts. Findings indicate that the peer experts exhibited a higher sense of competence than the peer users. Their feedback was perceived as more clear, specific, and useful than that provided by the peer users. According to the Self-Determination Theory, we highlight the importance of different task design features for students’ sense of competence, relatedness, and autonomy.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101408"},"PeriodicalIF":2.6,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142425077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sentiment analysis of student feedback: A comparative study employing lexicon and machine learning techniques 学生反馈的情感分析:采用词典和机器学习技术的比较研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-02 DOI: 10.1016/j.stueduc.2024.101406
Charalampos Dervenis , Giannis Kanakis , Panos Fitsilis
One of the most pressing concerns in contemporary education examines the integration of big data and artificial intelligence methodologies to enhance the educational learning outcome. Towards that purpose, it is imperative to leverage the unstructured data originating from student feedback, particularly in the form of comments to open-ended questions aiming to extract emotions and opinions conveyed within their messages. Our research goal is to ascertain the most efficient approach to tackle this difficult task by conducting a comparison of sentiment analysis methods, including Machine Learning (ML) and Lexicon based models. Both lexicon based and machine learning approaches were implemented using an open source data mining platform while also utilizing student comments submitted at the end of academic semesters. Our study reveals a promising approach that effectively addresses the issue at hand, particularly within the domain of educational data. Additionally, it emphasizes the key aspects that led to the selection of this approach effectively highlighting the weaknesses and strengths inherent in each method
当代教育最紧迫的问题之一是研究如何整合大数据和人工智能方法,以提高教育学习成果。为此,当务之急是利用源自学生反馈的非结构化数据,特别是以对开放式问题的评论为形式的数据,以提取其信息中传达的情感和观点。我们的研究目标是通过比较情感分析方法,包括机器学习(ML)和基于词典的模型,确定解决这一难题的最有效方法。基于词典的方法和机器学习方法都是通过一个开源数据挖掘平台实现的,同时还利用了学生在学期末提交的评论。我们的研究揭示了一种很有前途的方法,它能有效解决手头的问题,尤其是在教育数据领域。此外,它还强调了导致选择这种方法的关键方面,有效地突出了每种方法固有的缺点和优点
{"title":"Sentiment analysis of student feedback: A comparative study employing lexicon and machine learning techniques","authors":"Charalampos Dervenis ,&nbsp;Giannis Kanakis ,&nbsp;Panos Fitsilis","doi":"10.1016/j.stueduc.2024.101406","DOIUrl":"10.1016/j.stueduc.2024.101406","url":null,"abstract":"<div><div>One of the most pressing concerns in contemporary education examines the integration of big data and artificial intelligence methodologies to enhance the educational learning outcome. Towards that purpose, it is imperative to leverage the unstructured data originating from student feedback, particularly in the form of comments to open-ended questions aiming to extract emotions and opinions conveyed within their messages. Our research goal is to ascertain the most efficient approach to tackle this difficult task by conducting a comparison of sentiment analysis methods, including Machine Learning (ML) and Lexicon based models. Both lexicon based and machine learning approaches were implemented using an open source data mining platform while also utilizing student comments submitted at the end of academic semesters. Our study reveals a promising approach that effectively addresses the issue at hand, particularly within the domain of educational data. Additionally, it emphasizes the key aspects that led to the selection of this approach effectively highlighting the weaknesses and strengths inherent in each method</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101406"},"PeriodicalIF":2.6,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142425076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Studies in Educational Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1