首页 > 最新文献

Studies in Educational Evaluation最新文献

英文 中文
Self-regulated learning in secondary school: Students’ self-feedback in a peer observation programme 中学的自我调节学习:学生在同伴观察计划中的自我反馈
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-14 DOI: 10.1016/j.stueduc.2024.101407
Ana Cristina Torres , Marina Duarte , Daniela Pinto , Ana Mouraz
Self-regulated learning (SRL) is crucial for fostering learner autonomy and lifelong learning skills. The article focuses on observation as a trigger of student self-feedback and self-reflection towards the development of SRL. A student peer observation programme, co-designed and piloted by teachers and researchers in two Portuguese public secondary schools is introduced, including its theoretical and methodological framework, observation scheme, and supporting observation guides. A qualitative study of self-reported effects by participating students was performed with the objectives of identifying strong aspects and possible improvements to the programme but also to gain a deeper understanding of how observation and self-feedback mediate between the performance and self-reflection phases of SRL. The results reveal an increased appreciation for feedback from various sources, and of the reflection it enables, with students emphasizing seeking help from teachers and peers. Implications for designing collaborative and student-centred learning environments with observational strategies to promote SRL are included.
自律学习(SRL)对于培养学习者的自主性和终身学习技能至关重要。这篇文章的重点是观察作为学生自我反馈和自我反思的触发器,以促进自律学习的发展。文章介绍了由葡萄牙两所公立中学的教师和研究人员共同设计和试点的学生同伴观察计划,包括其理论和方法框架、观察计划和辅助观察指南。对参与学生自我报告的效果进行了定性研究,目的是找出该计划的优点和可能的改进之处,同时更深入地了解观察和自我反馈如何在自学学习的表现和自我反思阶段之间起到中介作用。研究结果表明,学生对来自各种渠道的反馈以及反馈所带来的反思有了更多的了解,他们强调向教师和同学寻求帮助。这对设计协作式和以学生为中心的学习环境、采用观察策略促进自学学习具有重要意义。
{"title":"Self-regulated learning in secondary school: Students’ self-feedback in a peer observation programme","authors":"Ana Cristina Torres ,&nbsp;Marina Duarte ,&nbsp;Daniela Pinto ,&nbsp;Ana Mouraz","doi":"10.1016/j.stueduc.2024.101407","DOIUrl":"10.1016/j.stueduc.2024.101407","url":null,"abstract":"<div><div>Self-regulated learning (SRL) is crucial for fostering learner autonomy and lifelong learning skills. The article focuses on observation as a trigger of student self-feedback and self-reflection towards the development of SRL. A student peer observation programme, co-designed and piloted by teachers and researchers in two Portuguese public secondary schools is introduced, including its theoretical and methodological framework, observation scheme, and supporting observation guides. A qualitative study of self-reported effects by participating students was performed with the objectives of identifying strong aspects and possible improvements to the programme but also to gain a deeper understanding of how observation and self-feedback mediate between the performance and self-reflection phases of SRL. The results reveal an increased appreciation for feedback from various sources, and of the reflection it enables, with students emphasizing seeking help from teachers and peers. Implications for designing collaborative and student-centred learning environments with observational strategies to promote SRL are included.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101407"},"PeriodicalIF":2.6,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Peer feedback in higher education: How students’ roles affect providing and receiving feedback 高等教育中的同伴反馈:学生的角色如何影响反馈的提供和接收
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-05 DOI: 10.1016/j.stueduc.2024.101408
Milan Stančić, Vladeta Milin, Andrea Gašić
In this study, we aimed to explore the impact of different roles of feedback providers on their experience of providing feedback, as well as their influence on the feedback receivers’ responses to feedback. The students who performed the assignment (creating learning material) assumed the role of peer experts (N=22) in providing feedback. The other students (N=22) took on the role of peer users as they used the developed learning materials. The data on the students’ experiences were collected using the Intrinsic Motivation Inventory. The response to feedback was explored via interviews with the peer experts. Findings indicate that the peer experts exhibited a higher sense of competence than the peer users. Their feedback was perceived as more clear, specific, and useful than that provided by the peer users. According to the Self-Determination Theory, we highlight the importance of different task design features for students’ sense of competence, relatedness, and autonomy.
在这项研究中,我们旨在探索反馈提供者的不同角色对其反馈经验的影响,以及他们对反馈接收者对反馈的反应的影响。完成作业(创建学习材料)的学生在提供反馈时扮演了同伴专家的角色(22 人)。其他学生(22 人)在使用开发的学习材料时则扮演同伴用户的角色。使用内在动机量表收集了学生的体验数据。通过对同伴专家的访谈,探讨了他们对反馈的反应。研究结果表明,同伴专家比同伴用户表现出更高的能力感。他们的反馈被认为比同伴用户提供的反馈更清晰、更具体、更有用。根据 "自我决定理论",我们强调了不同任务设计特征对学生能力感、相关性和自主性的重要性。
{"title":"Peer feedback in higher education: How students’ roles affect providing and receiving feedback","authors":"Milan Stančić,&nbsp;Vladeta Milin,&nbsp;Andrea Gašić","doi":"10.1016/j.stueduc.2024.101408","DOIUrl":"10.1016/j.stueduc.2024.101408","url":null,"abstract":"<div><div>In this study, we aimed to explore the impact of different roles of feedback providers on their experience of providing feedback, as well as their influence on the feedback receivers’ responses to feedback. The students who performed the assignment (creating learning material) assumed the role of peer experts (N=22) in providing feedback. The other students (N=22) took on the role of peer users as they used the developed learning materials. The data on the students’ experiences were collected using the Intrinsic Motivation Inventory. The response to feedback was explored via interviews with the peer experts. Findings indicate that the peer experts exhibited a higher sense of competence than the peer users. Their feedback was perceived as more clear, specific, and useful than that provided by the peer users. According to the Self-Determination Theory, we highlight the importance of different task design features for students’ sense of competence, relatedness, and autonomy.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101408"},"PeriodicalIF":2.6,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142425077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sentiment analysis of student feedback: A comparative study employing lexicon and machine learning techniques 学生反馈的情感分析:采用词典和机器学习技术的比较研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-10-02 DOI: 10.1016/j.stueduc.2024.101406
Charalampos Dervenis , Giannis Kanakis , Panos Fitsilis
One of the most pressing concerns in contemporary education examines the integration of big data and artificial intelligence methodologies to enhance the educational learning outcome. Towards that purpose, it is imperative to leverage the unstructured data originating from student feedback, particularly in the form of comments to open-ended questions aiming to extract emotions and opinions conveyed within their messages. Our research goal is to ascertain the most efficient approach to tackle this difficult task by conducting a comparison of sentiment analysis methods, including Machine Learning (ML) and Lexicon based models. Both lexicon based and machine learning approaches were implemented using an open source data mining platform while also utilizing student comments submitted at the end of academic semesters. Our study reveals a promising approach that effectively addresses the issue at hand, particularly within the domain of educational data. Additionally, it emphasizes the key aspects that led to the selection of this approach effectively highlighting the weaknesses and strengths inherent in each method
当代教育最紧迫的问题之一是研究如何整合大数据和人工智能方法,以提高教育学习成果。为此,当务之急是利用源自学生反馈的非结构化数据,特别是以对开放式问题的评论为形式的数据,以提取其信息中传达的情感和观点。我们的研究目标是通过比较情感分析方法,包括机器学习(ML)和基于词典的模型,确定解决这一难题的最有效方法。基于词典的方法和机器学习方法都是通过一个开源数据挖掘平台实现的,同时还利用了学生在学期末提交的评论。我们的研究揭示了一种很有前途的方法,它能有效解决手头的问题,尤其是在教育数据领域。此外,它还强调了导致选择这种方法的关键方面,有效地突出了每种方法固有的缺点和优点
{"title":"Sentiment analysis of student feedback: A comparative study employing lexicon and machine learning techniques","authors":"Charalampos Dervenis ,&nbsp;Giannis Kanakis ,&nbsp;Panos Fitsilis","doi":"10.1016/j.stueduc.2024.101406","DOIUrl":"10.1016/j.stueduc.2024.101406","url":null,"abstract":"<div><div>One of the most pressing concerns in contemporary education examines the integration of big data and artificial intelligence methodologies to enhance the educational learning outcome. Towards that purpose, it is imperative to leverage the unstructured data originating from student feedback, particularly in the form of comments to open-ended questions aiming to extract emotions and opinions conveyed within their messages. Our research goal is to ascertain the most efficient approach to tackle this difficult task by conducting a comparison of sentiment analysis methods, including Machine Learning (ML) and Lexicon based models. Both lexicon based and machine learning approaches were implemented using an open source data mining platform while also utilizing student comments submitted at the end of academic semesters. Our study reveals a promising approach that effectively addresses the issue at hand, particularly within the domain of educational data. Additionally, it emphasizes the key aspects that led to the selection of this approach effectively highlighting the weaknesses and strengths inherent in each method</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101406"},"PeriodicalIF":2.6,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142425076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The impact of peer assessment design on interpersonal processes: A systematic review 同伴评估设计对人际交往过程的影响:系统回顾
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-26 DOI: 10.1016/j.stueduc.2024.101405
Morgane Senden, Liesje Coertjens
Peer assessment can have a very positive impact on students’ learning. However, it also poses some challenges such as trust issues, concerns about its fairness, feelings of discomfort, etc. It is known that the interpersonal processes of peer assessment can affect its outcomes. However, it is less clear how peer assessment should be implemented to prevent this. In this article, we reviewed 27 studies that have investigated how the instructional design elements of peer assessment influence interpersonal processes. A literature search was carried out on Scopus, PsycINFO, and Eric with a search string composed of three parts with keywords linked to (1) peer assessment, (2) educational contexts, and (3) interpersonal processes. The 14,552 retrieved records were screened in terms of the inclusion criteria, which resulted in 27 studies being included and analysed through a narrative synthesis. The results revealed that the three most commonly-investigated design elements were privacy, format, and training. Privacy seems to have a positive impact on some interpersonal processes, but a detrimental effect on others. Concerning format, studies suggest that increased amounts of guidance are associated with a positive impact on interpersonal processes, but this result must be interpreted with caution due to the limitations of the studies’ research designs. The use of training seems to be beneficial in minimising the negative effects of interpersonal processes. Finally, no conclusion could be drawn on three other design elements that were only investigated in one study each, and with weak research designs. These results allowed us to draw important recommendations for practitioners implementing peer assessment and to identify gaps and needs that could inform future research.
同伴评价可以对学生的学习产生非常积极的影响。然而,它也带来了一些挑战,如信任问题、对其公平性的担忧、不适应感等。众所周知,同伴互评的人际交往过程会影响其结果。然而,如何实施同伴互评来避免这种情况的发生却不太清楚。在本文中,我们回顾了 27 项研究,这些研究调查了同伴互评的教学设计要素如何影响人际交往过程。我们在 Scopus、PsycINFO 和 Eric 网站上进行了文献检索,检索字符串由三部分组成,关键词分别是:(1)同伴互评;(2)教育情境;(3)人际交往过程。根据纳入标准对检索到的 14,552 条记录进行了筛选,最终有 27 项研究被纳入并通过叙事综合法进行了分析。结果显示,最常研究的三个设计要素是隐私、形式和培训。隐私似乎对一些人际交往过程有积极影响,但对另一些则有不利影响。关于形式,研究表明,增加指导量对人际交往过程有积极影响,但由于研究设计的局限性,对这一结果的解释必须谨慎。使用培训似乎有利于最大限度地减少人际交往过程的负面影响。最后,对于其他三个设计要素,我们无法得出结论,因为这三个要素只在一项研究中进行了调查,而且研究设计也很薄弱。这些结果使我们能够为实施同伴评估的从业人员提出重要建议,并找出差距和需求,为今后的研究提供参考。
{"title":"The impact of peer assessment design on interpersonal processes: A systematic review","authors":"Morgane Senden,&nbsp;Liesje Coertjens","doi":"10.1016/j.stueduc.2024.101405","DOIUrl":"10.1016/j.stueduc.2024.101405","url":null,"abstract":"<div><div>Peer assessment can have a very positive impact on students’ learning. However, it also poses some challenges such as trust issues, concerns about its fairness, feelings of discomfort, etc. It is known that the interpersonal processes of peer assessment can affect its outcomes. However, it is less clear how peer assessment should be implemented to prevent this. In this article, we reviewed 27 studies that have investigated how the instructional design elements of peer assessment influence interpersonal processes. A literature search was carried out on Scopus, PsycINFO, and Eric with a search string composed of three parts with keywords linked to (1) peer assessment, (2) educational contexts, and (3) interpersonal processes. The 14,552 retrieved records were screened in terms of the inclusion criteria, which resulted in 27 studies being included and analysed through a narrative synthesis. The results revealed that the three most commonly-investigated design elements were privacy, format, and training. Privacy seems to have a positive impact on some interpersonal processes, but a detrimental effect on others. Concerning format, studies suggest that increased amounts of guidance are associated with a positive impact on interpersonal processes, but this result must be interpreted with caution due to the limitations of the studies’ research designs. The use of training seems to be beneficial in minimising the negative effects of interpersonal processes. Finally, no conclusion could be drawn on three other design elements that were only investigated in one study each, and with weak research designs. These results allowed us to draw important recommendations for practitioners implementing peer assessment and to identify gaps and needs that could inform future research.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101405"},"PeriodicalIF":2.6,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142322882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the suitability of self-reports to gain insights into teachers’ technological pedagogical knowledge 探索自我报告是否适合深入了解教师的技术教学知识
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-19 DOI: 10.1016/j.stueduc.2024.101402
Franziska Baier-Mosch , Lukas Schulze-Vorberg , Holger Horz , Mareike Kunter
Teachers need high technological pedagogical knowledge (TPK) to integrate digital technology effectively into their teaching. The valid assessment of teachers’ TPK is important so that researchers can investigate its development and impact on student outcomes. However, providing validity evidence for frequently used TPK self-report scales is challenging. Previous studies have indicated only weak correlations between these scales and tests. It remains open whether low correlations are due to method-specific biases of the self-reports or the fact that self-reports and tests measure different constructs (generalized knowledge/self-efficacy vs. specific knowledge). We investigated the relationship between self-report scales and tests of two aspects of teachers’ TPK – TPK-teaching and learning and TPK-classroom management – in a sample of 238 in-service teachers. Results showed that the TPK self-report scales seemed to measure a different construct (more generalized knowledge) than the tests and that low correlations cannot simply be explained by self-report method-specific biases.
教师需要具备较高的技术教学知识(TPK),才能有效地将数字技术融入教学。对教师的技术教学知识进行有效评估非常重要,这样研究人员才能调查教师技术教学知识的发展及其对学生成绩的影响。然而,为经常使用的 TPK 自我报告量表提供有效性证据具有挑战性。以往的研究表明,这些量表与测试之间只有微弱的相关性。相关性低究竟是由于自我报告方法的特定偏差,还是由于自我报告和测试测量的是不同的建构(广义知识/自我效能感相对于特定知识),这仍然是一个未知数。我们以 238 名在职教师为样本,研究了自我报告量表与测试之间的关系,这两个方面涉及教师的 "教师专业 知识"--"教与学 "和 "课堂管理"。结果表明,TPK 自我报告量表似乎测量的是与测试不同的结构(更广泛的知识),而低相关性不能简单地用自我报告方法的特定偏差来解释。
{"title":"Exploring the suitability of self-reports to gain insights into teachers’ technological pedagogical knowledge","authors":"Franziska Baier-Mosch ,&nbsp;Lukas Schulze-Vorberg ,&nbsp;Holger Horz ,&nbsp;Mareike Kunter","doi":"10.1016/j.stueduc.2024.101402","DOIUrl":"10.1016/j.stueduc.2024.101402","url":null,"abstract":"<div><div>Teachers need high technological pedagogical knowledge (TPK) to integrate digital technology effectively into their teaching. The valid assessment of teachers’ TPK is important so that researchers can investigate its development and impact on student outcomes. However, providing validity evidence for frequently used TPK self-report scales is challenging. Previous studies have indicated only weak correlations between these scales and tests. It remains open whether low correlations are due to method-specific biases of the self-reports or the fact that self-reports and tests measure different constructs (generalized knowledge/self-efficacy vs. specific knowledge). We investigated the relationship between self-report scales and tests of two aspects of teachers’ TPK – TPK-teaching and learning and TPK-classroom management – in a sample of 238 in-service teachers. Results showed that the TPK self-report scales seemed to measure a different construct (more generalized knowledge) than the tests and that low correlations cannot simply be explained by self-report method-specific biases.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101402"},"PeriodicalIF":2.6,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000816/pdfft?md5=0f3bcb8e4fcb832eb5f927ad6c20eb5e&pid=1-s2.0-S0191491X24000816-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142310772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Students’ perceptions of online peer feedback in process-oriented L2 writing: A qualitative inquiry 在以过程为导向的 L2 写作中,学生对在线同伴反馈的看法:定性调查
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-17 DOI: 10.1016/j.stueduc.2024.101403
Pelin Irgin , Zeynep Bilki

Peer feedback has been of paramount importance in second language (L2) writing given that L2 learners especially need the facilitative role of feedback in improving their writing skills. Despite recent research highlighting the benefits of peer feedback in L2 writing, there is a call for more qualitative studies situated in classroom contexts to explore the continuous flow of peer feedback in a social community including technology-enhanced interactive social settings. This case study takes the students at a university in Turkey as the center of the peer feedback process and explores how L2 writers (n = 35) using student blogs for online peer evaluation in the naturalistic setting of an academic writing course perceive online peer feedback in L2 writing. This qualitative study adopted a case study design using the data from students’ essays (210 essays), blog-mediated peer comments (on 35 student blogs), and self-reflection papers (105 reflections). The data was analyzed through Braun and Clarke’s inductive thematic analysis. The analysis resulting in four themes revealed that peer feedback experienced in an online writing community improved students’ ability to perceive and use feedback effectively by creating opportunities for a shared understanding of peer feedback and establishing a writing community and also enhanced students’ critical thinking skills as an essential aspect of the writing process. This study provides insights into the student experience of online peer feedback in L2 writing, highlighting the importance of creating a supportive and collaborative learning environment to foster effective feedback practices and enhance the students’ L2 writing skills.

在第二语言(L2)写作中,同伴反馈一直是至关重要的,因为第二语言学习者尤其需要反馈的促进作用来提高他们的写作技能。尽管最近的研究强调了同伴反馈在第二语言写作中的益处,但仍需要更多的课堂背景下的定性研究,以探索同伴反馈在社会群体(包括技术增强的互动社会环境)中的持续流动。本案例研究将土耳其一所大学的学生作为同伴反馈过程的中心,探讨在学术写作课程的自然环境中,使用学生博客进行在线同伴评价的 L2 写作者(n = 35)如何看待 L2 写作中的在线同伴反馈。这项定性研究采用了案例研究设计,使用的数据来自学生的作文(210 篇)、以博客为媒介的同伴评论(35 个学生的博客)和自我反思论文(105 篇反思)。通过布劳恩和克拉克的归纳式主题分析法对数据进行了分析。分析得出的四个主题显示,在在线写作社区中体验到的同伴反馈,通过创造机会让学生共同理解同伴反馈和建立写作社区,提高了学生有效感知和使用反馈的能力,同时也增强了学生的批判性思维能力,这是写作过程的一个重要方面。本研究深入探讨了学生在第二语言写作中的在线同伴反馈体验,强调了创建一个支持性和协作性学习环境对于促进有效反馈实践和提高学生第二语言写作技能的重要性。
{"title":"Students’ perceptions of online peer feedback in process-oriented L2 writing: A qualitative inquiry","authors":"Pelin Irgin ,&nbsp;Zeynep Bilki","doi":"10.1016/j.stueduc.2024.101403","DOIUrl":"10.1016/j.stueduc.2024.101403","url":null,"abstract":"<div><p>Peer feedback has been of paramount importance in second language (L2) writing given that L2 learners especially need the facilitative role of feedback in improving their writing skills. Despite recent research highlighting the benefits of peer feedback in L2 writing, there is a call for more qualitative studies situated in classroom contexts to explore the continuous flow of peer feedback in a social community including technology-enhanced interactive social settings. This case study takes the students at a university in Turkey as the center of the peer feedback process and explores how L2 writers (n = 35) using student blogs for online peer evaluation in the naturalistic setting of an academic writing course perceive online peer feedback in L2 writing. This qualitative study adopted a case study design using the data from students’ essays (210 essays), blog-mediated peer comments (on 35 student blogs), and self-reflection papers (105 reflections). The data was analyzed through Braun and Clarke’s inductive thematic analysis. The analysis resulting in four themes revealed that peer feedback experienced in an online writing community improved students’ ability to perceive and use feedback effectively by creating opportunities for a shared understanding of peer feedback and establishing a writing community and also enhanced students’ critical thinking skills as an essential aspect of the writing process. This study provides insights into the student experience of online peer feedback in L2 writing, highlighting the importance of creating a supportive and collaborative learning environment to foster effective feedback practices and enhance the students’ L2 writing skills.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101403"},"PeriodicalIF":2.6,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000828/pdfft?md5=cff1f7eaaeb5452c090472e6bd3c9b91&pid=1-s2.0-S0191491X24000828-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142243320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The role of item format in the PISA 2018 mathematics literacy assessment: A cross-country study 项目格式在 PISA 2018 数学素养评估中的作用:跨国研究
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-14 DOI: 10.1016/j.stueduc.2024.101401
Kseniia Marcq , Erika Jassuly Chalén Donayre , Johan Braeken

When construct-irrelevant sources affect item difficulty, validity of the assessment is compromised. Using responses of 260000 students from 71 countries to the Programme for International Student Assessment (PISA) 2018 mathematics assessment and cross-classified mixed effects models, we examined three validity concerns associated with the construct-irrelevant factor, item format: whether the format influenced item difficulty, whether item format’s impact on difficulty varied across countries, undermining PISA’s foundational goal of meaningful country comparisons, and whether item format effects differed between genders, affecting assessment fairness. Item format contributed to a substantial average of 12 % of variance in item difficulties. The effect of item format was non-uniform across countries, with 30 % of the variance in item difficulties being due to format in lower-performing countries, and 10 % in higher-performing countries, challenging the comparability of educational outcomes. The impact of gender on item format differences was minor. Implications for secondary research and assessment design are discussed.

当与建构无关的因素影响项目难度时,评估的有效性就会受到损害。利用来自 71 个国家的 26 万名学生对 2018 年国际学生评估项目(PISA)数学评估的回答和交叉分类混合效应模型,我们研究了与建构无关因素--项目格式--相关的三个效度问题:格式是否影响项目难度;项目格式对难度的影响是否因国家而异,从而破坏了 PISA 进行有意义的国家比较的基本目标;项目格式的影响是否因性别而异,从而影响评估的公平性。题目格式平均占题目难度差异的 12%。项目格式对各国的影响并不均匀,在成绩较差的国家,项目难度差异的 30% 是由项目格式造成的,而在成绩较好的国家,则为 10%,这对教育成果的可比性提出了挑战。性别对项目格式差异的影响很小。讨论了二次研究和评估设计的意义。
{"title":"The role of item format in the PISA 2018 mathematics literacy assessment: A cross-country study","authors":"Kseniia Marcq ,&nbsp;Erika Jassuly Chalén Donayre ,&nbsp;Johan Braeken","doi":"10.1016/j.stueduc.2024.101401","DOIUrl":"10.1016/j.stueduc.2024.101401","url":null,"abstract":"<div><p>When construct-irrelevant sources affect item difficulty, validity of the assessment is compromised. Using responses of 260000 students from 71 countries to the Programme for International Student Assessment (PISA) 2018 mathematics assessment and cross-classified mixed effects models, we examined three validity concerns associated with the construct-irrelevant factor, item format: whether the format influenced item difficulty, whether item format’s impact on difficulty varied across countries, undermining PISA’s foundational goal of meaningful country comparisons, and whether item format effects differed between genders, affecting assessment fairness. Item format contributed to a substantial average of 12 % of variance in item difficulties. The effect of item format was non-uniform across countries, with 30 % of the variance in item difficulties being due to format in lower-performing countries, and 10 % in higher-performing countries, challenging the comparability of educational outcomes. The impact of gender on item format differences was minor. Implications for secondary research and assessment design are discussed.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101401"},"PeriodicalIF":2.6,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X24000804/pdfft?md5=508c28bd0233e2005407a3aeaf5ccee2&pid=1-s2.0-S0191491X24000804-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142229772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The effects of peer interaction on learning outcome of college students in digital environment—The chain-mediated role of attitude and self-efficacy 数字化环境下同伴互动对大学生学习效果的影响--态度和自我效能的连锁中介作用
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-14 DOI: 10.1016/j.stueduc.2024.101404
Fangfang Pan , Guangxing Zhu , Wenjie Sui , Mengyun Fu

With the in-depth development of the Internet and digital technology, it has become an important way to learn online. Under digital learning environment, peer interaction among learners is not only playing a crucial role in the construction of their knowledge, but also is a key link to enhance their learning outcome. To investigate how peer interaction can affect learning outcome of college students, this research constructs a model of relationship, and administers a questionnaire survey among 3263 college students in 28 universities in China. The study has found that peer interaction positively affects learning outcome, meanwhile, attitude and self-efficacy act as chain mediators in the relationship of peer interaction and learning outcome. This study thoroughly discusses the impact mechanism of peer interaction on learning outcome of college students in the digital environment, which will provide beneficial references and inspirations for optimizing online learning mode and promoting learning outcome.

随着互联网和数字技术的深入发展,网络学习已经成为一种重要的学习方式。在数字化学习环境下,学习者之间的同伴互动不仅对学习者的知识建构起着至关重要的作用,也是提高学习效果的关键环节。为了探究同伴互动如何影响大学生的学习效果,本研究构建了一个关系模型,并对中国 28 所高校的 3263 名大学生进行了问卷调查。研究发现,同伴互动会对学习效果产生积极影响,同时,态度和自我效能感在同伴互动与学习效果的关系中起着连锁中介的作用。本研究深入探讨了数字化环境下同伴互动对大学生学习效果的影响机制,将为优化在线学习模式、促进学习效果提供有益的参考和启示。
{"title":"The effects of peer interaction on learning outcome of college students in digital environment—The chain-mediated role of attitude and self-efficacy","authors":"Fangfang Pan ,&nbsp;Guangxing Zhu ,&nbsp;Wenjie Sui ,&nbsp;Mengyun Fu","doi":"10.1016/j.stueduc.2024.101404","DOIUrl":"10.1016/j.stueduc.2024.101404","url":null,"abstract":"<div><p>With the in-depth development of the Internet and digital technology, it has become an important way to learn online. Under digital learning environment, peer interaction among learners is not only playing a crucial role in the construction of their knowledge, but also is a key link to enhance their learning outcome. To investigate how peer interaction can affect learning outcome of college students, this research constructs a model of relationship, and administers a questionnaire survey among 3263 college students in 28 universities in China. The study has found that peer interaction positively affects learning outcome, meanwhile, attitude and self-efficacy act as chain mediators in the relationship of peer interaction and learning outcome. This study thoroughly discusses the impact mechanism of peer interaction on learning outcome of college students in the digital environment, which will provide beneficial references and inspirations for optimizing online learning mode and promoting learning outcome.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101404"},"PeriodicalIF":2.6,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0191491X2400083X/pdfft?md5=f43d433d121130c19440d7b72c42e6bc&pid=1-s2.0-S0191491X2400083X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142229773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Building an explanatory framework for co-workers’ responses to teacher underperformance 建立同事对教师表现不佳的反应的解释框架
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-11 DOI: 10.1016/j.stueduc.2024.101397
Loth Van Den Ouweland , Jan Vanhoof , Piet Van den Bossche

Underperforming teachers can have a profound negative impact on their students, principals and co-workers, and the educational quality in their schools. Since little is known about how and why co-workers respond to teacher underperformance, this study aims to build an explanatory framework for different types of co-workers’ responses. The results of our survey study indicate that co-workers’ responses can partly be explained by how they consider their responsibility and authority to respond, as well as the use of responding. These considerations are, in turn, influenced by different underperformance, underperformer, co-worker, leadership and team characteristics. We discuss how co-workers’ responses to teacher underperformance can be facilitated.

表现不佳的教师会对学生、校长和同事以及学校的教育质量产生深远的负面影响。由于人们对同事如何以及为何对表现不佳的教师做出反应知之甚少,本研究旨在为不同类型的同事反应建立一个解释框架。我们的调查研究结果表明,同事的回应可以部分地通过他们如何看待自己回应的责任和权力以及回应的使用来解释。而这些考虑因素又受到不同的绩效不佳者、绩效不佳者、同事、领导和团队特征的影响。我们将讨论如何促进同事对教师表现不佳做出回应。
{"title":"Building an explanatory framework for co-workers’ responses to teacher underperformance","authors":"Loth Van Den Ouweland ,&nbsp;Jan Vanhoof ,&nbsp;Piet Van den Bossche","doi":"10.1016/j.stueduc.2024.101397","DOIUrl":"10.1016/j.stueduc.2024.101397","url":null,"abstract":"<div><p>Underperforming teachers can have a profound negative impact on their students, principals and co-workers, and the educational quality in their schools. Since little is known about how and why co-workers respond to teacher underperformance, this study aims to build an explanatory framework for different types of co-workers’ responses. The results of our survey study indicate that co-workers’ responses can partly be explained by how they consider their responsibility and authority to respond, as well as the use of responding. These considerations are, in turn, influenced by different underperformance, underperformer, co-worker, leadership and team characteristics. We discuss how co-workers’ responses to teacher underperformance can be facilitated.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101397"},"PeriodicalIF":2.6,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142168709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The influence of authentic leadership on teacher performance in Guiyang public primary schools 真实领导对贵阳市公立小学教师绩效的影响
IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-11 DOI: 10.1016/j.stueduc.2024.101400
Yihong Long , Yi Xia , Fasheng Cao , Yuan Long

This study examines the impact of authentic leadership on teacher performance within the context of Chinese primary schools, focusing specifically on the mediating roles of internalized moral perspective, balanced processing, and relational transparency. Utilizing a sample of 396 primary school teachers from 18 public primary schools in Guiyang, China, the study employs Partial Least Squares Structural Equation Modelling (PLS-SEM) to analyze the data. Results reveal that all four dimensions of authentic leadership—self-awareness, internalized moral perspective, balanced processing, and relational transparency—significantly enhance teacher performance. Additionally, internalized moral perspective, balanced processing, and relational transparency were found to mediate the relationship between self-awareness and teacher performance. These findings highlight the importance of fostering authentic leadership to improve educational outcomes. The study discusses its implications for teacher training programs, potential limitations, and directions for future research.

本研究探讨了在中国小学背景下,真实领导力对教师绩效的影响,尤其关注内化道德观、平衡处理和关系透明度的中介作用。研究采用偏最小二乘法结构方程模型(PLS-SEM)对数据进行分析。结果显示,真实领导力的四个维度--自我意识、内化道德观、平衡处理和关系透明度--都能显著提高教师绩效。此外,研究还发现,内化道德观、平衡处理和关系透明度在自我意识与教师绩效之间起到了中介作用。这些发现凸显了培养真实领导力对改善教育成果的重要性。本研究讨论了其对教师培训计划的影响、潜在的局限性以及未来的研究方向。
{"title":"The influence of authentic leadership on teacher performance in Guiyang public primary schools","authors":"Yihong Long ,&nbsp;Yi Xia ,&nbsp;Fasheng Cao ,&nbsp;Yuan Long","doi":"10.1016/j.stueduc.2024.101400","DOIUrl":"10.1016/j.stueduc.2024.101400","url":null,"abstract":"<div><p>This study examines the impact of authentic leadership on teacher performance within the context of Chinese primary schools, focusing specifically on the mediating roles of internalized moral perspective, balanced processing, and relational transparency. Utilizing a sample of 396 primary school teachers from 18 public primary schools in Guiyang, China, the study employs Partial Least Squares Structural Equation Modelling (PLS-SEM) to analyze the data. Results reveal that all four dimensions of authentic leadership—self-awareness, internalized moral perspective, balanced processing, and relational transparency—significantly enhance teacher performance. Additionally, internalized moral perspective, balanced processing, and relational transparency were found to mediate the relationship between self-awareness and teacher performance. These findings highlight the importance of fostering authentic leadership to improve educational outcomes. The study discusses its implications for teacher training programs, potential limitations, and directions for future research.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"83 ","pages":"Article 101400"},"PeriodicalIF":2.6,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142168708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Studies in Educational Evaluation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1