同行评估、自我评估和结果反馈:可行性和可靠性的检查

IF 2 Q2 EDUCATION & EDUCATIONAL RESEARCH European Journal of Engineering Education Pub Date : 2023-03-08 DOI:10.1080/03043797.2023.2185769
J. Power, David Tanner
{"title":"同行评估、自我评估和结果反馈:可行性和可靠性的检查","authors":"J. Power, David Tanner","doi":"10.1080/03043797.2023.2185769","DOIUrl":null,"url":null,"abstract":"ABSTRACT Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to peer-assessment scores, self-assessment scores, and expert assessor scores are analysed. Quality of feedback generated during the peer assessment activity is also considered. An open data set is included within the manuscript and hosted on the Open Science Framework. The results of this study suggest relatively high peer-assessment reliability when compared to expert assessments, although peer scoring tends to be consistently overestimated. In contrast, self-assessment scores demonstrate relatively low reliability when compared with expert assessor scores. The quality of feedback provided during the peer assessment exercise demonstrated a strong relationship with student performance. Recommendations for further refinement and implementation with larger cohorts are discussed.","PeriodicalId":47348,"journal":{"name":"European Journal of Engineering Education","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2023-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Peer assessment, self-assessment, and resultant feedback: an examination of feasibility and reliability\",\"authors\":\"J. Power, David Tanner\",\"doi\":\"10.1080/03043797.2023.2185769\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to peer-assessment scores, self-assessment scores, and expert assessor scores are analysed. Quality of feedback generated during the peer assessment activity is also considered. An open data set is included within the manuscript and hosted on the Open Science Framework. The results of this study suggest relatively high peer-assessment reliability when compared to expert assessments, although peer scoring tends to be consistently overestimated. In contrast, self-assessment scores demonstrate relatively low reliability when compared with expert assessor scores. The quality of feedback provided during the peer assessment exercise demonstrated a strong relationship with student performance. Recommendations for further refinement and implementation with larger cohorts are discussed.\",\"PeriodicalId\":47348,\"journal\":{\"name\":\"European Journal of Engineering Education\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2023-03-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Engineering Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/03043797.2023.2185769\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Engineering Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/03043797.2023.2185769","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 2

摘要

自我评估和同伴评估被认为是加深对复杂概念理解、增强元认知能力和支持学习者自我效能感的有效策略。本研究调查了在大学工程课程中完成的同伴和自我评估练习相关的数据(n=61)。分析了与同行评估分数、自我评估分数和专家评估分数相关的数据。在同行评估活动中产生的反馈的质量也被考虑在内。手稿中包含一个开放数据集,并托管在开放科学框架上。本研究的结果表明,与专家评估相比,同行评估的可靠性相对较高,尽管同行评分往往被高估。与专家评估分数相比,自我评估分数的可靠性相对较低。在同侪评估过程中提供的反馈的质量与学生的表现密切相关。讨论了进一步改进和在更大队列中实施的建议。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Peer assessment, self-assessment, and resultant feedback: an examination of feasibility and reliability
ABSTRACT Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to peer-assessment scores, self-assessment scores, and expert assessor scores are analysed. Quality of feedback generated during the peer assessment activity is also considered. An open data set is included within the manuscript and hosted on the Open Science Framework. The results of this study suggest relatively high peer-assessment reliability when compared to expert assessments, although peer scoring tends to be consistently overestimated. In contrast, self-assessment scores demonstrate relatively low reliability when compared with expert assessor scores. The quality of feedback provided during the peer assessment exercise demonstrated a strong relationship with student performance. Recommendations for further refinement and implementation with larger cohorts are discussed.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
European Journal of Engineering Education
European Journal of Engineering Education EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
7.30
自引率
13.00%
发文量
64
期刊介绍: European Journal of Engineering Education is published six times a year in print and electronic editions and provides an essential forum for dialogue between researchers and specialists in the field of engineering education, at European and worldwide levels. European Journal of Engineering Education is the Official Journal of SEFI, the Socièté Européenne pour la Formation des Ingénieurs (the European Society for Engineering Education). SEFI is a non-governmental organization whose aims are to develop information about engineering education, to improve communication and exchange between professors, researchers and students and to promote cooperation between the various institutions concerned with engineering education.
期刊最新文献
Engineer students’ views on competencies for sustainable development: a case from a systemic PBL environment using Q methodology ‘I think it's probably one of the most important skills we could ever know’: insights from early-career engineers on the preparedness of undergraduate degrees for the aerospace industry A system-based framework for engineering education as sustainable development What is the structure of a Challenge Based Learning project? A shortitudinal trajectory analysis of student process behaviours in an interdisciplinary engineering course Engineering professor perceptions of undergraduate engineering student stress
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1