{"title":"同行评估、自我评估和结果反馈:可行性和可靠性的检查","authors":"J. Power, David Tanner","doi":"10.1080/03043797.2023.2185769","DOIUrl":null,"url":null,"abstract":"ABSTRACT Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to peer-assessment scores, self-assessment scores, and expert assessor scores are analysed. Quality of feedback generated during the peer assessment activity is also considered. An open data set is included within the manuscript and hosted on the Open Science Framework. The results of this study suggest relatively high peer-assessment reliability when compared to expert assessments, although peer scoring tends to be consistently overestimated. In contrast, self-assessment scores demonstrate relatively low reliability when compared with expert assessor scores. The quality of feedback provided during the peer assessment exercise demonstrated a strong relationship with student performance. Recommendations for further refinement and implementation with larger cohorts are discussed.","PeriodicalId":47348,"journal":{"name":"European Journal of Engineering Education","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2023-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Peer assessment, self-assessment, and resultant feedback: an examination of feasibility and reliability\",\"authors\":\"J. Power, David Tanner\",\"doi\":\"10.1080/03043797.2023.2185769\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to peer-assessment scores, self-assessment scores, and expert assessor scores are analysed. Quality of feedback generated during the peer assessment activity is also considered. An open data set is included within the manuscript and hosted on the Open Science Framework. The results of this study suggest relatively high peer-assessment reliability when compared to expert assessments, although peer scoring tends to be consistently overestimated. In contrast, self-assessment scores demonstrate relatively low reliability when compared with expert assessor scores. The quality of feedback provided during the peer assessment exercise demonstrated a strong relationship with student performance. Recommendations for further refinement and implementation with larger cohorts are discussed.\",\"PeriodicalId\":47348,\"journal\":{\"name\":\"European Journal of Engineering Education\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2023-03-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Engineering Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/03043797.2023.2185769\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Engineering Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/03043797.2023.2185769","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Peer assessment, self-assessment, and resultant feedback: an examination of feasibility and reliability
ABSTRACT Self and peer assessments have been identified as effective strategies to develop a deeper understanding of complex concepts, enhance meta-cognitive capacity, and support learner self-efficacy. This study examines data related to peer and self-assessment exercises completed within a university engineering programme (n=61). Data related to peer-assessment scores, self-assessment scores, and expert assessor scores are analysed. Quality of feedback generated during the peer assessment activity is also considered. An open data set is included within the manuscript and hosted on the Open Science Framework. The results of this study suggest relatively high peer-assessment reliability when compared to expert assessments, although peer scoring tends to be consistently overestimated. In contrast, self-assessment scores demonstrate relatively low reliability when compared with expert assessor scores. The quality of feedback provided during the peer assessment exercise demonstrated a strong relationship with student performance. Recommendations for further refinement and implementation with larger cohorts are discussed.
期刊介绍:
European Journal of Engineering Education is published six times a year in print and electronic editions and provides an essential forum for dialogue between researchers and specialists in the field of engineering education, at European and worldwide levels. European Journal of Engineering Education is the Official Journal of SEFI, the Socièté Européenne pour la Formation des Ingénieurs (the European Society for Engineering Education). SEFI is a non-governmental organization whose aims are to develop information about engineering education, to improve communication and exchange between professors, researchers and students and to promote cooperation between the various institutions concerned with engineering education.