{"title":"小组论文评分的过程指标:评估数据和在线行为的学习分析","authors":"Mei-Shiu Chiu, Ya Ping (Amy) Hsiao","doi":"10.30958/aje.10-4-2","DOIUrl":null,"url":null,"abstract":"The aim of this study was to identify process-related indicators for grading group essays. The research participants were students registered in a teacher-training course using an instructional design with face-to-face and digital blended learning. The course required the students in small collaborative groups to design, implement, and evaluate a teaching program using creative pedagogical designs, which were documented using group essays. Four indicators relating to group essays along the course process were collected: (A) group essay grades assessed by different agents, (B) students’ other course grades or behaviours (i.e., multiple assessments) as well as (C) comment behaviours and (D) version history behaviours through an online co-editing system (i.e., Google Docs). Statistical analysis results indicated that the instructor’s group essay grades were related to the group essay grades assessed by out-group peers (i.e. peers from other groups), online group comment frequencies, and online group comment interaction density. Keywords: assessment methods and tools, collaborative learning, essay grading, learning analytics, higher education","PeriodicalId":36453,"journal":{"name":"Athens Journal of Education","volume":"90 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour\",\"authors\":\"Mei-Shiu Chiu, Ya Ping (Amy) Hsiao\",\"doi\":\"10.30958/aje.10-4-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The aim of this study was to identify process-related indicators for grading group essays. The research participants were students registered in a teacher-training course using an instructional design with face-to-face and digital blended learning. The course required the students in small collaborative groups to design, implement, and evaluate a teaching program using creative pedagogical designs, which were documented using group essays. Four indicators relating to group essays along the course process were collected: (A) group essay grades assessed by different agents, (B) students’ other course grades or behaviours (i.e., multiple assessments) as well as (C) comment behaviours and (D) version history behaviours through an online co-editing system (i.e., Google Docs). Statistical analysis results indicated that the instructor’s group essay grades were related to the group essay grades assessed by out-group peers (i.e. peers from other groups), online group comment frequencies, and online group comment interaction density. Keywords: assessment methods and tools, collaborative learning, essay grading, learning analytics, higher education\",\"PeriodicalId\":36453,\"journal\":{\"name\":\"Athens Journal of Education\",\"volume\":\"90 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Athens Journal of Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.30958/aje.10-4-2\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Athens Journal of Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.30958/aje.10-4-2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Social Sciences","Score":null,"Total":0}
Process Indicators for Grading Group Essays: Learning Analytics of Assessment Data and Online Behaviour
The aim of this study was to identify process-related indicators for grading group essays. The research participants were students registered in a teacher-training course using an instructional design with face-to-face and digital blended learning. The course required the students in small collaborative groups to design, implement, and evaluate a teaching program using creative pedagogical designs, which were documented using group essays. Four indicators relating to group essays along the course process were collected: (A) group essay grades assessed by different agents, (B) students’ other course grades or behaviours (i.e., multiple assessments) as well as (C) comment behaviours and (D) version history behaviours through an online co-editing system (i.e., Google Docs). Statistical analysis results indicated that the instructor’s group essay grades were related to the group essay grades assessed by out-group peers (i.e. peers from other groups), online group comment frequencies, and online group comment interaction density. Keywords: assessment methods and tools, collaborative learning, essay grading, learning analytics, higher education