首页 > 最新文献

Assessment & Evaluation in Higher Education最新文献

英文 中文
Factors associated with online examination cheating 与网络考试作弊有关的因素
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-11-11 DOI: 10.1080/02602938.2022.2144802
Michael Henderson, Jennifer Chung, R. Awdry, Matthew Mundy, Mike Bryant, Cliff Ashford, K. Ryan
Abstract Online examinations are a common experience in higher education. Their security is a key concern for education communities, and has resulted in a variety of cheating countermeasures. There is broad consensus in the literature that there is no one measure, including proctoring, which eradicates cheating behaviours. As a result, this study is exploratory, seeking to add to our understanding of the range of factors that may interact with frequency of cheating behaviour in online examinations. This large-scale study (N = 7839) is based in one Australian university which pivoted to online examinations during the 2021 Covid-19 lockdowns. Students who reported cheating (n = 216) revealed a wide range of factors that may have influenced their behaviours. A key observation is that cheating, although less frequent than reported elsewhere, occurred regardless of the security measure, assessment design, examination condition, and across the spectrum of student demographic variables. However, there were statistically significant differences in relation to frequency of cheating according to certain demographics, examination conditions, motivations, attitudes and perceptions. Although some forms of proctoring did demonstrate reduced frequencies in self-reported cheating, they are demonstrably incomplete solutions due to the complexity of other variables.
在线考试是高等教育中常见的一种体验。他们的安全是教育界关注的重点,并导致了各种各样的作弊对策。文献中有一个广泛的共识,即没有一种措施,包括监考,可以根除作弊行为。因此,这项研究是探索性的,旨在增加我们对可能与在线考试作弊行为频率相互作用的因素范围的理解。这项大规模研究(N = 7839)是在一所澳大利亚大学进行的,该大学在2021年Covid-19封锁期间转向在线考试。报告作弊的学生(n = 216)揭示了可能影响他们行为的各种因素。一个关键的观察是,尽管作弊比其他地方报道的要少,但无论安全措施、评估设计、考试条件和学生人口统计变量的范围如何,作弊都发生了。然而,根据某些人口统计、考试条件、动机、态度和观念,作弊频率在统计上存在显著差异。尽管某些形式的监考确实显示出自我报告作弊的频率降低,但由于其他变量的复杂性,它们显然是不完整的解决方案。
{"title":"Factors associated with online examination cheating","authors":"Michael Henderson, Jennifer Chung, R. Awdry, Matthew Mundy, Mike Bryant, Cliff Ashford, K. Ryan","doi":"10.1080/02602938.2022.2144802","DOIUrl":"https://doi.org/10.1080/02602938.2022.2144802","url":null,"abstract":"Abstract Online examinations are a common experience in higher education. Their security is a key concern for education communities, and has resulted in a variety of cheating countermeasures. There is broad consensus in the literature that there is no one measure, including proctoring, which eradicates cheating behaviours. As a result, this study is exploratory, seeking to add to our understanding of the range of factors that may interact with frequency of cheating behaviour in online examinations. This large-scale study (N = 7839) is based in one Australian university which pivoted to online examinations during the 2021 Covid-19 lockdowns. Students who reported cheating (n = 216) revealed a wide range of factors that may have influenced their behaviours. A key observation is that cheating, although less frequent than reported elsewhere, occurred regardless of the security measure, assessment design, examination condition, and across the spectrum of student demographic variables. However, there were statistically significant differences in relation to frequency of cheating according to certain demographics, examination conditions, motivations, attitudes and perceptions. Although some forms of proctoring did demonstrate reduced frequencies in self-reported cheating, they are demonstrably incomplete solutions due to the complexity of other variables.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"1 1","pages":"980 - 994"},"PeriodicalIF":4.4,"publicationDate":"2022-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82909071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Bifactor modelling of the psychological constructs of learner feedback literacy: conceptions of feedback, feedback trust and self-efficacy 学习者反馈素养心理结构的双因素模型:反馈、反馈信任和自我效能概念
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-11-10 DOI: 10.1080/02602938.2022.2042187
B. Song
Abstract In contemporary feedback research, effective feedback does not depend on merely the characteristics of feedback but also on learners’ ability to understand, manage and use the information. Known as feedback literacy, it refers to learners’ social cognitive capacity, affective capacity and disposition prior to substantial engagement with feedback. In addition, feedback literacy is said to be developed in social learning settings. Despite the importance of the learner feedback literacy construct, little is known about its quantitative conceptualization or the specific psychological variables underpinning it. The purpose of this paper is to propose and validate a bifactor model of learner feedback literacy consisting of (1) conceptions of feedback, (2) feedback trust and (3) self-efficacy. Drawing from data on 923 learners from a polytechnic in Singapore that practices the social constructivist learning approach, results from Rasch and bifactor modelling analyses revealed that the learner feedback literacy model is psychometrically sound and robust with the potential to be developed further. Limitations and future research directions in the use of this model are discussed in the paper.
摘要在当代反馈研究中,有效的反馈不仅仅取决于反馈的特征,还取决于学习者理解、管理和使用信息的能力。它被称为反馈素养,是指学习者在大量参与反馈之前的社会认知能力、情感能力和性格。此外,据说反馈素养是在社会学习环境中发展起来的。尽管学习者反馈素养结构很重要,但人们对其定量概念化或支撑它的特定心理变量知之甚少。本文的目的是提出并验证一个由(1)反馈概念、(2)反馈信任和(3)自我效能组成的学习者反馈质量双因子模型。根据新加坡一所采用社会建构主义学习方法的理工学院923名学生的数据,Rasch和双因子建模分析的结果表明,学习者反馈素养模型在心理测量方面是健全和稳健的,有进一步发展的潜力。文中讨论了该模型的局限性和未来的研究方向。
{"title":"Bifactor modelling of the psychological constructs of learner feedback literacy: conceptions of feedback, feedback trust and self-efficacy","authors":"B. Song","doi":"10.1080/02602938.2022.2042187","DOIUrl":"https://doi.org/10.1080/02602938.2022.2042187","url":null,"abstract":"Abstract In contemporary feedback research, effective feedback does not depend on merely the characteristics of feedback but also on learners’ ability to understand, manage and use the information. Known as feedback literacy, it refers to learners’ social cognitive capacity, affective capacity and disposition prior to substantial engagement with feedback. In addition, feedback literacy is said to be developed in social learning settings. Despite the importance of the learner feedback literacy construct, little is known about its quantitative conceptualization or the specific psychological variables underpinning it. The purpose of this paper is to propose and validate a bifactor model of learner feedback literacy consisting of (1) conceptions of feedback, (2) feedback trust and (3) self-efficacy. Drawing from data on 923 learners from a polytechnic in Singapore that practices the social constructivist learning approach, results from Rasch and bifactor modelling analyses revealed that the learner feedback literacy model is psychometrically sound and robust with the potential to be developed further. Limitations and future research directions in the use of this model are discussed in the paper.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"47 1","pages":"1444 - 1457"},"PeriodicalIF":4.4,"publicationDate":"2022-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49365570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Talking during a test?! Embracing mobile instant messaging during assessment 考试时说话?在评估期间采用移动即时消息
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-11-10 DOI: 10.1080/02602938.2022.2041545
Cecile Janse van Rensburg, S. Coetzee, Astrid Schmulian
Abstract This study reports on the incorporation of mobile instant messaging (MIM) in assessments, as a collaborative learning tool, to enable students to socially construct knowledge and develop their collaborative problem solving competence, while being assessed individually. In particular, this study explores: what is the extent and timing of students’ use of MIM to communicate with other students while being assessed individually? What communicative activities are evident in the content of students’ MIM communications while being assessed individually? How do students experience being able to use MIM while being assessed individually? The results of this study’s analysis of the messages sent during various assessments suggests that when incorporating MIM into assessments, instructors should consider the objective of those assessments together with the nature (e.g. essay style) and the stakes of the assessments as these appear to influence the extent, timing and content of the instant messaging communications by the students during the assessment. A survey of the students suggested that their experiences of being able to use MIM during assessments were largely positive due to the learning opportunities, collaboration and teamwork, authenticity and equity that the introduction of instant messaging during assessment enabled.
摘要本研究报告了将移动即时消息(MIM)作为一种协作学习工具纳入评估中的情况,以使学生在接受单独评估的同时,能够在社会上构建知识并发展其协作解决问题的能力。特别是,本研究探讨了:在单独评估的同时,学生使用MIM与其他学生交流的程度和时间是什么?在单独评估学生的MIM交流内容时,哪些交流活动是显而易见的?在单独评估的同时,学生如何体验能够使用MIM?本研究对各种评估期间发送的信息的分析结果表明,在将MIM纳入评估时,教师应考虑这些评估的目标以及评估的性质(如论文风格)和利害关系,因为这些似乎会影响评估的程度,学生在评估期间即时通讯的时间和内容。一项针对学生的调查表明,他们在评估期间能够使用MIM的经历在很大程度上是积极的,这是因为在评估期间引入即时消息带来了学习机会、协作和团队合作、真实性和公平性。
{"title":"Talking during a test?! Embracing mobile instant messaging during assessment","authors":"Cecile Janse van Rensburg, S. Coetzee, Astrid Schmulian","doi":"10.1080/02602938.2022.2041545","DOIUrl":"https://doi.org/10.1080/02602938.2022.2041545","url":null,"abstract":"Abstract This study reports on the incorporation of mobile instant messaging (MIM) in assessments, as a collaborative learning tool, to enable students to socially construct knowledge and develop their collaborative problem solving competence, while being assessed individually. In particular, this study explores: what is the extent and timing of students’ use of MIM to communicate with other students while being assessed individually? What communicative activities are evident in the content of students’ MIM communications while being assessed individually? How do students experience being able to use MIM while being assessed individually? The results of this study’s analysis of the messages sent during various assessments suggests that when incorporating MIM into assessments, instructors should consider the objective of those assessments together with the nature (e.g. essay style) and the stakes of the assessments as these appear to influence the extent, timing and content of the instant messaging communications by the students during the assessment. A survey of the students suggested that their experiences of being able to use MIM during assessments were largely positive due to the learning opportunities, collaboration and teamwork, authenticity and equity that the introduction of instant messaging during assessment enabled.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"47 1","pages":"1388 - 1400"},"PeriodicalIF":4.4,"publicationDate":"2022-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42131707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Developing assessment literacy among trainee translators: scaffolding self and peer assessment as an intervention 培养培训翻译人员的评估素养:作为干预手段的脚手架式自我评估和同行评估
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-11-07 DOI: 10.1080/02602938.2022.2142515
Guangjiao Chen, Xiangling Wang, Lyu Wang
Abstract Recent growth in research on assessment has focused on the importance of university students’ assessment literacy, yet few studies have investigated how self and peer assessment combined with scaffolding can develop student assessment literacy. To address this, we developed scaffolding self and peer assessment (SSPA) as an intervention to build student assessment literacy. A quasi-experimental design was implemented to test its usefulness; one class (N = 21) received the intervention and the other (N = 23) did not. The findings indicated that SSPA had a positive effect on the trainee translators’ assessment literacy levels. Consistent across the time points, the intervention group demonstrated significant improvements in self and peer feedback provision. In contrast, no such trend was noticed among the non-intervention group. The intervention group also significantly outperformed the non-intervention group in translation performance. Students were generally positive about SSPA, showing its feasibility in translation instruction. This study highlights the role that teacher scaffolding can play in helping trainee translators develop assessment literacy to meet language service industry requirements.
摘要最近对评估的研究集中在大学生评估素养的重要性上,但很少有研究调查自我和同伴评估与支架相结合如何培养学生的评估素养。为了解决这一问题,我们开发了脚手架式自我和同伴评估(SSPA),作为建立学生评估素养的干预措施。实施了一个准实验设计来测试其有用性;一类(N = 21)接受干预,而另一个(N = 23)没有。研究结果表明,SSPA对实习译员的评估素养水平有积极影响。在各个时间点上保持一致,干预组在自我和同伴反馈方面表现出显著改善。相反,在非干预组中没有发现这种趋势。干预组的翻译成绩也显著优于非干预组。学生普遍对SSPA持肯定态度,表明其在翻译教学中的可行性。这项研究强调了教师脚手架在帮助实习翻译培养评估素养以满足语言服务行业要求方面可以发挥的作用。
{"title":"Developing assessment literacy among trainee translators: scaffolding self and peer assessment as an intervention","authors":"Guangjiao Chen, Xiangling Wang, Lyu Wang","doi":"10.1080/02602938.2022.2142515","DOIUrl":"https://doi.org/10.1080/02602938.2022.2142515","url":null,"abstract":"Abstract Recent growth in research on assessment has focused on the importance of university students’ assessment literacy, yet few studies have investigated how self and peer assessment combined with scaffolding can develop student assessment literacy. To address this, we developed scaffolding self and peer assessment (SSPA) as an intervention to build student assessment literacy. A quasi-experimental design was implemented to test its usefulness; one class (N = 21) received the intervention and the other (N = 23) did not. The findings indicated that SSPA had a positive effect on the trainee translators’ assessment literacy levels. Consistent across the time points, the intervention group demonstrated significant improvements in self and peer feedback provision. In contrast, no such trend was noticed among the non-intervention group. The intervention group also significantly outperformed the non-intervention group in translation performance. Students were generally positive about SSPA, showing its feasibility in translation instruction. This study highlights the role that teacher scaffolding can play in helping trainee translators develop assessment literacy to meet language service industry requirements.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"888 - 902"},"PeriodicalIF":4.4,"publicationDate":"2022-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42909214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A practical approach to overcoming biases in comparing student performance in higher education 在比较高等教育学生表现时克服偏见的实用方法
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-11-03 DOI: 10.1080/02602938.2022.2134841
Kai Pastor, Thorsten Schank, O. Troitschanskaia, K. Wälde
Abstract In times of rankings and performance benchmarks, data on average marks of higher education students are very common internationally and are often used as quality indicators in practice. We discuss the principles behind the distribution of average marks of students. These principles need to be taken into account when calculating the percentile of (the average mark of) a student. An informative percentile is obtained only if the average mark is compared to a distribution of averages that have been calculated based on the same number of credit points obtained by the student. We provide an empirical example from a university in Germany, which shows that percentile information can differ considerably when based upon different samples. Our findings indicate that the approach proposed in this study may not only be the most efficient approach for ranking students to be implemented into university practice, but may also contribute to a much more objective and credible grade reporting system for student performance.
摘要在排名和成绩基准时代,高等教育学生的平均成绩数据在国际上非常常见,在实践中经常被用作质量指标。我们讨论了学生平均分数分布背后的原则。在计算学生的百分位(平均分数)时,需要考虑这些原则。只有将平均分数与基于学生获得的相同学分计算的平均值分布进行比较,才能获得信息百分位数。我们提供了一个来自德国一所大学的实证例子,该例子表明,当基于不同的样本时,百分位信息可能会有很大的差异。我们的研究结果表明,本研究中提出的方法不仅可能是将学生排名纳入大学实践的最有效方法,而且可能有助于建立一个更客观、更可信的学生成绩报告系统。
{"title":"A practical approach to overcoming biases in comparing student performance in higher education","authors":"Kai Pastor, Thorsten Schank, O. Troitschanskaia, K. Wälde","doi":"10.1080/02602938.2022.2134841","DOIUrl":"https://doi.org/10.1080/02602938.2022.2134841","url":null,"abstract":"Abstract In times of rankings and performance benchmarks, data on average marks of higher education students are very common internationally and are often used as quality indicators in practice. We discuss the principles behind the distribution of average marks of students. These principles need to be taken into account when calculating the percentile of (the average mark of) a student. An informative percentile is obtained only if the average mark is compared to a distribution of averages that have been calculated based on the same number of credit points obtained by the student. We provide an empirical example from a university in Germany, which shows that percentile information can differ considerably when based upon different samples. Our findings indicate that the approach proposed in this study may not only be the most efficient approach for ranking students to be implemented into university practice, but may also contribute to a much more objective and credible grade reporting system for student performance.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"834 - 846"},"PeriodicalIF":4.4,"publicationDate":"2022-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47686766","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A review of the changes in higher education assessment and grading policy during covid-19 新冠肺炎期间高等教育评估和分级政策的变化
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-11-03 DOI: 10.1080/02602938.2022.2140780
C. Chan
Abstract The Covid-19 pandemic has not only brought about sociocultural, psychological and economic challenges, but also educational problems that have entailed radical policy changes to allow universities and colleges to fulfil their role. Before the pandemic, the majority of university courses were designed for face-to-face settings; but under the social distancing policies since Covid-19, institutions have had to react quickly, revising their teaching and assessment policies to ensure that education continues for all students and accommodate the new remote reality of education. This paper provides a review of the changes in educational assessment and grading policies of universities around the world in response to the Covid-19 pandemic, where five key themes were identified: covid-19 binary grading system, revised regulations governing the final degree award, relaxed academic progression policies, revised extension, deferral and exceptional circumstances policies, and mark adjustments. This review will serve as a useful summary for institutions to reflect upon and inform planning strategies for subsequent unexpected future events.
摘要新冠肺炎大流行不仅带来了社会文化、心理和经济挑战,还带来了教育问题,这些问题导致了政策的根本改变,使大学和学院能够发挥其作用。在新冠疫情之前,大多数大学课程都是为面对面的环境而设计的;但在新冠肺炎以来的社交距离政策下,各院校不得不迅速做出反应,修改教学和评估政策,以确保所有学生都能继续接受教育,并适应新的远程教育现实。本文回顾了世界各地大学为应对新冠肺炎疫情而进行的教育评估和分级政策的变化,其中确定了五个关键主题:新冠肺炎二元分级制度、修订的最终学位授予条例、放宽的学术进步政策、修订的延期、延期和特殊情况政策,以及标记调整。这一审查将作为一个有用的总结,供各机构反思并为后续意外未来事件的规划战略提供信息。
{"title":"A review of the changes in higher education assessment and grading policy during covid-19","authors":"C. Chan","doi":"10.1080/02602938.2022.2140780","DOIUrl":"https://doi.org/10.1080/02602938.2022.2140780","url":null,"abstract":"Abstract The Covid-19 pandemic has not only brought about sociocultural, psychological and economic challenges, but also educational problems that have entailed radical policy changes to allow universities and colleges to fulfil their role. Before the pandemic, the majority of university courses were designed for face-to-face settings; but under the social distancing policies since Covid-19, institutions have had to react quickly, revising their teaching and assessment policies to ensure that education continues for all students and accommodate the new remote reality of education. This paper provides a review of the changes in educational assessment and grading policies of universities around the world in response to the Covid-19 pandemic, where five key themes were identified: covid-19 binary grading system, revised regulations governing the final degree award, relaxed academic progression policies, revised extension, deferral and exceptional circumstances policies, and mark adjustments. This review will serve as a useful summary for institutions to reflect upon and inform planning strategies for subsequent unexpected future events.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"874 - 887"},"PeriodicalIF":4.4,"publicationDate":"2022-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44534424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Exploring the relationship between personalized feedback models, learning design and assessment outcomes 探索个性化反馈模型、学习设计和评估结果之间的关系
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-27 DOI: 10.1080/02602938.2022.2139351
Fatemeh Salehian Kia, Abelardo Pardo, S. Dawson, Heather O’Brien
Abstract The increasing use of technology in education has brought new opportunities for the systematic collection of student data. Analyzing technology-mediated trace data, for example, has enabled researchers to bring new insights into student learning processes and the factors involved to support learning and teaching. However, many of these learning analytic studies have drawn conclusions from limited data sets that are derived from a single course or program of study. This impacts the generalizability of noted outcomes and calls for research on larger institutional data sets. The institutional adoption and analysis of learning technology can provide deeper insights into a wide range of learning contexts in practice. This study focused on examining how instructors used the learning tool, OnTask, to provide personalized feedback for students in large classes. We collected usage data from 99 courses and 19,385 students to examine how the instructors customized feedback to different groups of students. The findings reveal that there is a significant association between the topics of feedback and students with different performance. The results also demonstrated that instructors most frequently provided feedback related to student assessment. The study emphasizes the importance of teacher and student feedback literacy for creating effective feedback loops.
摘要技术在教育中的日益使用为系统收集学生数据带来了新的机会。例如,分析技术中介的追踪数据使研究人员能够对学生的学习过程以及支持学习和教学的因素有新的见解。然而,这些学习分析研究中的许多都是从有限的数据集中得出结论的,这些数据集是从单一的课程或课程中得出的。这影响了所注意到的结果的可推广性,并要求对更大的机构数据集进行研究。机构对学习技术的采用和分析可以在实践中对广泛的学习环境提供更深入的见解。这项研究的重点是考察教师如何使用学习工具OnTask为大班学生提供个性化反馈。我们收集了99门课程和19385名学生的使用数据,以研究讲师如何为不同的学生群体定制反馈。研究结果表明,反馈主题与不同表现的学生之间存在显著关联。研究结果还表明,教师最常提供与学生评估相关的反馈。该研究强调了教师和学生的反馈素养对于创建有效的反馈回路的重要性。
{"title":"Exploring the relationship between personalized feedback models, learning design and assessment outcomes","authors":"Fatemeh Salehian Kia, Abelardo Pardo, S. Dawson, Heather O’Brien","doi":"10.1080/02602938.2022.2139351","DOIUrl":"https://doi.org/10.1080/02602938.2022.2139351","url":null,"abstract":"Abstract The increasing use of technology in education has brought new opportunities for the systematic collection of student data. Analyzing technology-mediated trace data, for example, has enabled researchers to bring new insights into student learning processes and the factors involved to support learning and teaching. However, many of these learning analytic studies have drawn conclusions from limited data sets that are derived from a single course or program of study. This impacts the generalizability of noted outcomes and calls for research on larger institutional data sets. The institutional adoption and analysis of learning technology can provide deeper insights into a wide range of learning contexts in practice. This study focused on examining how instructors used the learning tool, OnTask, to provide personalized feedback for students in large classes. We collected usage data from 99 courses and 19,385 students to examine how the instructors customized feedback to different groups of students. The findings reveal that there is a significant association between the topics of feedback and students with different performance. The results also demonstrated that instructors most frequently provided feedback related to student assessment. The study emphasizes the importance of teacher and student feedback literacy for creating effective feedback loops.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"860 - 873"},"PeriodicalIF":4.4,"publicationDate":"2022-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47365731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Mark distribution is affected by the type of assignment but not by features of the marking scheme in a biomedical sciences department of a UK university 在英国一所大学的生物医学科学系中,分数分布受作业类型的影响,而不受评分方案特征的影响
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-22 DOI: 10.1080/02602938.2022.2134552
M. Daw
Abstract Marking schemes are a tool to ensure fairness in assessment of student work. Key features of fairness are that different markers would award the same mark to the same work and that the resulting marks effectively discriminate between different levels of student attainment. This study focuses on the ability of assessment to discriminate by analysing the mark distributions resulting from the use of different types of marking scheme in a real-world setting in a research-intensive UK university. This analysis shows that, in qualitative assessment, the mark distribution is unaffected by features of the marking scheme used. Instead, it shows that the type of assignment used has a significant effect on the mark distribution and that these effects are sometimes counterintuitive. Marking schemes are unlikely to be an effective tool in shaping mark distributions. To determine the effectiveness of approaches to assessment, we need to interrogate data rather than make assumptions.
摘要评分方案是确保学生作业评估公平性的一种工具。公平的主要特征是,不同的分数会给同一项工作授予相同的分数,由此产生的分数有效地区分了不同水平的学生。本研究通过分析英国一所研究密集型大学在现实世界中使用不同类型的评分方案所产生的分数分布,重点关注评估的辨别能力。该分析表明,在定性评估中,分数分布不受所用评分方案特征的影响。相反,它表明所使用的分配类型对分数分布有显著影响,这些影响有时是违反直觉的。标记方案不太可能成为形成标记分布的有效工具。为了确定评估方法的有效性,我们需要询问数据,而不是做出假设。
{"title":"Mark distribution is affected by the type of assignment but not by features of the marking scheme in a biomedical sciences department of a UK university","authors":"M. Daw","doi":"10.1080/02602938.2022.2134552","DOIUrl":"https://doi.org/10.1080/02602938.2022.2134552","url":null,"abstract":"Abstract Marking schemes are a tool to ensure fairness in assessment of student work. Key features of fairness are that different markers would award the same mark to the same work and that the resulting marks effectively discriminate between different levels of student attainment. This study focuses on the ability of assessment to discriminate by analysing the mark distributions resulting from the use of different types of marking scheme in a real-world setting in a research-intensive UK university. This analysis shows that, in qualitative assessment, the mark distribution is unaffected by features of the marking scheme used. Instead, it shows that the type of assignment used has a significant effect on the mark distribution and that these effects are sometimes counterintuitive. Marking schemes are unlikely to be an effective tool in shaping mark distributions. To determine the effectiveness of approaches to assessment, we need to interrogate data rather than make assumptions.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"806 - 819"},"PeriodicalIF":4.4,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42298797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Program-level assessment planning in Australia: the considerations and practices of university academics 澳大利亚项目级评估规划:大学学术界的思考与实践
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-22 DOI: 10.1080/02602938.2022.2134553
N. Charlton, R. Newsham-West
Abstract Quality assessment in higher education needs to drive learning to produce graduates with disciplinary knowledge and employable skills. Performance-based funding requires universities to focus on graduate outcomes and future employment status. Research was conducted to investigate how program-level assessment planning is occurring within Australian universities, to determine academics understanding what aspects they consider and the assessment practice they identify as essential at the program-planning level. Constructivist grounded theory underpins the methodological approach and 18 academics were interviewed. Participants included Associate Deans and Program Directors (or equivalent roles) from seven Australian universities, in the accredited disciplines of dietetics and physiotherapy and non-accredited degrees in biomedical science and science. The results indicate that academics consider a myriad of factors including policies, curriculum, skills, and accreditation. Assessment practices identified as essential incorporate constructive alignment, a range of assessment tasks, authentic, and continuous assessments. The goal of program-level assessment planning is to holistically sequence assessment tasks to enhance students’ employability, so they become successful graduates and secure employment, which enables universities to acquire future funding.
摘要高等教育质量评估需要推动学习,培养具有学科知识和就业技能的毕业生。基于绩效的资助要求大学关注毕业生的成绩和未来的就业状况。进行研究是为了调查澳大利亚大学内部的项目级评估规划是如何进行的,以确定学术界对他们所考虑的方面以及他们认为在项目规划层面至关重要的评估实践的理解。建构主义基础理论是方法论的基础,18位学者接受了采访。参与者包括来自七所澳大利亚大学的副院长和项目主任(或同等职位),他们分别是营养学和物理疗法的认证学科以及生物医学和科学的非认证学位。研究结果表明,学术界考虑了许多因素,包括政策、课程、技能和认证。被确定为至关重要的评估实践包括建设性的一致性、一系列评估任务、真实和持续的评估。项目级评估规划的目标是对评估任务进行全面排序,以提高学生的就业能力,从而使他们成为成功的毕业生并确保就业,这使大学能够获得未来的资金。
{"title":"Program-level assessment planning in Australia: the considerations and practices of university academics","authors":"N. Charlton, R. Newsham-West","doi":"10.1080/02602938.2022.2134553","DOIUrl":"https://doi.org/10.1080/02602938.2022.2134553","url":null,"abstract":"Abstract Quality assessment in higher education needs to drive learning to produce graduates with disciplinary knowledge and employable skills. Performance-based funding requires universities to focus on graduate outcomes and future employment status. Research was conducted to investigate how program-level assessment planning is occurring within Australian universities, to determine academics understanding what aspects they consider and the assessment practice they identify as essential at the program-planning level. Constructivist grounded theory underpins the methodological approach and 18 academics were interviewed. Participants included Associate Deans and Program Directors (or equivalent roles) from seven Australian universities, in the accredited disciplines of dietetics and physiotherapy and non-accredited degrees in biomedical science and science. The results indicate that academics consider a myriad of factors including policies, curriculum, skills, and accreditation. Assessment practices identified as essential incorporate constructive alignment, a range of assessment tasks, authentic, and continuous assessments. The goal of program-level assessment planning is to holistically sequence assessment tasks to enhance students’ employability, so they become successful graduates and secure employment, which enables universities to acquire future funding.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"820 - 833"},"PeriodicalIF":4.4,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43703318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing engineering students’ perspectives of entrepreneurship education within higher education: a comparative study in Hong Kong 评估高等教育中工科学生的创业教育观点:香港的比较研究
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-22 DOI: 10.1080/02602938.2022.2137103
Hannah Y. H. Wong, Cecilia K. Y. Chan
Abstract With the increasing interest in entrepreneurship education within engineering education, there are questions on what engineering entrepreneurship education should include. As engineering entrepreneurship education aims to foster entrepreneurial individuals who will contribute to knowledge-based societies and economic growth, student perspectives are crucial. This study assessed first and final year engineering students’ perceptions on entrepreneurship education in a university in Hong Kong, identifying important competencies as learning outcomes and motivating and deterring factors for students to pursue entrepreneurship as a career. Findings offer implications for curriculum design and educational practices, particularly on formally offering entrepreneurship education in the engineering discipline, involving competencies development in educational practices and developing opportunities addressing students’ factors of motivation and deterrence.
随着创业教育在工程教育领域受到越来越多的关注,工程创业教育应该包括哪些内容也出现了一些问题。由于工程创业教育旨在培养为知识型社会和经济增长做出贡献的企业家,学生的观点至关重要。本研究评估了香港一所大学一年级和最后一年级工科学生对创业教育的看法,找出了作为学习成果的重要能力,以及激励和阻碍学生将创业作为职业的因素。研究结果为课程设计和教育实践提供了启示,特别是在工程学科中正式提供创业教育,涉及教育实践中的能力发展和发展机会,解决学生的动机和威慑因素。
{"title":"Assessing engineering students’ perspectives of entrepreneurship education within higher education: a comparative study in Hong Kong","authors":"Hannah Y. H. Wong, Cecilia K. Y. Chan","doi":"10.1080/02602938.2022.2137103","DOIUrl":"https://doi.org/10.1080/02602938.2022.2137103","url":null,"abstract":"Abstract With the increasing interest in entrepreneurship education within engineering education, there are questions on what engineering entrepreneurship education should include. As engineering entrepreneurship education aims to foster entrepreneurial individuals who will contribute to knowledge-based societies and economic growth, student perspectives are crucial. This study assessed first and final year engineering students’ perceptions on entrepreneurship education in a university in Hong Kong, identifying important competencies as learning outcomes and motivating and deterring factors for students to pursue entrepreneurship as a career. Findings offer implications for curriculum design and educational practices, particularly on formally offering entrepreneurship education in the engineering discipline, involving competencies development in educational practices and developing opportunities addressing students’ factors of motivation and deterrence.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"847 - 859"},"PeriodicalIF":4.4,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47226312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Assessment & Evaluation in Higher Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1