首页 > 最新文献

Assessment & Evaluation in Higher Education最新文献

英文 中文
Setting out SET: a situational mapping of student evaluation of teaching in Australian higher education 设置SET:澳大利亚高等教育中学生评价教学的情境映射
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-19 DOI: 10.1080/02602938.2022.2130169
Margaret Lloyd, Freya Wright-Brough
Abstract The student evaluation of teaching (SET) in higher education has become an increasingly complex and subjectively contested area. From a singular purpose in seeking information to improve teaching in the 1920s, evaluation has now expanded to encompass administrative and regulatory purposes. Currently, evaluation impacts on personal and institutional reputation and is frequently used as a benchmark in determining and shaping individual academic careers. The value and purpose of evaluation is open to ongoing debate, as is the notion of transparency regarding who should have access to evaluation data (quantitative scores and/or free text comments). This paper presents the outcome of a situational mapping we conducted to better understand student evaluations of teaching in Australian higher education. We identified the component actors, actants and elements of the setting and derived a list of the discursive constructions which drive the relationships between them. To test the efficacy of our mapping in terms of isolating situations within the broader setting, we describe three hypothetical case studies: making student evaluations public, closing the loop and academic surveillance.
摘要高等教育中的学生教学评价(SET)已成为一个日益复杂和主观争议的领域。从20世纪20年代寻求信息以改善教学的单一目的,评估现在已经扩展到包括行政和监管目的。目前,评估影响个人和机构声誉,并经常被用作决定和塑造个人学术生涯的基准。评价的价值和目的以及关于谁应该获得评价数据(定量分数和/或自由文本评论)的透明度概念,都有待于持续的辩论。本文介绍了我们为更好地理解澳大利亚高等教育中学生对教学的评价而进行的情景映射的结果。我们确定了场景中的组成角色、行为体和元素,并推导了一份驱动它们之间关系的话语结构列表。为了测试我们在更广泛的环境中孤立情况的映射效果,我们描述了三个假设的案例研究:公开学生评估、闭环和学术监督。
{"title":"Setting out SET: a situational mapping of student evaluation of teaching in Australian higher education","authors":"Margaret Lloyd, Freya Wright-Brough","doi":"10.1080/02602938.2022.2130169","DOIUrl":"https://doi.org/10.1080/02602938.2022.2130169","url":null,"abstract":"Abstract The student evaluation of teaching (SET) in higher education has become an increasingly complex and subjectively contested area. From a singular purpose in seeking information to improve teaching in the 1920s, evaluation has now expanded to encompass administrative and regulatory purposes. Currently, evaluation impacts on personal and institutional reputation and is frequently used as a benchmark in determining and shaping individual academic careers. The value and purpose of evaluation is open to ongoing debate, as is the notion of transparency regarding who should have access to evaluation data (quantitative scores and/or free text comments). This paper presents the outcome of a situational mapping we conducted to better understand student evaluations of teaching in Australian higher education. We identified the component actors, actants and elements of the setting and derived a list of the discursive constructions which drive the relationships between them. To test the efficacy of our mapping in terms of isolating situations within the broader setting, we describe three hypothetical case studies: making student evaluations public, closing the loop and academic surveillance.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"790 - 805"},"PeriodicalIF":4.4,"publicationDate":"2022-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41528645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
‘I don’t know if people realize the impact of their words’: how does feedback during internship impact nursing student learning? “我不知道人们是否意识到他们话语的影响”:实习期间的反馈如何影响护理学生的学习?
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-11 DOI: 10.1080/02602938.2022.2130168
Matthieu Hausman, J. Dancot, B. Petre, M. Guillaume, P. Detroz
Abstract Previous studies on the factors that can affect self-esteem and clinical skills during training among bachelor’s-level nursing students in Belgium have shown that internships – and evaluation and feedback moments, more specifically – were key points in that process. We did a study to better understand how students experience those moments and which specific aspects of feedback are involved. This article focuses on how feedback is experienced and on the consequences of that in terms of learning. Here we identify the aspects of feedback that can result in positive or negative experiences, with different implications for learning. Our findings highlight the key role that – along with valence – the focus and tone of feedback plays. In addition, students’ lived experience can heighten or dampen their motivation to act on feedback and affect how they regulate their learning behavior when feedback is experienced either positively or negatively. Generally speaking, students show resistance or rejection when feedback is experienced negatively. While these results are consistent with other studies, further research is needed to explore the emotional process at work in feedback processing.
摘要先前关于比利时学士级护理学生在培训期间影响自尊和临床技能的因素的研究表明,实习——更具体地说,评估和反馈时刻——是这一过程中的关键点。我们做了一项研究,以更好地了解学生是如何体验这些时刻的,以及反馈涉及哪些具体方面。这篇文章的重点是如何体验反馈,以及反馈对学习的影响。在这里,我们确定了反馈中可能导致积极或消极体验的方面,这些方面对学习有不同的影响。我们的研究结果强调了反馈的焦点和语气以及效价所起的关键作用。此外,学生的生活经历会增强或抑制他们对反馈采取行动的动机,并影响他们在积极或消极地体验反馈时如何调节学习行为。一般来说,当反馈受到负面影响时,学生会表现出抗拒或拒绝。虽然这些结果与其他研究一致,但还需要进一步的研究来探索反馈处理中的情绪过程。
{"title":"‘I don’t know if people realize the impact of their words’: how does feedback during internship impact nursing student learning?","authors":"Matthieu Hausman, J. Dancot, B. Petre, M. Guillaume, P. Detroz","doi":"10.1080/02602938.2022.2130168","DOIUrl":"https://doi.org/10.1080/02602938.2022.2130168","url":null,"abstract":"Abstract Previous studies on the factors that can affect self-esteem and clinical skills during training among bachelor’s-level nursing students in Belgium have shown that internships – and evaluation and feedback moments, more specifically – were key points in that process. We did a study to better understand how students experience those moments and which specific aspects of feedback are involved. This article focuses on how feedback is experienced and on the consequences of that in terms of learning. Here we identify the aspects of feedback that can result in positive or negative experiences, with different implications for learning. Our findings highlight the key role that – along with valence – the focus and tone of feedback plays. In addition, students’ lived experience can heighten or dampen their motivation to act on feedback and affect how they regulate their learning behavior when feedback is experienced either positively or negatively. Generally speaking, students show resistance or rejection when feedback is experienced negatively. While these results are consistent with other studies, further research is needed to explore the emotional process at work in feedback processing.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"777 - 789"},"PeriodicalIF":4.4,"publicationDate":"2022-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48298156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Are men and women really different? The effects of gender and training on peer scoring and perceptions of peer assessment 男人和女人真的不同吗?性别和培训对同伴评分和对同伴评估的看法的影响
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-10-10 DOI: 10.1080/02602938.2022.2130167
J. C. Ocampo, E. Panadero, Fernando Díez
Abstract A number of studies have expressed that gender might be a source of difference and bias in peer assessment activities. However, evidence supporting this remains mixed and scant. The present study examined gender difference and accuracy bias between men and women assessors’ peer scoring of same-sex or opposite-sex writing samples using a quasi-experimental approach in which we implemented peer assessment training to explore if it could minimise gender difference and bias. Additionally, we also explored the effects on participants’ perceptions of trust and comfort in giving peer scores. A total of 145 (men = 25) psychology students enrolled in four separate courses participated in this study. Two of the classes received peer assessment training, while the other two only received task instructions. Participants were divided into eight scoring subgroups where they peer scored three writing samples of varying quality (poor, average and excellent) using a scoring rubric in Eduflow. We found that, regardless of their training condition, men and women assessors did not differ in their peer scores of men and women peers. Only untrained men assessors showed less trust in their abilities and discomfort when peer scoring women assessees’ writing samples.
许多研究表明,性别可能是同行评议活动中差异和偏见的一个来源。然而,支持这一观点的证据仍然缺乏。本研究采用准实验的方法,考察了男性和女性评估员对同性或异性写作样本的同伴评分的性别差异和准确性偏差,其中我们实施了同伴评估培训,以探索是否可以最大限度地减少性别差异和偏差。此外,我们还探讨了在给予同伴分数时对参与者的信任和舒适感知的影响。共有145名(男性= 25)心理学专业的学生参加了这项研究。其中两个班接受了同行评估培训,而另外两个班只接受了任务指导。参与者被分成八个评分小组,他们的同伴使用Eduflow的评分标准对三个不同质量的写作样本(差,一般和优秀)进行评分。我们发现,无论他们的培训条件如何,男性和女性评估者在男性和女性同龄人的同龄人得分上没有差异。只有未经训练的男性评估者对自己的能力表现出较低的信任度,而当同行评估者的女性评估者的写作样本时,他们表现出不安。
{"title":"Are men and women really different? The effects of gender and training on peer scoring and perceptions of peer assessment","authors":"J. C. Ocampo, E. Panadero, Fernando Díez","doi":"10.1080/02602938.2022.2130167","DOIUrl":"https://doi.org/10.1080/02602938.2022.2130167","url":null,"abstract":"Abstract A number of studies have expressed that gender might be a source of difference and bias in peer assessment activities. However, evidence supporting this remains mixed and scant. The present study examined gender difference and accuracy bias between men and women assessors’ peer scoring of same-sex or opposite-sex writing samples using a quasi-experimental approach in which we implemented peer assessment training to explore if it could minimise gender difference and bias. Additionally, we also explored the effects on participants’ perceptions of trust and comfort in giving peer scores. A total of 145 (men = 25) psychology students enrolled in four separate courses participated in this study. Two of the classes received peer assessment training, while the other two only received task instructions. Participants were divided into eight scoring subgroups where they peer scored three writing samples of varying quality (poor, average and excellent) using a scoring rubric in Eduflow. We found that, regardless of their training condition, men and women assessors did not differ in their peer scores of men and women peers. Only untrained men assessors showed less trust in their abilities and discomfort when peer scoring women assessees’ writing samples.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"760 - 776"},"PeriodicalIF":4.4,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"59373329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
We cannot agree to disagree: ensuring consistency, transparency and fairness across bachelor thesis writing, supervision and evaluation 我们不能同意不同意见:确保学士论文写作、监督和评估的一致性、透明度和公平性
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-28 DOI: 10.1080/02602938.2022.2125931
Riina Koris, Rauno Pello
Abstract Writing, supervision and evaluation of students’ dissertations has received a fair share of attention in academic literature, with a focus on problems of marking, information processing mechanisms, worldviews and more. In most texts, problems of inconsistency, transparency and fairness are identified, leading to frustration among supervisors, assessors and students. This article shares positive experience on the creation and application of an instrument which would benefit educators and contribute practical solutions on how the issues of inconsistency, transparency and fairness within the bachelor thesis process could be tackled. Using design science research, which utilizes gained knowledge to solve problems, create change or improve existing solutions, we developed the bachelor thesis writing and assessing instrument. Following three iterations of the instrument among writers, supervisors and assessors of bachelor theses at the Estonian Business School, we conclude that the use of the instrument has greatly improved consistency, transparency and fairness of the thesis-process, thus benefitting all three parties in particular and the university in general.
摘要学生学位论文的撰写、监督和评估在学术文献中受到了相当多的关注,重点关注评分、信息处理机制、世界观等问题。在大多数文本中,都发现了不一致、透明和公平的问题,导致主管、评估员和学生感到沮丧。本文分享了创建和应用一种工具的积极经验,该工具将使教育工作者受益,并为如何解决学士学位论文过程中的不一致、透明和公平问题提供切实可行的解决方案。利用设计科学研究,利用所获得的知识来解决问题、创造改变或改进现有的解决方案,我们开发了学士论文写作和评估工具。在爱沙尼亚商学院学士论文的作者、导师和评审员对该工具进行了三次迭代后,我们得出结论,该工具的使用极大地提高了论文过程的一致性、透明度和公平性,从而使三方和整个大学都受益。
{"title":"We cannot agree to disagree: ensuring consistency, transparency and fairness across bachelor thesis writing, supervision and evaluation","authors":"Riina Koris, Rauno Pello","doi":"10.1080/02602938.2022.2125931","DOIUrl":"https://doi.org/10.1080/02602938.2022.2125931","url":null,"abstract":"Abstract Writing, supervision and evaluation of students’ dissertations has received a fair share of attention in academic literature, with a focus on problems of marking, information processing mechanisms, worldviews and more. In most texts, problems of inconsistency, transparency and fairness are identified, leading to frustration among supervisors, assessors and students. This article shares positive experience on the creation and application of an instrument which would benefit educators and contribute practical solutions on how the issues of inconsistency, transparency and fairness within the bachelor thesis process could be tackled. Using design science research, which utilizes gained knowledge to solve problems, create change or improve existing solutions, we developed the bachelor thesis writing and assessing instrument. Following three iterations of the instrument among writers, supervisors and assessors of bachelor theses at the Estonian Business School, we conclude that the use of the instrument has greatly improved consistency, transparency and fairness of the thesis-process, thus benefitting all three parties in particular and the university in general.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"736 - 747"},"PeriodicalIF":4.4,"publicationDate":"2022-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41781929","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Playing the SET game: how teachers view the impact of student evaluation on the experience of teaching and learning 玩SET游戏:教师如何看待学生评价对教学体验的影响
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-25 DOI: 10.1080/02602938.2022.2126430
R. Lakeman, R. Coutts, M. Hutchinson, D. Massey, Dima Nasrawi, Jann Fielden, Megan Lee
Abstract Student evaluation of teaching (SET) has become a ubiquitous feature of higher education. The attainment and maintenance of positive SET is essential for most teaching staff to obtain and maintain tenure. It is not uncommon for teachers to receive offensive and non-constructive commentary unrelated to teaching quality. Regular exposure to SET contributes to stress and adversely impacts mental health and well-being. We surveyed Australian teaching academics in 2021, and in this paper, we explore the perceived impacts of SET on the teaching and learning experience, academic standards and quality. Many respondents perceived that SET contributes to an erosion of standards and inflation of grades. A thematic analysis of open-ended questions revealed potential mechanisms for these impacts. These include enabling a culture of incivility, elevating stress and anxiety in teaching staff, and pressure to change approaches to teaching and assessment to achieve the highest scores. Playing the SET game involves balancing a commitment to quality and standards with concessions to ensure optimal student satisfaction. Anonymous SET is overvalued, erodes standards and contributes to incivility. The process of SET needs urgent reform.
摘要学生教学评价(SET)已成为高等教育的一个普遍特征。获得和保持积极的SET对大多数教职员工获得和保持终身教职至关重要。教师收到与教学质量无关的攻击性和非建设性评论并不罕见。经常接触SET会造成压力,并对心理健康和幸福产生不利影响。我们在2021年调查了澳大利亚的教学学者,在本文中,我们探讨了SET对教学体验、学术标准和质量的感知影响。许多受访者认为SET导致了标准的下降和成绩的膨胀。对开放式问题的专题分析揭示了这些影响的潜在机制。这些措施包括营造一种不文明的文化,增加教职员工的压力和焦虑,以及改变教学和评估方法以获得最高分数的压力。玩SET游戏需要在对质量和标准的承诺与让步之间取得平衡,以确保学生的最佳满意度。匿名SET被高估,破坏了标准,助长了不文明行为。SET进程急需改革。
{"title":"Playing the SET game: how teachers view the impact of student evaluation on the experience of teaching and learning","authors":"R. Lakeman, R. Coutts, M. Hutchinson, D. Massey, Dima Nasrawi, Jann Fielden, Megan Lee","doi":"10.1080/02602938.2022.2126430","DOIUrl":"https://doi.org/10.1080/02602938.2022.2126430","url":null,"abstract":"Abstract Student evaluation of teaching (SET) has become a ubiquitous feature of higher education. The attainment and maintenance of positive SET is essential for most teaching staff to obtain and maintain tenure. It is not uncommon for teachers to receive offensive and non-constructive commentary unrelated to teaching quality. Regular exposure to SET contributes to stress and adversely impacts mental health and well-being. We surveyed Australian teaching academics in 2021, and in this paper, we explore the perceived impacts of SET on the teaching and learning experience, academic standards and quality. Many respondents perceived that SET contributes to an erosion of standards and inflation of grades. A thematic analysis of open-ended questions revealed potential mechanisms for these impacts. These include enabling a culture of incivility, elevating stress and anxiety in teaching staff, and pressure to change approaches to teaching and assessment to achieve the highest scores. Playing the SET game involves balancing a commitment to quality and standards with concessions to ensure optimal student satisfaction. Anonymous SET is overvalued, erodes standards and contributes to incivility. The process of SET needs urgent reform.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"749 - 759"},"PeriodicalIF":4.4,"publicationDate":"2022-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41672336","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
How does grade inflation affect student evaluation of teaching? 分数膨胀如何影响学生对教学的评价?
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-25 DOI: 10.1080/02602938.2022.2126429
Byung-Ryun Park, Joonmo Cho
Abstract Student evaluation of teaching (SET) is important for assessing university instructors’ performance. However, this system seems biased as students’ grade expectations result in rewards or penalties in SET. As a fair evaluation of grades became difficult during the COVID-19 pandemic, universities implemented a relaxed grade policy that expanded the distribution of high grades. This grade inflation altered students’ expected grade. Through empirical analysis, this study examined the change in the relationship between bias and SET due to grade inflation. A top-ranking South Korean university provided 125,003 cases of SET data in 2019 and 2020 for the analysis. Grade inflation diminished the biasing effect on SET, mainly in terms of reward. Furthermore, the group with the lowest grade point average (GPA) showed the highest decrease in rewards, and the group with the highest GPA showed maximum decrease in punishment. This finding implies that a change in expected grades due to factors other than lectures may alter students’ attitudes toward SET, and grade expectations may play a key role in reducing bias in SET.
摘要学生教学评价是评价高校教师工作绩效的重要手段。然而,这种制度似乎有偏见,因为学生对成绩的期望导致了SET的奖励或惩罚。在新冠肺炎疫情期间,由于难以公平评价成绩,各大学实施了放宽成绩政策,扩大了高分的分配。这种分数膨胀改变了学生的预期分数。通过实证分析,本研究考察了分数膨胀对偏差与SET关系的影响。韩国一所顶尖大学在2019年和2020年提供了125003例SET数据用于分析。分数膨胀减少了对SET的偏倚效应,主要是在奖励方面。此外,平均绩点(GPA)最低的一组奖励减少幅度最大,而GPA最高的一组惩罚减少幅度最大。这一发现表明,由于讲课以外的因素而导致的期望成绩的变化可能会改变学生对SET的态度,并且期望成绩可能在减少SET偏见方面发挥关键作用。
{"title":"How does grade inflation affect student evaluation of teaching?","authors":"Byung-Ryun Park, Joonmo Cho","doi":"10.1080/02602938.2022.2126429","DOIUrl":"https://doi.org/10.1080/02602938.2022.2126429","url":null,"abstract":"Abstract Student evaluation of teaching (SET) is important for assessing university instructors’ performance. However, this system seems biased as students’ grade expectations result in rewards or penalties in SET. As a fair evaluation of grades became difficult during the COVID-19 pandemic, universities implemented a relaxed grade policy that expanded the distribution of high grades. This grade inflation altered students’ expected grade. Through empirical analysis, this study examined the change in the relationship between bias and SET due to grade inflation. A top-ranking South Korean university provided 125,003 cases of SET data in 2019 and 2020 for the analysis. Grade inflation diminished the biasing effect on SET, mainly in terms of reward. Furthermore, the group with the lowest grade point average (GPA) showed the highest decrease in rewards, and the group with the highest GPA showed maximum decrease in punishment. This finding implies that a change in expected grades due to factors other than lectures may alter students’ attitudes toward SET, and grade expectations may play a key role in reducing bias in SET.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"723 - 735"},"PeriodicalIF":4.4,"publicationDate":"2022-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"59373321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Assessors’ perspectives of an oral assessment within a teaching performance assessment 评核员对教学表现评估中口头评核的看法
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-15 DOI: 10.1080/02602938.2022.2122930
Julia Mascadri, Nerida Spina, Rebecca Spooner-Lane, Elizabeth Briant
Abstract Australia has recently implemented Teaching Performance Assessments (TPAs) as a national accreditation requirement to assess final year preservice teachers’ classroom readiness. In 2019, an Australian university developed a TPA to meet this requirement, comprising three written components and one oral component. This exploratory study investigated 18 TPA assessors’ perceptions of the oral component. Focus group data revealed that both explicit and latent assessment criteria influenced assessors’ professional judgments of the oral component. A discourse competence framework was used to analyse the data, illustrating how preservice teachers’ personal experience and their professional and institutional discourse competence are evident in their orals. Thematic analysis revealed that benefits and issues of fairness and equity contributed to assessors’ perspectives about the value of the oral component.
摘要澳大利亚最近实施了教学绩效评估(TPA),作为评估最后一年职前教师课堂准备情况的国家认证要求。2019年,澳大利亚一所大学制定了一项TPA来满足这一要求,包括三个书面部分和一个口头部分。这项探索性研究调查了18名TPA评估员对口腔成分的感知。焦点小组数据显示,显性和隐性评估标准都会影响评估员对口语部分的专业判断。使用话语能力框架对数据进行分析,说明职前教师的个人经历以及他们的专业和机构话语能力是如何在他们的口语中表现出来的。专题分析显示,公平和公正的好处和问题有助于评估员对口头部分价值的看法。
{"title":"Assessors’ perspectives of an oral assessment within a teaching performance assessment","authors":"Julia Mascadri, Nerida Spina, Rebecca Spooner-Lane, Elizabeth Briant","doi":"10.1080/02602938.2022.2122930","DOIUrl":"https://doi.org/10.1080/02602938.2022.2122930","url":null,"abstract":"Abstract Australia has recently implemented Teaching Performance Assessments (TPAs) as a national accreditation requirement to assess final year preservice teachers’ classroom readiness. In 2019, an Australian university developed a TPA to meet this requirement, comprising three written components and one oral component. This exploratory study investigated 18 TPA assessors’ perceptions of the oral component. Focus group data revealed that both explicit and latent assessment criteria influenced assessors’ professional judgments of the oral component. A discourse competence framework was used to analyse the data, illustrating how preservice teachers’ personal experience and their professional and institutional discourse competence are evident in their orals. Thematic analysis revealed that benefits and issues of fairness and equity contributed to assessors’ perspectives about the value of the oral component.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"613 - 626"},"PeriodicalIF":4.4,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45960829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The end of the line? A quantitative analysis of two decades of competitive assessment and research funding in UK higher education 到终点了吗?二十年来英国高等教育竞争性评估和研究经费的定量分析
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-09 DOI: 10.1080/02602938.2022.2120961
A. Kelly
Abstract The Research Excellence Framework is a high-stakes exercise used by the UK government to allocate billions of pounds of quality-related research (QR) funding and used by the media to rank universities and their departments in national league tables. The 2008, 2014 and 2021 assessments were zero-sum games in terms of league table position because the outcomes were captured as Grade Point Averages (GPA) on a ratio scale, unlike the 1996 and 2001 iterations when departments were ranked on a simple seven-point ordinal scale. Although league tables were never part of the assessment itself, they were inevitable in 2008, 2014 and 2021 given the nature of the scoring, and subsequent league table position had a significant effect on investment and disinvestment within universities. This paper uses data from the 2008, 2014 and 2021 assessments to look at the changing competitiveness of different subjects, the size of submissions, and how these are related to QR funding. It finds that competition in the UK research sector is exceptionally tough, but that competitiveness and QR funding are so closely related to submission size that it calls into question the benefit of carrying out any more assessment exercises in their current format.
摘要卓越研究框架是一项高风险的活动,由英国政府用于分配数十亿英镑的质量相关研究(QR)资金,并由媒体用于在国家排行榜中对大学及其部门进行排名。就排行榜位置而言,2008年、2014年和2021年的评估是零和游戏,因为结果在比例量表上被记录为平均绩点(GPA),而不是1996年和2001年的迭代,当时各部门在简单的7分顺序量表上排名。尽管排行榜从来不是评估本身的一部分,但考虑到评分的性质,它们在2008年、2014年和2021年是不可避免的,随后的排行榜位置对大学内部的投资和撤资产生了重大影响。本文使用2008年、2014年和2021年评估的数据来研究不同科目不断变化的竞争力、提交材料的规模,以及这些与QR资金的关系。它发现,英国研究部门的竞争异常激烈,但竞争力和QR资金与提交规模密切相关,这让人们对以目前的形式进行更多评估的好处产生了疑问。
{"title":"The end of the line? A quantitative analysis of two decades of competitive assessment and research funding in UK higher education","authors":"A. Kelly","doi":"10.1080/02602938.2022.2120961","DOIUrl":"https://doi.org/10.1080/02602938.2022.2120961","url":null,"abstract":"Abstract The Research Excellence Framework is a high-stakes exercise used by the UK government to allocate billions of pounds of quality-related research (QR) funding and used by the media to rank universities and their departments in national league tables. The 2008, 2014 and 2021 assessments were zero-sum games in terms of league table position because the outcomes were captured as Grade Point Averages (GPA) on a ratio scale, unlike the 1996 and 2001 iterations when departments were ranked on a simple seven-point ordinal scale. Although league tables were never part of the assessment itself, they were inevitable in 2008, 2014 and 2021 given the nature of the scoring, and subsequent league table position had a significant effect on investment and disinvestment within universities. This paper uses data from the 2008, 2014 and 2021 assessments to look at the changing competitiveness of different subjects, the size of submissions, and how these are related to QR funding. It finds that competition in the UK research sector is exceptionally tough, but that competitiveness and QR funding are so closely related to submission size that it calls into question the benefit of carrying out any more assessment exercises in their current format.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"701 - 722"},"PeriodicalIF":4.4,"publicationDate":"2022-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47381200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
What do college students think of feedback literacy? An ecological interpretation of Hong Kong students’ perspectives 大学生如何看待反馈素养?香港学生观点的生态诠释
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-08 DOI: 10.1080/02602938.2022.2121380
Y. Zhan
Abstract Recent discussions on student feedback literacy have been primarily conceptual and framed from the perspectives of scholars and educators. Few empirical studies have explored what and how college students conceive of student feedback literacy. To address this research gap, we explored Hong Kong college students’ conceptions of student feedback literacy. Fifteen Bachelor of Education students were individually interviewed to elaborate on the mind maps they had drawn about student feedback literacy. The data analysis revealed that the participants depicted several feedback competencies required for students to elicit and process feedback but paid scant attention to the competencies needed to enact feedback. Meanwhile, they believed that a feedback-literate student should appreciate the values of feedback and be active, modest and committed in the feedback process. The participants’ conceptions of student feedback literacy were ecologically influenced by Chinese cultural values, the university learning setting, their prior feedback experiences, and course learning.
最近关于学生反馈素养的讨论主要是概念性的,并从学者和教育者的角度进行了框架。很少有实证研究探讨大学生对学生反馈素养的看法和方式。为了弥补这一研究空白,我们探讨了香港大学生对学生反馈素养的概念。15名教育学学士学生被单独采访,详细阐述他们所绘制的关于学生反馈素养的思维导图。数据分析显示,参与者描述了学生引出和处理反馈所需的几种反馈能力,但很少关注制定反馈所需的能力。同时,他们认为一个有反馈素养的学生应该欣赏反馈的价值,并在反馈过程中积极、谦虚和投入。被试对学生反馈素养的概念受到中国文化价值观、大学学习环境、他们先前的反馈经验和课程学习的生态影响。
{"title":"What do college students think of feedback literacy? An ecological interpretation of Hong Kong students’ perspectives","authors":"Y. Zhan","doi":"10.1080/02602938.2022.2121380","DOIUrl":"https://doi.org/10.1080/02602938.2022.2121380","url":null,"abstract":"Abstract Recent discussions on student feedback literacy have been primarily conceptual and framed from the perspectives of scholars and educators. Few empirical studies have explored what and how college students conceive of student feedback literacy. To address this research gap, we explored Hong Kong college students’ conceptions of student feedback literacy. Fifteen Bachelor of Education students were individually interviewed to elaborate on the mind maps they had drawn about student feedback literacy. The data analysis revealed that the participants depicted several feedback competencies required for students to elicit and process feedback but paid scant attention to the competencies needed to enact feedback. Meanwhile, they believed that a feedback-literate student should appreciate the values of feedback and be active, modest and committed in the feedback process. The participants’ conceptions of student feedback literacy were ecologically influenced by Chinese cultural values, the university learning setting, their prior feedback experiences, and course learning.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"686 - 700"},"PeriodicalIF":4.4,"publicationDate":"2022-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"59373314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Psychometric properties of the academic procrastination scale in Spanish university students 西班牙大学生学业拖延量表的心理测量特征
IF 4.4 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-09-05 DOI: 10.1080/02602938.2022.2117791
L. Martín-Antón, Leandro S. Almedia, M. Sáiz-Manzanares, Marta Álvarez‐Cañizo, M. Carbonero
Abstract Procrastination in academic activities is common amongst university students, and has negative consequences for their personal as well as academic development. As a result, there is a need for valid –yet at the same time brief and clear-cut– measurement tools that enable the specific procrastinating behaviour of university students to be measured. This work explores in depth the psychometric properties of the Spanish version of the Academic Procrastination Scale, a widely used brief tool in secondary and higher education in the Spanish speaking world. The scale was applied to a total of 1734 university students, together with the Procrastination Assessment Scale-Students (PASS), the Unintentional Procrastination Scale (UPS) and the Active Procrastination Scale (APS). Factor analyses indicate the best fit is a structure involving four interrelated factors (task aversion, poor time management, low emotional and motivational self-control, and risk assumption) compared to other proposed models. The model presents factorial invariance between men and women, and adequate convergent validity. We discuss the implications of using this scale in higher education, since differentiating the four factors might help to identify different support measures depending on university student needs.
摘要在大学生中,学习拖延症是一种普遍现象,它对大学生的个人发展和学业发展都产生了负面影响。因此,我们需要一种有效的——同时又简洁明了的——测量工具来测量大学生的特定拖延行为。这项工作深入探讨了西班牙语版学业拖延量表的心理测量特性,这是一种在西班牙语世界的中学和高等教育中广泛使用的简短工具。本量表与学生拖延量表(PASS)、无意识拖延量表(UPS)和主动拖延量表(APS)一起应用于1734名大学生。因子分析表明,与其他提出的模型相比,最适合的结构涉及四个相互关联的因素(任务厌恶、时间管理不良、情绪和动机自我控制低下以及风险假设)。该模型在男女之间表现出因子不变性,具有足够的收敛效度。我们讨论了在高等教育中使用该量表的含义,因为区分这四个因素可能有助于根据大学生的需求确定不同的支持措施。
{"title":"Psychometric properties of the academic procrastination scale in Spanish university students","authors":"L. Martín-Antón, Leandro S. Almedia, M. Sáiz-Manzanares, Marta Álvarez‐Cañizo, M. Carbonero","doi":"10.1080/02602938.2022.2117791","DOIUrl":"https://doi.org/10.1080/02602938.2022.2117791","url":null,"abstract":"Abstract Procrastination in academic activities is common amongst university students, and has negative consequences for their personal as well as academic development. As a result, there is a need for valid –yet at the same time brief and clear-cut– measurement tools that enable the specific procrastinating behaviour of university students to be measured. This work explores in depth the psychometric properties of the Spanish version of the Academic Procrastination Scale, a widely used brief tool in secondary and higher education in the Spanish speaking world. The scale was applied to a total of 1734 university students, together with the Procrastination Assessment Scale-Students (PASS), the Unintentional Procrastination Scale (UPS) and the Active Procrastination Scale (APS). Factor analyses indicate the best fit is a structure involving four interrelated factors (task aversion, poor time management, low emotional and motivational self-control, and risk assumption) compared to other proposed models. The model presents factorial invariance between men and women, and adequate convergent validity. We discuss the implications of using this scale in higher education, since differentiating the four factors might help to identify different support measures depending on university student needs.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"642 - 656"},"PeriodicalIF":4.4,"publicationDate":"2022-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48229762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Assessment & Evaluation in Higher Education
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1