首页 > 最新文献

Assessment in Education-Principles Policy & Practice最新文献

英文 中文
The power of positive emotions? The link between young people’s positive and negative affect and performance in high-stakes examinations 积极情绪的力量?年轻人的积极和消极情绪与高风险考试成绩之间的联系
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-04-27 DOI: 10.1080/0969594X.2022.2054941
John Jerrim
ABSTRACT A substantial body of research suggests that young people’s emotions – both positive and negative – are linked to a wide range of future outcomes. This paper contributes to this literature by investigating the link between young people’s positive and negative emotions and their performance in high-stakes examinations. Using Programme for International Student Assessment (PISA) data from England linked to the National Pupil Database (NPD), I investigate how 15-year-olds positive affect, negative affect and fear of failure is associated with the grades they achieve in high-stakes examinations. I find that low levels of positive affect – i.e. pupils rarely feeling happy, lively and cheerful – is associated with a 0.10–0.15 standard deviation reduction in young people’s examination grades. On the other hand, little evidence is found of a substantive link between negative affect or fear of failure and examination performance.
大量研究表明,年轻人的情绪——无论是积极的还是消极的——都与未来的各种结果有关。本文通过调查年轻人的积极和消极情绪与他们在高风险考试中的表现之间的联系,为这一文献做出贡献。利用英国国际学生评估项目(PISA)与国家学生数据库(NPD)相关联的数据,我调查了15岁学生的积极情绪、消极情绪和对失败的恐惧与他们在高风险考试中取得的成绩之间的关系。我发现,低水平的积极影响——即学生很少感到快乐、活泼和愉快——与年轻人考试成绩降低0.10-0.15个标准差有关。另一方面,几乎没有证据表明消极情绪或害怕失败与考试成绩之间存在实质性联系。
{"title":"The power of positive emotions? The link between young people’s positive and negative affect and performance in high-stakes examinations","authors":"John Jerrim","doi":"10.1080/0969594X.2022.2054941","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2054941","url":null,"abstract":"ABSTRACT A substantial body of research suggests that young people’s emotions – both positive and negative – are linked to a wide range of future outcomes. This paper contributes to this literature by investigating the link between young people’s positive and negative emotions and their performance in high-stakes examinations. Using Programme for International Student Assessment (PISA) data from England linked to the National Pupil Database (NPD), I investigate how 15-year-olds positive affect, negative affect and fear of failure is associated with the grades they achieve in high-stakes examinations. I find that low levels of positive affect – i.e. pupils rarely feeling happy, lively and cheerful – is associated with a 0.10–0.15 standard deviation reduction in young people’s examination grades. On the other hand, little evidence is found of a substantive link between negative affect or fear of failure and examination performance.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"80 1","pages":"310 - 331"},"PeriodicalIF":3.2,"publicationDate":"2022-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85686993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Changes in classroom assessment practices during emergency remote teaching due to COVID-19 新冠肺炎疫情下应急远程教学课堂评估实践的变化
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-04-24 DOI: 10.1080/0969594X.2022.2067123
E. Panadero, J. Fraile, Leire Pinedo, C. Rodríguez-Hernández, Fernando Díez
ABSTRACT This study explores the effects of the shift to emergency remote teaching on assessment practices due to COVID-19 lockdown. A total of 936 Spanish teachers from all educational levels ranging from early childhood to university participated in this nationwide survey. Four aspects were explored: (1) changes in the use of assessment instruments (e.g. exams); (2) changes in assessment criteria, standards and grading; (3) changes in the delivery of feedback and use of rubrics; and (4) changes in students’ involvement in assessment (i.e. self- and peer assessment). In general, results are mixed, with some areas undergoing certain changes with the aim of adapting to the new situation (e.g. primary education teachers lowering their grading standards), whereas many other assessment practices have remained similar, especially among higher education teachers. Unfortunately, some of the assessment practices have worsened, such as students’ involvement in assessment which has decreased.
摘要:本研究探讨了由于COVID-19封锁而转向紧急远程教学对评估实践的影响。共有936名西班牙语教师参加了这项全国性的调查,他们来自从幼儿到大学的各个教育层次。从四个方面进行了探讨:(1)评估工具(如考试)使用的变化;(二)考核标准、标准、等级的变化;(三)反馈方式和使用方式的变化;(4)学生参与评估(即自我评估和同伴评估)的变化。总体而言,结果好坏参半,有些领域为适应新形势而发生了某些变化(例如,小学教师降低了评分标准),而其他许多评估做法保持不变,特别是在高等教育教师中。不幸的是,一些评估实践已经恶化,例如学生参与评估的情况有所下降。
{"title":"Changes in classroom assessment practices during emergency remote teaching due to COVID-19","authors":"E. Panadero, J. Fraile, Leire Pinedo, C. Rodríguez-Hernández, Fernando Díez","doi":"10.1080/0969594X.2022.2067123","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2067123","url":null,"abstract":"ABSTRACT This study explores the effects of the shift to emergency remote teaching on assessment practices due to COVID-19 lockdown. A total of 936 Spanish teachers from all educational levels ranging from early childhood to university participated in this nationwide survey. Four aspects were explored: (1) changes in the use of assessment instruments (e.g. exams); (2) changes in assessment criteria, standards and grading; (3) changes in the delivery of feedback and use of rubrics; and (4) changes in students’ involvement in assessment (i.e. self- and peer assessment). In general, results are mixed, with some areas undergoing certain changes with the aim of adapting to the new situation (e.g. primary education teachers lowering their grading standards), whereas many other assessment practices have remained similar, especially among higher education teachers. Unfortunately, some of the assessment practices have worsened, such as students’ involvement in assessment which has decreased.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"95 1","pages":"361 - 382"},"PeriodicalIF":3.2,"publicationDate":"2022-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73106590","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
Emergency assessment: rethinking classroom practices and priorities amid remote teaching 紧急评估:重新思考远程教学中的课堂实践和优先事项
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-04-24 DOI: 10.1080/0969594X.2022.2069084
Amanda Cooper, Christopher DeLuca, M. Holden, Stephen MacGregor
ABSTRACT Systemic disruptions from COVID-19 have transformed the assessment landscape in Canada and across the world. Alongside repeated shifts to emergency remote teaching, large-scale assessments and summative evaluations were cancelled in many jurisdictions, and repeated concerns were raised about ensuring equity and access to quality education. This paper investigates the rapid – and in many cases innovative – responses teachers offered to these challenges at the height of the pandemic. Drawing on prolonged semi-structured interviews with 17 secondary school teachers in Ontario, Canada, the paper provides a detailed account of Ontario’s approach to assessment during COVID-19, exemplified by participants’ lived experiences. Results highlight the notion of emergency remote assessment, the vital role of assessment in stemming widening equity and well-being gaps, and emerging consequences from this period. These data offer critical insights into the future of our forever-changed education landscape, and position classroom assessment as a priority player in this work.
2019冠状病毒病造成的系统性破坏改变了加拿大和世界各地的评估格局。除了一再转向紧急远程教学外,许多司法管辖区还取消了大规模评估和总结性评价,并一再对确保公平和获得优质教育表示关切。本文调查了教师们在疫情最严重的时候对这些挑战作出的快速反应——在许多情况下是创新的反应。本文通过对加拿大安大略省17名中学教师的长时间半结构化访谈,详细介绍了安大略省在2019冠状病毒病期间的评估方法,并以参与者的亲身经历为例。结果强调了紧急远程评估的概念、评估在遏制不断扩大的公平和福祉差距方面的重要作用以及这一时期出现的新后果。这些数据为我们永远改变的教育格局的未来提供了重要的见解,并将课堂评估定位为这项工作的优先参与者。
{"title":"Emergency assessment: rethinking classroom practices and priorities amid remote teaching","authors":"Amanda Cooper, Christopher DeLuca, M. Holden, Stephen MacGregor","doi":"10.1080/0969594X.2022.2069084","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2069084","url":null,"abstract":"ABSTRACT Systemic disruptions from COVID-19 have transformed the assessment landscape in Canada and across the world. Alongside repeated shifts to emergency remote teaching, large-scale assessments and summative evaluations were cancelled in many jurisdictions, and repeated concerns were raised about ensuring equity and access to quality education. This paper investigates the rapid – and in many cases innovative – responses teachers offered to these challenges at the height of the pandemic. Drawing on prolonged semi-structured interviews with 17 secondary school teachers in Ontario, Canada, the paper provides a detailed account of Ontario’s approach to assessment during COVID-19, exemplified by participants’ lived experiences. Results highlight the notion of emergency remote assessment, the vital role of assessment in stemming widening equity and well-being gaps, and emerging consequences from this period. These data offer critical insights into the future of our forever-changed education landscape, and position classroom assessment as a priority player in this work.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"240 1","pages":"534 - 554"},"PeriodicalIF":3.2,"publicationDate":"2022-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73173276","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Fair high-stakes assessment in the long shadow of Covid-19 在Covid-19的长期阴影下进行公平的高风险评估
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-04-19 DOI: 10.1080/0969594X.2022.2067834
I. Nisbet, Stuart Shaw
ABSTRACT Fairness in assessment has become increasingly topical and controversial in recent years. Assessment theoreticians are writing more about fairness and assessment practitioners have developed processes and good practice to minimise unfairness. There is also increased scrutiny by students, parents and the wider public – not only of the fairness of assessments themselves and their outcomes, but of their use, notably for selection for college or university. This is in a context of continued awareness of inequalities in society and their impact on education and assessment. And on top of all these questions has been the impact – and the continuing long shadow – of Covid. Can there be fair assessment in such an unfair world? We consider three types of challenge to fair assessment: •Theoretical challenges •Challenges from thinking about social justice •Challenges from the way that statistics were used to award assessment outcomes in 2020 (particularly in England)
近年来,评估公平性问题日益成为热门话题和争议话题。评估理论家正在撰写更多关于公平的文章,评估从业者已经制定了将不公平最小化的流程和良好实践。学生、家长和更广泛的公众也加强了对评估本身及其结果的公正性的审查,而且还审查了评估的用途,特别是在选择学院或大学时。这是在继续认识到社会不平等及其对教育和评价的影响的背景下进行的。在所有这些问题之上,还有新冠疫情的影响和持续的长期阴影。在这样一个不公平的世界里,还有公平的评估吗?我们考虑了对公平评估的三种挑战:•理论挑战•来自社会正义思考的挑战•来自统计数据用于奖励2020年评估结果的方式的挑战(特别是在英格兰)
{"title":"Fair high-stakes assessment in the long shadow of Covid-19","authors":"I. Nisbet, Stuart Shaw","doi":"10.1080/0969594X.2022.2067834","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2067834","url":null,"abstract":"ABSTRACT Fairness in assessment has become increasingly topical and controversial in recent years. Assessment theoreticians are writing more about fairness and assessment practitioners have developed processes and good practice to minimise unfairness. There is also increased scrutiny by students, parents and the wider public – not only of the fairness of assessments themselves and their outcomes, but of their use, notably for selection for college or university. This is in a context of continued awareness of inequalities in society and their impact on education and assessment. And on top of all these questions has been the impact – and the continuing long shadow – of Covid. Can there be fair assessment in such an unfair world? We consider three types of challenge to fair assessment: •Theoretical challenges •Challenges from thinking about social justice •Challenges from the way that statistics were used to award assessment outcomes in 2020 (particularly in England)","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"80 1","pages":"518 - 533"},"PeriodicalIF":3.2,"publicationDate":"2022-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84112471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Validity evidence for a formative writing engagement assessment in elementary grades 小学形成性写作投入评估的效度证据
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-03-04 DOI: 10.1080/0969594X.2022.2054942
Paul M. Rogers, Jonathan Marine, Samantha T. Ives, Seth A. Parsons, Ashlee Horton, Chase Young
ABSTRACT This article reports on the implementation of a formative assessment tool (the Writing Engagement Scale, or WES) in grades 3–5 in schools in the United States. We used confirmatory factor analysis (CFA) to collect validity evidence for the WES for our population. Results demonstrated acceptable validity and reliability. In addition, survey results indicated that teachers perceived the WES to be useful as a formative writing assessment. We make the case that the WES provides an opportunity to inform teachers’ practice and help researchers understand the dimensions of students’ engagement in writing.
摘要:本文报告了美国学校在3-5年级实施形成性评估工具(写作参与量表,WES)的情况。我们使用验证性因子分析(CFA)来收集我们人群WES的效度证据。结果显示可接受的效度和信度。此外,调查结果显示,教师认为WES作为形成性写作评估是有用的。我们认为,WES为教师的实践提供了一个机会,并帮助研究人员了解学生参与写作的各个方面。
{"title":"Validity evidence for a formative writing engagement assessment in elementary grades","authors":"Paul M. Rogers, Jonathan Marine, Samantha T. Ives, Seth A. Parsons, Ashlee Horton, Chase Young","doi":"10.1080/0969594X.2022.2054942","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2054942","url":null,"abstract":"ABSTRACT This article reports on the implementation of a formative assessment tool (the Writing Engagement Scale, or WES) in grades 3–5 in schools in the United States. We used confirmatory factor analysis (CFA) to collect validity evidence for the WES for our population. Results demonstrated acceptable validity and reliability. In addition, survey results indicated that teachers perceived the WES to be useful as a formative writing assessment. We make the case that the WES provides an opportunity to inform teachers’ practice and help researchers understand the dimensions of students’ engagement in writing.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"17 1","pages":"262 - 284"},"PeriodicalIF":3.2,"publicationDate":"2022-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78021923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Formative writing assessment for change – introduction to the special issue 变化的形成性写作评估——特刊简介
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-03-04 DOI: 10.1080/0969594X.2022.2089488
G. B. Skar, Steve Graham, Gert Rijlaarsdam
This current special issue centres on formative writing assessment with children in the elementary grades. Participants in the investigations included in this special issue represent a span from the very youngest students just learning to write to students in fifth and sixth grades who generally have overcome the barriers of knowing how to encode writing, but who face increased demands for producing discursive, audience adapted texts. As editors, we limited papers in the special issue to include studies conducted with students in this grade span because it has been under-researched compared to other grade spans. That these grades have received less attention does not reflect on the importance of early writing instruction; becoming a skilled writer takes time, and the first writing instruction is essential. Becoming a good writer is the result of many complex interactions–including but not limited to–interactions between a writer’s attitude towards writing, her cognitive capacity, the kind of writing instruction she is exposed to, as well as the writer’s perception of textual norms in relation to the reader’s perception of the same norms, and thereby the reader’s textual expectations (Graham, 2018a; Rijlaarsdam et al., 2012; Skar & Aasen, 2021). To help children progress as writers, then, there is a need for tools that can elicit information about students’ writing skills in different domains (e.g. affective, cognitive, textual) and tools that help teachers transform that information into instruction. Such tools are often described as tools for formative assessment. Formative writing assessment has proven to be effective in increasing the writing skills of students. A review by (Graham, 2018b) reported positive effect sizes for text response (d = 0.36), adult feedback (d = 0.87), peer feedback (0.58), self-feedback (d = 0.62) and computerised feedback (d = 0.38). An earlier study by Graham et al. (2011) reported an effect size of d = 1.01 for feedback from adults or peers. So, formative writing assessment can work, and it can lead to positive change. But what is it? Graham (2018b, pp. 145–147) suggested the following definition of formative writing assessment: ‘instructional feedback in writing as information provided by another person, group of people, agency, machine, self, or experience that allows a writer, one learning to write, or a writing teacher/mentor to compare some aspect of performance to an expected, desired, or idealized performance’ and that ‘Formative feedback is derived from assessments that involve collecting information or evidence about student learning, interpreting it in terms of learners’ needs, and using it to alter what happens.’ In other words, formative writing assessment concerns taking actions based on information about a writer’s skills in order to make that writer even more skilled. One might therefore say that formative writing assessment – in the end – is all about consequences. ASSESSMENT IN EDUCATION: PRINCIPLES
本期特刊关注的是小学阶段儿童的形成性写作评估。本期特刊中调查的参与者涵盖了从刚开始学习写作的最年轻的学生到五年级和六年级的学生,这些学生通常已经克服了知道如何编码写作的障碍,但他们对创作话语性的、适合读者的文本的需求越来越大。作为编辑,我们将特刊中的论文限制在包含对这个年级的学生进行的研究,因为与其他年级相比,这个年级的研究不足。这些分数受到的关注较少并不能反映早期写作指导的重要性;成为一个熟练的作家需要时间,第一次写作指导是必不可少的。成为一名优秀的作家是许多复杂互动的结果,包括但不限于作家对写作的态度、她的认知能力、她所接触到的写作指导类型,以及作家对文本规范的感知与读者对同一规范的感知之间的互动,从而影响读者对文本的期望(Graham, 2018a;Rijlaarsdam et al., 2012;Skar & Aasen, 2021)。因此,为了帮助儿童在写作方面取得进步,需要一些工具来引出学生在不同领域(如情感、认知、文本)的写作技能信息,并帮助教师将这些信息转化为教学。这些工具通常被描述为形成性评估的工具。形成性写作评估已被证明对提高学生的写作技能是有效的。(Graham, 2018b)的一篇综述报告了文本回复(d = 0.36)、成人反馈(d = 0.87)、同伴反馈(0.58)、自我反馈(d = 0.62)和计算机反馈(d = 0.38)的积极效应大小。Graham et al.(2011)的早期研究报告了来自成年人或同伴反馈的效应量d = 1.01。因此,形成性写作评估是有效的,它可以带来积极的变化。但它是什么呢?Graham (2018b, pp. 145-147)提出了形成性写作评估的以下定义:“写作中的指教性反馈是由另一个人、一群人、机构、机器、自我或经验提供的信息,它允许作家、一个学习写作的人或写作老师/导师将表现的某些方面与预期的、期望的或理想的表现进行比较”,“形成性反馈来自于收集有关学生学习的信息或证据的评估,并根据学习者的需求进行解释。”用它来改变发生的事情。换句话说,形成性写作评估关注的是基于作者技能的信息采取行动,以使作者更加熟练。因此,有人可能会说,最终形成性写作评估是关于结果的。教育中的评估:原则、政策与实践,2022,第29卷,第2期。2,121 - 126 https://doi.org/10.1080/0969594X.2022.2089488
{"title":"Formative writing assessment for change – introduction to the special issue","authors":"G. B. Skar, Steve Graham, Gert Rijlaarsdam","doi":"10.1080/0969594X.2022.2089488","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2089488","url":null,"abstract":"This current special issue centres on formative writing assessment with children in the elementary grades. Participants in the investigations included in this special issue represent a span from the very youngest students just learning to write to students in fifth and sixth grades who generally have overcome the barriers of knowing how to encode writing, but who face increased demands for producing discursive, audience adapted texts. As editors, we limited papers in the special issue to include studies conducted with students in this grade span because it has been under-researched compared to other grade spans. That these grades have received less attention does not reflect on the importance of early writing instruction; becoming a skilled writer takes time, and the first writing instruction is essential. Becoming a good writer is the result of many complex interactions–including but not limited to–interactions between a writer’s attitude towards writing, her cognitive capacity, the kind of writing instruction she is exposed to, as well as the writer’s perception of textual norms in relation to the reader’s perception of the same norms, and thereby the reader’s textual expectations (Graham, 2018a; Rijlaarsdam et al., 2012; Skar & Aasen, 2021). To help children progress as writers, then, there is a need for tools that can elicit information about students’ writing skills in different domains (e.g. affective, cognitive, textual) and tools that help teachers transform that information into instruction. Such tools are often described as tools for formative assessment. Formative writing assessment has proven to be effective in increasing the writing skills of students. A review by (Graham, 2018b) reported positive effect sizes for text response (d = 0.36), adult feedback (d = 0.87), peer feedback (0.58), self-feedback (d = 0.62) and computerised feedback (d = 0.38). An earlier study by Graham et al. (2011) reported an effect size of d = 1.01 for feedback from adults or peers. So, formative writing assessment can work, and it can lead to positive change. But what is it? Graham (2018b, pp. 145–147) suggested the following definition of formative writing assessment: ‘instructional feedback in writing as information provided by another person, group of people, agency, machine, self, or experience that allows a writer, one learning to write, or a writing teacher/mentor to compare some aspect of performance to an expected, desired, or idealized performance’ and that ‘Formative feedback is derived from assessments that involve collecting information or evidence about student learning, interpreting it in terms of learners’ needs, and using it to alter what happens.’ In other words, formative writing assessment concerns taking actions based on information about a writer’s skills in order to make that writer even more skilled. One might therefore say that formative writing assessment – in the end – is all about consequences. ASSESSMENT IN EDUCATION: PRINCIPLES","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"59 1","pages":"121 - 126"},"PeriodicalIF":3.2,"publicationDate":"2022-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84341978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The early automated writing evaluation (eAWE) framework 早期的自动写作评估(eAWE)框架
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-03-04 DOI: 10.1080/0969594X.2022.2037509
D. McNamara, Panayiota Kendeou
ABSTRACT We propose a framework designed to guide the development of automated writing practice and formative evaluation and feedback for young children (K-5th grade) – the early Automated Writing Evaluation (early-AWE) Framework. e-AWE is grounded on the fundamental assumption that e-AWE is needed for young developing readers, but must incorporate advanced technologies inherent to AWE, speech recognition, and games. In line with interdisciplinary views on writing to support learners in the classroom, e-AWE must support a community of learners and interlace reading and writing instructional activities combined with feedback to use reading and writing strategies. The e-AWE Framework provides a guide for the development of tools that leverage and integrate cutting-edge technologies, some of which only recently have become widely available in educational settings. These tools can continue to provide usable and feasible means to offer high-quality automated writing practice and feedback to a diverse and large number of students.
我们提出了一个旨在指导幼儿(k -5年级)自动化写作实践和形成性评估与反馈发展的框架——早期自动化写作评估(early- awe)框架。e-AWE基于一个基本假设,即年轻的发展中读者需要e-AWE,但必须结合AWE固有的先进技术,语音识别和游戏。与跨学科的写作观点一致,e-AWE必须支持学习者社区,并将阅读和写作教学活动与反馈相结合,以使用阅读和写作策略。e-AWE框架为开发利用和整合尖端技术的工具提供了指南,其中一些技术最近才在教育环境中广泛使用。这些工具可以继续提供可用和可行的手段,为多样化和大量的学生提供高质量的自动化写作练习和反馈。
{"title":"The early automated writing evaluation (eAWE) framework","authors":"D. McNamara, Panayiota Kendeou","doi":"10.1080/0969594X.2022.2037509","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2037509","url":null,"abstract":"ABSTRACT We propose a framework designed to guide the development of automated writing practice and formative evaluation and feedback for young children (K-5th grade) – the early Automated Writing Evaluation (early-AWE) Framework. e-AWE is grounded on the fundamental assumption that e-AWE is needed for young developing readers, but must incorporate advanced technologies inherent to AWE, speech recognition, and games. In line with interdisciplinary views on writing to support learners in the classroom, e-AWE must support a community of learners and interlace reading and writing instructional activities combined with feedback to use reading and writing strategies. The e-AWE Framework provides a guide for the development of tools that leverage and integrate cutting-edge technologies, some of which only recently have become widely available in educational settings. These tools can continue to provide usable and feasible means to offer high-quality automated writing practice and feedback to a diverse and large number of students.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"14 1","pages":"150 - 182"},"PeriodicalIF":3.2,"publicationDate":"2022-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76672344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Writing motivation questionnaire: validation and application as a formative assessment 写作动机问卷:作为形成性评估的验证与应用
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-03-04 DOI: 10.1080/0969594X.2022.2080178
Steve Graham, Allen G. Harbaugh-Schattenkirk, A. Aitken, K. Harris, Clarence Ng, Amber B. Ray, John M. Wilson, Jeanne Wdowin
ABSTRACT This study evaluated the validity of a multi-dimensional measure of motives for writing. Based on an earlier instrument and theoretical conceptualisations of writing beliefs, we developed the Writing Motivation Questionnaire (WMQ). A sample of 2,186 fourth- (558 girls; 521 boys) and fifth-grade students (546 girls; 561 boys) completed 28 writing motivation items assessing seven motives for writing. Two of these motives addressed intrinsic reasons for writing (curiosity, involvement); three motives assessed extrinsic reasons (grades, competition, and social recognition); and two motives examined self-regulatory reasons (emotional regulation, relief from boredom). Confirmatory factor analyses supported the hypothesised structure of the WMQ, and each of the seven motives evidenced adequate reliability for research purposes. Measurement invariance was established for grades four and five students, girls and boys, White and non-White students, children receiving or not receiving free/reduced lunch, and students receiving or not receiving special education services. The WMQ predicted students’ writing performance.
摘要:本研究评估了写作动机的多维度测量的有效性。基于早期的工具和写作信念的理论概念,我们开发了写作动机问卷(WMQ)。2186名四分之一(558名女孩;521名男生)和五年级学生(546名女生;561名男生完成了28个写作动机项目,评估了7个写作动机。其中两个动机涉及写作的内在原因(好奇心、参与感);三种动机评估外在原因(成绩、竞争和社会认可);还有两种动机是自我调节的原因(情绪调节,摆脱无聊)。验证性因素分析支持WMQ的假设结构,七个动机中的每一个都证明了研究目的的足够可靠性。四年级和五年级学生、女孩和男孩、白人和非白人学生、接受或不接受免费/减少午餐的儿童、接受或不接受特殊教育服务的学生建立了测量不变性。WMQ预测了学生的写作表现。
{"title":"Writing motivation questionnaire: validation and application as a formative assessment","authors":"Steve Graham, Allen G. Harbaugh-Schattenkirk, A. Aitken, K. Harris, Clarence Ng, Amber B. Ray, John M. Wilson, Jeanne Wdowin","doi":"10.1080/0969594X.2022.2080178","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2080178","url":null,"abstract":"ABSTRACT This study evaluated the validity of a multi-dimensional measure of motives for writing. Based on an earlier instrument and theoretical conceptualisations of writing beliefs, we developed the Writing Motivation Questionnaire (WMQ). A sample of 2,186 fourth- (558 girls; 521 boys) and fifth-grade students (546 girls; 561 boys) completed 28 writing motivation items assessing seven motives for writing. Two of these motives addressed intrinsic reasons for writing (curiosity, involvement); three motives assessed extrinsic reasons (grades, competition, and social recognition); and two motives examined self-regulatory reasons (emotional regulation, relief from boredom). Confirmatory factor analyses supported the hypothesised structure of the WMQ, and each of the seven motives evidenced adequate reliability for research purposes. Measurement invariance was established for grades four and five students, girls and boys, White and non-White students, children receiving or not receiving free/reduced lunch, and students receiving or not receiving special education services. The WMQ predicted students’ writing performance.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"73 1","pages":"238 - 261"},"PeriodicalIF":3.2,"publicationDate":"2022-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86015447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Predicting first grade students’ writing proficiency 预测一年级学生的写作能力
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-03-04 DOI: 10.1080/0969594X.2022.2057424
G. B. Skar, Alan Huebner
ABSTRACT This study aimed to investigate the predictability of writing development and if scores on a writing test in the first weeks of first grade accurately predict students’ placements into different proficiency groups. Participants were 832 first grade students in Norway. Writing proficiency was measured twice, at the start and at the end of first grade (time 1 and time 2, respectively). Multilevel linear regression analysis showed that writing proficiency measures at time 1 were significant predictors of writing proficiency at time 2. The results also showed that measures at time 1 could identify students running the risk of not meeting expectations with high precision. However, the results also revealed a substantial proportion of false positives. The results are interpreted and discussed from a formative writing assessment perspective.
摘要本研究旨在探讨一年级学生写作发展的可预测性,以及一年级前几周的写作测试分数是否能准确预测学生在不同水平组的位置。参与者是挪威的832名一年级学生。写作能力在一年级开始和结束时分别测量了两次(时间1和时间2)。多水平线性回归分析显示,时间1的写作熟练程度测量是时间2写作熟练程度的显著预测因子。结果还表明,时间1的测量方法可以高精度地识别出有不符合预期风险的学生。然而,结果也显示出相当大比例的假阳性。从形成性写作评估的角度对结果进行解释和讨论。
{"title":"Predicting first grade students’ writing proficiency","authors":"G. B. Skar, Alan Huebner","doi":"10.1080/0969594X.2022.2057424","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2057424","url":null,"abstract":"ABSTRACT This study aimed to investigate the predictability of writing development and if scores on a writing test in the first weeks of first grade accurately predict students’ placements into different proficiency groups. Participants were 832 first grade students in Norway. Writing proficiency was measured twice, at the start and at the end of first grade (time 1 and time 2, respectively). Multilevel linear regression analysis showed that writing proficiency measures at time 1 were significant predictors of writing proficiency at time 2. The results also showed that measures at time 1 could identify students running the risk of not meeting expectations with high precision. However, the results also revealed a substantial proportion of false positives. The results are interpreted and discussed from a formative writing assessment perspective.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"1 1","pages":"219 - 237"},"PeriodicalIF":3.2,"publicationDate":"2022-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81999243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Writing assessment for communities of writers: rubric validation to support formative assessment of writing in Pre-K to grade 2 作家社区的写作评估:支持Pre-K至2年级写作形成性评估的标题验证
IF 3.2 3区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2022-03-03 DOI: 10.1080/0969594X.2022.2047608
Eithne Kennedy, G. Shiel
ABSTRACT Formative assessment is an important driver in supporting children’s writing development. This paper describes a writing rubric designed for use by teachers to formatively assess the writing of children in Pre-K to Grade 2, how the rubric was received by teachers, and its implementation in classrooms. Writing samples from 337 children in 33 classrooms in 7 schools in the Write to Read literacy improvement project were scored on conventions, organisation, ideas, word choice and voice. Agreement among raters was good as overall weighted Kappa values at each grade level ranged from .62 to .80. Confirmatory factor analysis supported three- and five-factor models. Coaches endorsed use of the rubric for providing formative feedback to students, identifying learning needs, and differentiating instruction. They highlighted how the rubric provides a framework through which teachers and students engage with the language of writing assessment and raise expectations about writing quality.
形成性评价是支持儿童写作发展的重要驱动力。本文描述了一种写作标准,设计用于教师对学前班至二年级儿童的写作进行形式化评估,教师如何接受该标准,以及它在课堂上的实施。在Write to Read读写能力改善项目中,来自7所学校33个教室的337名儿童的写作样本在惯例、组织、想法、词汇选择和声音方面进行了评分。评分者之间的一致性很好,因为每个年级的总体加权Kappa值从0.62到0.80不等。验证性因子分析支持三因子和五因子模型。教练们赞同使用标准来为学生提供形成性的反馈,识别学习需求,区分教学。他们强调,该标准提供了一个框架,通过该框架,教师和学生可以参与写作语言评估,并提高对写作质量的期望。
{"title":"Writing assessment for communities of writers: rubric validation to support formative assessment of writing in Pre-K to grade 2","authors":"Eithne Kennedy, G. Shiel","doi":"10.1080/0969594X.2022.2047608","DOIUrl":"https://doi.org/10.1080/0969594X.2022.2047608","url":null,"abstract":"ABSTRACT Formative assessment is an important driver in supporting children’s writing development. This paper describes a writing rubric designed for use by teachers to formatively assess the writing of children in Pre-K to Grade 2, how the rubric was received by teachers, and its implementation in classrooms. Writing samples from 337 children in 33 classrooms in 7 schools in the Write to Read literacy improvement project were scored on conventions, organisation, ideas, word choice and voice. Agreement among raters was good as overall weighted Kappa values at each grade level ranged from .62 to .80. Confirmatory factor analysis supported three- and five-factor models. Coaches endorsed use of the rubric for providing formative feedback to students, identifying learning needs, and differentiating instruction. They highlighted how the rubric provides a framework through which teachers and students engage with the language of writing assessment and raise expectations about writing quality.","PeriodicalId":51515,"journal":{"name":"Assessment in Education-Principles Policy & Practice","volume":"3 1","pages":"127 - 149"},"PeriodicalIF":3.2,"publicationDate":"2022-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88570541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Assessment in Education-Principles Policy & Practice
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1