首页 > 最新文献

Assessing Writing最新文献

英文 中文
Effects of task-based language teaching on functional adequacy in L2 writing 任务型语言教学对第二语言写作功能充分性的影响
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-28 DOI: 10.1016/j.asw.2024.100838
Ran Wei , Xiaoyan Zhao

Task-based language teaching (TBLT) has generally been reported to enhance second language (L2) writing on linguistic features such as complexity, accuracy, and fluency. The research on how it influences pragmatic dimensions, however, has been scarce. Drawing upon a pretest-posttest design, this study investigates the potential of TBLT in pragmatic development in Chinese high school students’ English writing. Eighty Chinese senior high school students from two parallel classes participated in this study over four weeks. One class as the experimental group received TBLT writing instruction while the other class as the control group maintained the traditional product approach of writing teaching. Pragmatic outcomes were assessed in terms of functional adequacy (i.e., content, task requirements, comprehensibility, and coherence/cohesion) with functional adequacy rating scales. Results showed the salient effects of TBLT in helping students become more functionally adequate in English writing. In particular, it promoted the content, task requirements, and comprehensibility of students’ writing. The coherence and cohesion performance in writing, however, did not demonstrate considerable improvement. Intriguingly, a significant correlation was identified between students’ English proficiency and the coherence/cohesion dimension in their written texts. The study highlights the effectiveness of TBLT in facilitating L2 writing performance from the perspective of pragmatic dimensions and emphasizes the importance of developing students’ pragmatic writing ability. These findings have significant implications for Chinese high school English writing instruction.

据报道,任务型语言教学(TBLT)一般能提高第二语言(L2)写作的语言特点,如复杂性、准确性和流畅性。然而,有关它如何影响语用维度的研究却很少。本研究采用前测-后测设计,探讨了 TBLT 在中国高中生英语写作语用发展中的潜力。来自两个平行班级的 80 名中国高中生参加了为期四周的研究。一个班作为实验组,接受 TBLT 写作教学;另一个班作为对照组,保持传统的产品写作教学法。实用成果通过功能充分性评分量表(即内容、任务要求、可理解性和连贯性/凝聚力)进行评估。结果显示,TBLT 在帮助学生提高英语写作的功能充分性方面效果显著。特别是,它促进了学生写作内容、任务要求和可理解性的提高。然而,写作的连贯性和凝聚力方面的表现并没有得到明显改善。耐人寻味的是,学生的英语水平与书面文章的连贯性/凝聚力之间存在着明显的相关性。本研究从语用维度的角度强调了 TBLT 在促进 L2 写作表现方面的有效性,并强调了培养学生语用写作能力的重要性。这些发现对中国高中英语写作教学具有重要意义。
{"title":"Effects of task-based language teaching on functional adequacy in L2 writing","authors":"Ran Wei ,&nbsp;Xiaoyan Zhao","doi":"10.1016/j.asw.2024.100838","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100838","url":null,"abstract":"<div><p>Task-based language teaching (TBLT) has generally been reported to enhance second language (L2) writing on linguistic features such as complexity, accuracy, and fluency. The research on how it influences pragmatic dimensions, however, has been scarce. Drawing upon a pretest-posttest design, this study investigates the potential of TBLT in pragmatic development in Chinese high school students’ English writing. Eighty Chinese senior high school students from two parallel classes participated in this study over four weeks. One class as the experimental group received TBLT writing instruction while the other class as the control group maintained the traditional product approach of writing teaching. Pragmatic outcomes were assessed in terms of functional adequacy (i.e., content, task requirements, comprehensibility, and coherence/cohesion) with functional adequacy rating scales. Results showed the salient effects of TBLT in helping students become more functionally adequate in English writing. In particular, it promoted the content, task requirements, and comprehensibility of students’ writing. The coherence and cohesion performance in writing, however, did not demonstrate considerable improvement. Intriguingly, a significant correlation was identified between students’ English proficiency and the coherence/cohesion dimension in their written texts. The study highlights the effectiveness of TBLT in facilitating L2 writing performance from the perspective of pragmatic dimensions and emphasizes the importance of developing students’ pragmatic writing ability. These findings have significant implications for Chinese high school English writing instruction.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140321182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Writing productivity development in elementary school: A systematic review 小学写作能力的培养:系统回顾
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-27 DOI: 10.1016/j.asw.2024.100834
Catherine Martin , Julie E. Dockrell

The ability to produce fluent and coherent written text impacts learning and attainments. Valid and reliable assessments of writing are needed to monitor progression, develop goals for writing and identify struggling writers. In order to inform practice and research a systematic review was conducted to investigate which writing productivity measures captured writing development and identified struggling writers in elementary school. Sixty-seven empirical studies were identified for inclusion, appraised, and their data extracted under the themes of writing genre, duration of writing task, use of priming of topic knowledge prior to the writing assessment, use of planning time, writing modality, gender, age of participants and learning difficulties. Total Number of Words and Correct Word Sequences were the most common means of measuring productivity. Productivity varied significantly between genres and durations of writing tasks and was higher in girls than boys. Students with learning difficulties scored significantly lower in writing productivity when compared to typically developing peers. Insufficient research was available to draw conclusions regarding the effects of priming of topic knowledge, planning and modality on writing productivity. Study limitations, links to the assessment of writing and recommended further research are discussed.

能否写出流畅连贯的书面文字影响着学习和成绩。需要对写作进行有效可靠的评估,以监测写作进度、制定写作目标和识别写作困难者。为了给实践和研究提供信息,我们进行了一次系统性的回顾,以调查哪些写作能力测评方法可以捕捉写作的发展并识别小学阶段的写作困难学生。我们确定了 67 项实证研究,并按照写作体裁、写作任务持续时间、写作评估前主题知识引导的使用、计划时间的使用、写作模式、性别、参与者年龄和学习困难等主题对这些研究进行了评估和数据提取。总字数和正确单词序列是衡量写作效率最常用的方法。不同体裁和不同写作时间的学生的写作效率差异很大,而且女生的写作效率高于男生。有学习困难的学生的写作效率明显低于发育正常的学生。关于主题知识、计划和模式的引导对写作效率的影响,没有足够的研究可以得出结论。本文讨论了研究的局限性、与写作评估的联系以及建议开展的进一步研究。
{"title":"Writing productivity development in elementary school: A systematic review","authors":"Catherine Martin ,&nbsp;Julie E. Dockrell","doi":"10.1016/j.asw.2024.100834","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100834","url":null,"abstract":"<div><p>The ability to produce fluent and coherent written text impacts learning and attainments. Valid and reliable assessments of writing are needed to monitor progression, develop goals for writing and identify struggling writers. In order to inform practice and research a systematic review was conducted to investigate which writing productivity measures captured writing development and identified struggling writers in elementary school. Sixty-seven empirical studies were identified for inclusion, appraised, and their data extracted under the themes of writing genre, duration of writing task, use of priming of topic knowledge prior to the writing assessment, use of planning time, writing modality, gender, age of participants and learning difficulties. Total Number of Words and Correct Word Sequences were the most common means of measuring productivity. Productivity varied significantly between genres and durations of writing tasks and was higher in girls than boys. Students with learning difficulties scored significantly lower in writing productivity when compared to typically developing peers. Insufficient research was available to draw conclusions regarding the effects of priming of topic knowledge, planning and modality on writing productivity. Study limitations, links to the assessment of writing and recommended further research are discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000278/pdfft?md5=4ad6ec60a7c0a2285ea5a8ba6523a7dc&pid=1-s2.0-S1075293524000278-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140296575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing trained EFL peer reviewers’ feedback: From claim to reality 比较受过培训的 EFL 同行评审员的反馈意见:从主张到现实
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-21 DOI: 10.1016/j.asw.2024.100836
Alireza Memari Hanjani

Comparing trained L2 writing student reviewers’ feedback behaviors as well as examining the extent to which their claims are aligned with their actual evaluation practices have received limited scholarly attention. Employing think-aloud protocols, one cause and one effect essays evaluated by five upper-intermediate L2 learners, and follow-up semi-structured interviews, this case study research aimed to explore trained L2 peer reviewers’ feedback behaviors and the matches and mismatches between their claims and evaluation practices. While the first and the second data source compared the participants’ actual feedback practices in terms of nature, type, and validity, the last source probed their claims on peer evaluation. The findings contribute to peer feedback research by emphasizing on the need for individual, customized, and constant peer review training sessions rather than general, all-purpose, and decontextualized instructions which can consequently improve peer feedback quality in L2 writing contexts.

比较受过训练的第二语言写作学生审稿人的反馈行为,以及研究他们的主张与实际评价实践的一致程度,在学术界受到的关注很有限。本案例研究采用了思考-朗读协议、由五名中高级 L2 学习者评价的一篇原因和一篇结果文章以及后续的半结构式访谈,旨在探讨受过训练的 L2 同行评阅者的反馈行为以及他们的主张与评价实践之间的匹配与不匹配。第一个和第二个数据源比较了参与者在性质、类型和有效性方面的实际反馈做法,而最后一个数据源则探究了他们对同伴评价的主张。研究结果对同伴反馈研究有所贡献,强调了个别的、定制的和持续的同伴互评培训课程的必要性,而不是一般的、万能的和非语境化的指导,从而提高了 L2 写作语境中的同伴反馈质量。
{"title":"Comparing trained EFL peer reviewers’ feedback: From claim to reality","authors":"Alireza Memari Hanjani","doi":"10.1016/j.asw.2024.100836","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100836","url":null,"abstract":"<div><p>Comparing trained L2 writing student reviewers’ feedback behaviors as well as examining the extent to which their claims are aligned with their actual evaluation practices have received limited scholarly attention. Employing think-aloud protocols, one cause and one effect essays evaluated by five upper-intermediate L2 learners, and follow-up semi-structured interviews, this case study research aimed to explore trained L2 peer reviewers’ feedback behaviors and the matches and mismatches between their claims and evaluation practices. While the first and the second data source compared the participants’ actual feedback practices in terms of nature, type, and validity, the last source probed their claims on peer evaluation. The findings contribute to peer feedback research by emphasizing on the need for individual, customized, and constant peer review training sessions rather than general, all-purpose, and decontextualized instructions which can consequently improve peer feedback quality in L2 writing contexts.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140180208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-13 DOI: 10.1016/j.asw.2024.100835
Yan Yang
{"title":"","authors":"Yan Yang","doi":"10.1016/j.asw.2024.100835","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100835","url":null,"abstract":"","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140113425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The associations among growth mindsets, the ideal L2 writing self, and L2 writing enjoyment and their impacts on L2 English writing performance: A gender difference perspective 成长心态、理想的 L2 写作自我和 L2 写作乐趣之间的关联及其对 L2 英语写作成绩的影响:性别差异视角
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-11 DOI: 10.1016/j.asw.2024.100832
Yuan Yao , Xinhua Zhu , Jianling Zhan

Recently, researchers are paying increasing attention to the influence of second language (L2) writers’ personal beliefs on writing learning experiences and outcomes. Drawing on the Positive Psychology approach and from a gender difference perspective, this study investigates the relationships among two important motivational factors (i.e., growth mindsets and the ideal L2 writing self) and L2 writing enjoyment, as well as the impacts of these three positive mentalities on English writing performance with 679 12th grade high school students in mainland China. Independent sample t-tests results indicated that female students had significantly better English writing performance and higher levels of the three mentalities, although the effect sizes of the differences were small. Our multi-group structural equation model reported positive associations among the three mentalities for both male and female students. Growth mindsets were more influential for male students, whereas the ideal L2 writing self more influential for female students. In terms of the influence of the three mentalities on English writing performance, only the ideal L2 writing self was a significant predictor for female students. Pedagogical suggestions are provided based on the findings.

最近,研究人员越来越关注第二语言(L2)写作者的个人信念对写作学习经历和结果的影响。本研究借鉴积极心理学的研究方法,从性别差异的视角出发,以中国大陆679名12年级高中生为研究对象,探讨了两个重要的动机因素(即成长心态和理想的第二语言写作自我)与第二语言写作乐趣之间的关系,以及这三种积极心态对英语写作成绩的影响。独立样本t检验结果表明,女生的英语写作成绩明显更好,三种积极心态的水平也更高,但差异的效应大小较小。我们的多组结构方程模型显示,男女学生的三种心态之间存在正相关。成长心态对男生的影响更大,而理想的 L2 写作自我对女生的影响更大。就三种心态对英语写作成绩的影响而言,只有理想的 L2 写作自我对女生有显著的预测作用。根据研究结果提出了教学建议。
{"title":"The associations among growth mindsets, the ideal L2 writing self, and L2 writing enjoyment and their impacts on L2 English writing performance: A gender difference perspective","authors":"Yuan Yao ,&nbsp;Xinhua Zhu ,&nbsp;Jianling Zhan","doi":"10.1016/j.asw.2024.100832","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100832","url":null,"abstract":"<div><p>Recently, researchers are paying increasing attention to the influence of second language (L2) writers’ personal beliefs on writing learning experiences and outcomes. Drawing on the Positive Psychology approach and from a gender difference perspective, this study investigates the relationships among two important motivational factors (i.e., growth mindsets and the ideal L2 writing self) and L2 writing enjoyment, as well as the impacts of these three positive mentalities on English writing performance with 679 12th grade high school students in mainland China. Independent sample t-tests results indicated that female students had significantly better English writing performance and higher levels of the three mentalities, although the effect sizes of the differences were small. Our multi-group structural equation model reported positive associations among the three mentalities for both male and female students. Growth mindsets were more influential for male students, whereas the ideal L2 writing self more influential for female students. In terms of the influence of the three mentalities on English writing performance, only the ideal L2 writing self was a significant predictor for female students. Pedagogical suggestions are provided based on the findings.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140104185","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing writing and spelling interest and self-beliefs: Does the type of pictorial support affect first and third graders’ responses? 评估写作和拼写兴趣及自信心:图画支持的类型会影响一年级和三年级学生的反应吗?
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-10 DOI: 10.1016/j.asw.2024.100833
Aline Alves-Wold , Bente Rigmor Walgermo , Njål Foldnes

An array of pictorial supports (e.g., emojis, geometrical figures, animals) is often used in studies assessing young students’ writing motivation with Likert scales. However, although these images may influence the students’ responses, sufficient rationales for these choices are often absent from the studies. To the best of our knowledge, the present study is the first to investigate two different types of pictorial support (circles vs. faces) in Likert scales assessing first and third graders’ writing interest, self-concept, and spelling interest and self-efficacy. The samples consist of 2197 first graders (mean age 6.8 years) and 1740 third graders (mean age 8.4 years). Results show statistically significant differences among the scales indicating that when face-scales are used, first-graders skip motivation items more often, and students in both grades avoid the minimum values of the scale more often. Gender differences are also found indicating that when face-scales are used, boys in third grade avoid maximum values more often, and girls in both grades avoid the minimum values more often. These findings suggest that the use of circle-scales compared to face-scales seem more appropriate in scales measuring young students’ writing and spelling interest and self-beliefs.

在使用李克特量表评估青少年学生写作动机的研究中,经常会使用一系列图像支持(如表情符号、几何图形、动物)。然而,尽管这些图像可能会影响学生的回答,但研究中往往缺乏这些选择的充分理由。据我们所知,本研究首次调查了在评估一年级和三年级学生写作兴趣、自我概念、拼写兴趣和自我效能的李克特量表中两种不同类型的图像支持(圆圈与人脸)。样本包括 2197 名一年级学生(平均年龄 6.8 岁)和 1740 名三年级学生(平均年龄 8.4 岁)。结果显示,各量表之间存在显著的统计学差异,表明在使用面量表时,一年级学生更常跳过动机项目,而两个年级的学生都更常回避量表的最小值。性别差异也被发现,表明当使用面量表时,三年级的男生更经常地回避最大值,而两个年级的女生更经常地回避最小值。这些研究结果表明,在测量青少年学生的写作和拼写兴趣及自信心的量表中,使用圈形量表比使用面形量表似乎更合适。
{"title":"Assessing writing and spelling interest and self-beliefs: Does the type of pictorial support affect first and third graders’ responses?","authors":"Aline Alves-Wold ,&nbsp;Bente Rigmor Walgermo ,&nbsp;Njål Foldnes","doi":"10.1016/j.asw.2024.100833","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100833","url":null,"abstract":"<div><p>An array of pictorial supports (e.g., emojis, geometrical figures, animals) is often used in studies assessing young students’ writing motivation with Likert scales. However, although these images may influence the students’ responses, sufficient rationales for these choices are often absent from the studies. To the best of our knowledge, the present study is the first to investigate two different types of pictorial support (circles vs. faces) in Likert scales assessing first and third graders’ writing interest, self-concept, and spelling interest and self-efficacy. The samples consist of 2197 first graders (mean age 6.8 years) and 1740 third graders (mean age 8.4 years). Results show statistically significant differences among the scales indicating that when face-scales are used, first-graders skip motivation items more often, and students in both grades avoid the minimum values of the scale more often. Gender differences are also found indicating that when face-scales are used, boys in third grade avoid maximum values more often, and girls in both grades avoid the minimum values more often. These findings suggest that the use of circle-scales compared to face-scales seem more appropriate in scales measuring young students’ writing and spelling interest and self-beliefs.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000266/pdfft?md5=4d11341a0d40c0ba450a7679f146a437&pid=1-s2.0-S1075293524000266-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140069289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-03-01 DOI: 10.1016/j.asw.2024.100831
Jiabao Zhong , Qiaoyu Min
{"title":"","authors":"Jiabao Zhong ,&nbsp;Qiaoyu Min","doi":"10.1016/j.asw.2024.100831","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100831","url":null,"abstract":"","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140015345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Writing assessment and feedback literacy: Where do we stand and where can we go? 写作评估与反馈素养:何去何从?
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-02-27 DOI: 10.1016/j.asw.2024.100829
Shulin Yu , Icy Lee
{"title":"Writing assessment and feedback literacy: Where do we stand and where can we go?","authors":"Shulin Yu ,&nbsp;Icy Lee","doi":"10.1016/j.asw.2024.100829","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100829","url":null,"abstract":"","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139976120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-02-19 DOI: 10.1016/j.asw.2024.100812
Alexánder Ramírez-Espinosa
{"title":"","authors":"Alexánder Ramírez-Espinosa","doi":"10.1016/j.asw.2024.100812","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100812","url":null,"abstract":"","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139907855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Establishing analytic score profiles for large-scale L2 writing assessment: The case of the CET-4 writing test 为大规模 L2 写作评估建立分析分数档案:以 CET-4 写作测试为例
IF 3.9 1区 文学 Q1 Arts and Humanities Pub Date : 2024-02-19 DOI: 10.1016/j.asw.2024.100826
Shaoyan Zou , Xun Yan , Jason Fan

This study addresses a critical need in large-scale L2 writing assessment by emphasizing the significance of tailoring assessments to specific teaching and learning contexts. Focusing on the CET-4 writing test in China, the research unfolded in two phases. In Phase I, an empirically-developed analytic rating scale designed for the CET-4 writing test was rigorously validated. Twenty-one raters used this scale to rate 30 essays, and Many-Facets Rasch Model (MFRM) analysis was performed on the rating data. The outcomes demonstrate the scale’s robustness in effectively differentiating examinees’ writing performance, ensuring consistency among raters, and mitigating rater variation at both individual and group level. Phase II extends the research scope by applying the validated scale to score 142 CET-4 writing scripts. Utilizing Hierarchical and K-Means cluster analyses, this phase unveils three distinct score profiles. These findings are significant for both the CET-4 writing test and other L2 large-scale writing assessment. Theoretically, this study introduces a perspective that aims to enhance our understanding of learners’ performance in large-scale L2 writing assessment. Methodologically, this study presents a framework that integrates the validation of the rating scale with the identification of distinct score clusters, thus aiming to provide a more detailed solution for tailoring assessments to specific learning contexts.

本研究强调了根据具体的教学和学习环境调整评估的重要性,从而满足了大规模中级写作评估的关键需求。研究以中国的 CET-4 写作测试为重点,分两个阶段展开。在第一阶段,针对 CET-4 写作测试设计的经验性分析评分量表得到了严格验证。21 名评分员使用该量表对 30 篇文章进行了评分,并对评分数据进行了多面拉施模型(MFRM)分析。结果表明,该量表在有效区分考生的写作成绩、确保评分者之间的一致性以及减少评分者在个人和小组层面的差异方面具有很强的稳健性。第二阶段扩大了研究范围,将经过验证的量表用于对 142 份 CET-4 作文答卷进行评分。利用层次分析法和 K-Means 聚类分析法,该阶段揭示了三种不同的分数特征。这些发现对于 CET-4 写作测试和其他 L2 大规模写作评估都具有重要意义。从理论上讲,本研究引入了一个视角,旨在加深我们对学习者在大规模 L2 写作评估中的表现的理解。在方法论上,本研究提出了一个框架,将评分量表的验证与不同分数群的识别结合起来,从而为根据特定的学习环境定制评估提供更详细的解决方案。
{"title":"Establishing analytic score profiles for large-scale L2 writing assessment: The case of the CET-4 writing test","authors":"Shaoyan Zou ,&nbsp;Xun Yan ,&nbsp;Jason Fan","doi":"10.1016/j.asw.2024.100826","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100826","url":null,"abstract":"<div><p>This study addresses a critical need in large-scale L2 writing assessment by emphasizing the significance of tailoring assessments to specific teaching and learning contexts. Focusing on the CET-4 writing test in China, the research unfolded in two phases. In Phase I, an empirically-developed analytic rating scale designed for the CET-4 writing test was rigorously validated. Twenty-one raters used this scale to rate 30 essays, and Many-Facets Rasch Model (MFRM) analysis was performed on the rating data. The outcomes demonstrate the scale’s robustness in effectively differentiating examinees’ writing performance, ensuring consistency among raters, and mitigating rater variation at both individual and group level. Phase II extends the research scope by applying the validated scale to score 142 CET-4 writing scripts. Utilizing Hierarchical and K-Means cluster analyses, this phase unveils three distinct score profiles. These findings are significant for both the CET-4 writing test and other L2 large-scale writing assessment. Theoretically, this study introduces a perspective that aims to enhance our understanding of learners’ performance in large-scale L2 writing assessment. Methodologically, this study presents a framework that integrates the validation of the rating scale with the identification of distinct score clusters, thus aiming to provide a more detailed solution for tailoring assessments to specific learning contexts.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":3.9,"publicationDate":"2024-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139907854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Assessing Writing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1