首页 > 最新文献

Assessing Writing最新文献

英文 中文
Validating an integrated reading-into-writing scale with trained university students 通过训练有素的大学生验证 "从阅读到写作 "综合量表
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-24 DOI: 10.1016/j.asw.2024.100894
Integrated tasks are often used in higher education (HE) for diagnostic purposes, with increasing popularity in lingua franca contexts, such as German HE, where English-medium courses are gaining ground. In this context, we report the validation of a new rating scale for assessing reading-into-writing tasks. To examine scoring validity, we employed Weir’s (2005) socio-cognitive framework in an explanatory mixed-methods design. We collected 679 integrated performances in four summary and opinion tasks, which were rated by six trained student raters. They are to become writing tutors for first-year students. We utilized a many-facet Rasch model to investigate rater severity, reliability, consistency, and scale functioning. Using thematic analysis, we analyzed think-aloud protocols, retrospective and focus group interviews with the raters. Findings showed that the rating scale overall functions as intended and is perceived by the raters as valid operationalization of the integrated construct. FACETS analyses revealed reasonable reliabilities, yet exposed local issues with certain criteria and band levels. This is corroborated by the challenges reported by the raters, which they mainly attributed to the complexities inherent in such an assessment. Applying Weir’s (2005) framework in a mixed-methods approach facilitated the interpretation of the quantitative findings and yielded insights into potential validity threads.
在高等教育(HE)中,综合任务经常被用于诊断目的,在通用语言环境中越来越受欢迎,例如在德国高等教育中,以英语为教学语言的课程越来越受欢迎。在这种情况下,我们报告了用于评估 "读写结合 "任务的新评分量表的验证情况。为了检验评分的有效性,我们在解释性混合方法设计中采用了 Weir(2005 年)的社会认知框架。我们收集了 679 个学生在四项摘要和观点任务中的综合表现,并由六名经过培训的学生评分员进行评分。他们将成为一年级学生的写作导师。我们利用多方面的 Rasch 模型来研究评分者的严重程度、可靠性、一致性和量表功能。通过主题分析,我们分析了评分者的思考-朗读协议、回顾性访谈和焦点小组访谈。研究结果表明,评分量表的整体功能符合预期,评分者认为它是对综合概念的有效操作。FACETS 分析显示了合理的可靠性,但也暴露了某些标准和等级的局部问题。评定者所报告的挑战也证实了这一点,他们主要将这些挑战归因于这种评定所固有的复杂性。在混合方法中应用韦尔(Weir,2005 年)的框架有助于解释定量研究结果,并能深入了解潜在的有效性问题。
{"title":"Validating an integrated reading-into-writing scale with trained university students","authors":"","doi":"10.1016/j.asw.2024.100894","DOIUrl":"10.1016/j.asw.2024.100894","url":null,"abstract":"<div><div>Integrated tasks are often used in higher education (HE) for diagnostic purposes, with increasing popularity in lingua franca contexts, such as German HE, where English-medium courses are gaining ground. In this context, we report the validation of a new rating scale for assessing reading-into-writing tasks. To examine scoring validity, we employed Weir’s (2005) socio-cognitive framework in an explanatory mixed-methods design. We collected 679 integrated performances in four summary and opinion tasks, which were rated by six trained student raters. They are to become writing tutors for first-year students. We utilized a many-facet Rasch model to investigate rater severity, reliability, consistency, and scale functioning. Using thematic analysis, we analyzed think-aloud protocols, retrospective and focus group interviews with the raters. Findings showed that the rating scale overall functions as intended and is perceived by the raters as valid operationalization of the integrated construct. FACETS analyses revealed reasonable reliabilities, yet exposed local issues with certain criteria and band levels. This is corroborated by the challenges reported by the raters, which they mainly attributed to the complexities inherent in such an assessment. Applying Weir’s (2005) framework in a mixed-methods approach facilitated the interpretation of the quantitative findings and yielded insights into potential validity threads.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000874/pdfft?md5=73c505eab3803fbf3a3edfd0612d454a&pid=1-s2.0-S1075293524000874-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142314882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding the SSARC model of task sequencing: Assessing L2 writing development 了解任务排序的 SSARC 模型:评估 L2 写作发展
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-23 DOI: 10.1016/j.asw.2024.100893
This study aimed to explore the impact of task sequencing on the development of second language (L2) writing and investigate how L2 learners performed on three decision-making writing tasks completed in different orders over nine weeks. 120 advanced-high EFL students were randomly assigned to one of three groups and given different task sequences: 1) a simple-medium-complex (SMC) sequence, 2) a complex-medium-simple sequence (CMS), or 3) a random sequence (RDM). Essays were analyzed using measures of syntactic complexity, accuracy, lexical complexity, and fluency (CALF). Results showed that the CALF of L2 writing demonstrated longitudinal development over time in all three task sequencing groups. CALF development was not immediately apparent in the first six weeks, with most measures displaying a significant increase by the end of the ninth week. Furthermore, different task sequences resulted in varying patterns and magnitudes of CALF growth, but no specific sequence was found to be superior overall.
本研究旨在探讨任务顺序对第二语言(L2)写作发展的影响,并调查 L2 学习者在九周时间内以不同顺序完成三项决策性写作任务时的表现。120名EFL高年级学生被随机分配到三组中的一组,并被赋予不同的任务顺序:1)简单-中等-复杂(SMC)序列;2)复杂-中等-简单序列(CMS);或3)随机序列(RDM)。我们使用句法复杂性、准确性、词汇复杂性和流畅性(CALF)等指标对作文进行了分析。结果显示,在所有三个任务序列组中,L2 写作的 CALF 都随着时间的推移呈现纵向发展。在前六周,CALF 的发展并不明显,但到第九周结束时,大多数测量指标都有了显著的提高。此外,不同的任务序列会导致不同的 CALF 增长模式和幅度,但总体而言,没有发现任何特定的序列具有优势。
{"title":"Understanding the SSARC model of task sequencing: Assessing L2 writing development","authors":"","doi":"10.1016/j.asw.2024.100893","DOIUrl":"10.1016/j.asw.2024.100893","url":null,"abstract":"<div><div>This study aimed to explore the impact of task sequencing on the development of second language (L2) writing and investigate how L2 learners performed on three decision-making writing tasks completed in different orders over nine weeks. 120 advanced-high EFL students were randomly assigned to one of three groups and given different task sequences: 1) a simple-medium-complex (SMC) sequence, 2) a complex-medium-simple sequence (CMS), or 3) a random sequence (RDM). Essays were analyzed using measures of syntactic complexity, accuracy, lexical complexity, and fluency (CALF). Results showed that the CALF of L2 writing demonstrated longitudinal development over time in all three task sequencing groups. CALF development was not immediately apparent in the first six weeks, with most measures displaying a significant increase by the end of the ninth week. Furthermore, different task sequences resulted in varying patterns and magnitudes of CALF growth, but no specific sequence was found to be superior overall.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142311405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the use of model texts as a feedback instrument in expository writing: EFL learners’ noticing, incorporations, and text quality 探索在说明文写作中使用范文作为反馈工具:英语学习者的注意、融入和文本质量
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-20 DOI: 10.1016/j.asw.2024.100890
Model texts as a feedback instrument (MTFI) have proven effective in enhancing L2 writing, yet research on this domain mainly focused on narrative compositions over a three-stage task: i) composing, ii) comparing, and iii) rewriting. The impact of MTFI on learners’ noticing, incorporations, and text quality in expository writing, especially in the Vietnamese context, remains underexplored. To address these gaps, this study aims to investigate the effect of MTFI on 68 Vietnamese EFL undergraduates’ expository writing following a process-product approach. The participants were divided into a control group (CG, N = 33) and an experimental group (EG, N = 35). Both groups attended stages one and three, but only the EG compared their initial writing with a model text in stage two. The results, derived from learners’ note-taking sheets, written paragraphs, and semi-structured interviews, revealed that despite the two groups’ comparability in stage one, the EG demonstrated significantly better text quality than the CG in stage three, particularly in content, lexis, and organization. Furthermore, while the EG largely encountered lexical issues at the outset, they primarily concentrated on content-related and organizational features in the subsequent stages. Based on the findings, recommendations for future research and implications for pedagogy were deliberated.
事实证明,作为反馈工具的范文(MTFI)能有效提高 L2 写作水平,但这方面的研究主要集中在叙事作文的三个阶段任务上:i) 作文,ii) 比较,iii) 改写。MTFI对学习者在说明文写作中的注意、融入和文本质量的影响,尤其是在越南语境中的影响,仍未得到充分探索。为了弥补这些不足,本研究采用过程-产品法,旨在调查 MTFI 对 68 名越南 EFL 本科生说明文写作的影响。参与者分为对照组(CG,33 人)和实验组(EG,35 人)。两组都参加了第一和第三阶段,但只有实验组在第二阶段将他们的初始写作与范文进行了比较。从学习者的笔记单、书面段落和半结构式访谈中得出的结果显示,尽管两组在第一阶段具有可比性,但在第三阶段,EG 的文章质量明显优于 CG,尤其是在内容、词汇和组织方面。此外,虽然教育组在开始阶段主要遇到词汇方面的问题,但在随后的阶段,他们主要集中在与内容相关的和组织方面的特点上。根据研究结果,讨论了对未来研究的建议和对教学法的影响。
{"title":"Exploring the use of model texts as a feedback instrument in expository writing: EFL learners’ noticing, incorporations, and text quality","authors":"","doi":"10.1016/j.asw.2024.100890","DOIUrl":"10.1016/j.asw.2024.100890","url":null,"abstract":"<div><div>Model texts as a feedback instrument (MTFI) have proven effective in enhancing L2 writing, yet research on this domain mainly focused on narrative compositions over a three-stage task: i) composing, ii) comparing, and iii) rewriting. The impact of MTFI on learners’ noticing, incorporations, and text quality in expository writing, especially in the Vietnamese context, remains underexplored. To address these gaps, this study aims to investigate the effect of MTFI on 68 Vietnamese EFL undergraduates’ expository writing following a process-product approach. The participants were divided into a control group (CG, <em>N</em> = 33) and an experimental group (EG, <em>N</em> = 35). Both groups attended stages one and three, but only the EG compared their initial writing with a model text in stage two. The results, derived from learners’ note-taking sheets, written paragraphs, and semi-structured interviews, revealed that despite the two groups’ comparability in stage one, the EG demonstrated significantly better text quality than the CG in stage three, particularly in content, lexis, and organization. Furthermore, while the EG largely encountered lexical issues at the outset, they primarily concentrated on content-related and organizational features in the subsequent stages. Based on the findings, recommendations for future research and implications for pedagogy were deliberated.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142311404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the development of noun phrase complexity in L2 English writings across two genres 探索两种体裁的后二英语写作中名词短语复杂性的发展
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-16 DOI: 10.1016/j.asw.2024.100892

Researchers in second language (L2) writing studies are increasingly focusing on examining complex noun phrases (NPs). However, recent studies on NP complexity show a preference for examining advanced learners’ writings, despite the fact that English writings of early L2 learners already contain many NPs. In the present study, we used a corpus-based approach to investigate the development of NP complexity in argumentative and narrative compositions written by English as a foreign language (EFL) learners with different proficiency levels. The results show that eight NP complexity features presented patterns of growth at different proficiency levels. Among the eight features, attributive adjectives and -ing participles as post-modifiers can both reflect the development and characteristics of Chinese EFL learners’ writings. We also found that genre effect on NP complexity growth was the result of both task-related factors of genres and learners’ genre exposure. Our results largely corroborate the developmental index proposed by Biber et al. (2011), and confirm that NP complexity starts to grow from early stages of learning among L2 English learners with genre-specific features.

第二语言(L2)写作研究人员越来越重视研究复杂的名词短语(NPs)。然而,最近关于 NP 复杂性的研究显示,尽管早期 L2 学习者的英语写作中已经包含了许多 NP,但他们更倾向于研究高级学习者的写作。在本研究中,我们采用基于语料库的方法,研究了不同水平的英语作为外语(EFL)学习者所写的议论文和记叙文中 NP 复杂性的发展。研究结果表明,在不同水平的英语学习者中,有 8 个 NP 复杂性特征呈现出增长模式。在这八个特征中,作为后置修饰语的属性形容词和-ing分词都能反映中国EFL学习者作文的发展和特点。我们还发现,体裁对NP复杂性增长的影响是体裁的任务相关因素和学习者的体裁接触程度共同作用的结果。我们的研究结果在很大程度上印证了Biber等人(2011)提出的发展指数,并证实了NP复杂性在L2英语学习者的早期学习阶段就开始增长,并具有体裁特定的特征。
{"title":"Exploring the development of noun phrase complexity in L2 English writings across two genres","authors":"","doi":"10.1016/j.asw.2024.100892","DOIUrl":"10.1016/j.asw.2024.100892","url":null,"abstract":"<div><p>Researchers in second language (L2) writing studies are increasingly focusing on examining complex noun phrases (NPs). However, recent studies on NP complexity show a preference for examining advanced learners’ writings, despite the fact that English writings of early L2 learners already contain many NPs. In the present study, we used a corpus-based approach to investigate the development of NP complexity in argumentative and narrative compositions written by English as a foreign language (EFL) learners with different proficiency levels. The results show that eight NP complexity features presented patterns of growth at different proficiency levels. Among the eight features, attributive adjectives and -ing participles as post-modifiers can both reflect the development and characteristics of Chinese EFL learners’ writings. We also found that genre effect on NP complexity growth was the result of both task-related factors of genres and learners’ genre exposure. Our results largely corroborate the developmental index proposed by Biber et al. (2011), and confirm that NP complexity starts to grow from early stages of learning among L2 English learners with genre-specific features.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142241243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
L2 master’s and doctoral students’ preferences for supervisor written feedback on their theses/dissertations 语言为第二语言的硕士生和博士生对导师就其论文/毕业论文提供书面反馈意见的偏好
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-11 DOI: 10.1016/j.asw.2024.100891

The present study employed a qualitative research design to investigate possible differences between L2 master’s and doctoral students’ preferences for supervisor written feedback. Although the role of learners’ preferences, as a part of attitudinal engagement, has been emphasized in the literature on feedback, there are still niches in the literature that need to be occupied. One of these gaps is the examination of L2 master’s and doctoral students’ preferences for supervisor written feedback on their theses/dissertations. To bridge this research gap, the researcher interviewed 52 master’s and 21 doctoral Iranian English Language Teaching students. Thematic analysis of the interview data identified five main preferences: feedback that is clear, specific, encouraging, dialogic, and non-appropriative. The examination of interview data showed that both master’s and doctoral students expressed high levels of preference for receiving clear and encouraging feedback. A significantly higher percentage of master’s students expressed their preference for specific comments. In contrast, doctoral students exhibited heightened preferences for non-appropriative and dialogic feedback. The findings also provided insights into the underlying factors that can shape master’s and doctoral students’ preferences. Several practical implications and suggestions for further research are also discussed in this study.

本研究采用了定性研究设计,以调查语言为第二语言的硕士生和博士生对导师书面反馈的偏好可能存在的差异。虽然学习者的偏好作为态度参与的一部分,在有关反馈的文献中得到了强调,但文献中仍有一些空白需要填补。其中一个空白点就是研究语言为第二语言的硕士生和博士生对导师就其论文/毕业论文所做书面反馈的偏好。为了弥补这一研究空白,研究人员采访了 52 名伊朗英语语言教学专业的硕士生和 21 名博士生。通过对访谈数据进行主题分析,确定了五种主要偏好:反馈清晰、具体、鼓励性、对话性和非适当性。对访谈数据的分析表明,硕士生和博士生都非常希望得到清晰和鼓励性的反馈。硕士生表示喜欢具体评论的比例明显更高。与此相反,博士生则更倾向于非适当的和对话性的反馈。研究结果还揭示了影响硕士生和博士生偏好的潜在因素。本研究还讨论了进一步研究的若干实际意义和建议。
{"title":"L2 master’s and doctoral students’ preferences for supervisor written feedback on their theses/dissertations","authors":"","doi":"10.1016/j.asw.2024.100891","DOIUrl":"10.1016/j.asw.2024.100891","url":null,"abstract":"<div><p>The present study employed a qualitative research design to investigate possible differences between L2 master’s and doctoral students’ preferences for supervisor written feedback. Although the role of learners’ preferences, as a part of attitudinal engagement, has been emphasized in the literature on feedback, there are still niches in the literature that need to be occupied. One of these gaps is the examination of L2 master’s and doctoral students’ preferences for supervisor written feedback on their theses/dissertations. To bridge this research gap, the researcher interviewed 52 master’s and 21 doctoral Iranian English Language Teaching students. Thematic analysis of the interview data identified five main preferences: feedback that is clear, specific, encouraging, dialogic, and non-appropriative. The examination of interview data showed that both master’s and doctoral students expressed high levels of preference for receiving clear and encouraging feedback. A significantly higher percentage of master’s students expressed their preference for specific comments. In contrast, doctoral students exhibited heightened preferences for non-appropriative and dialogic feedback. The findings also provided insights into the underlying factors that can shape master’s and doctoral students’ preferences. Several practical implications and suggestions for further research are also discussed in this study.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142168122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of writing feedback literacies on feedback engagement and writing performance: A cross-linguistic perspective 写作反馈素养对反馈参与和写作成绩的影响:跨语言视角
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-09-05 DOI: 10.1016/j.asw.2024.100889

While the educational field has made progress in comprehending student feedback literacy, its impact on feedback engagement and student writing performance remains insufficiently explored. Furthermore, the cross-linguistic perspective has not yet been introduced to the literature on student feedback literacy, even though this approach has seen increased utilization in both L1 and L2 learning research. The current study examined the relationship between L1 and L2 writing feedback literacies and how they may contribute to L2 feedback engagement and L2 writing performance. Data were collected from 231 English major sophomore students from a Chinese university. The structural equation modeling analyses results showed that students’ L1 writing feedback literacy had a positive effect on their L2 writing feedback literacy. Further, L1 writing feedback literacy exerted an indirect effect on L2 writing performance via L2 writing feedback literacy and L2 feedback engagement. These findings underscore the pivotal role of L1 writing feedback literacy in L2 development and provide empirical evidence elucidating the close relationship between student feedback literacy and feedback engagement. The study concludes with pedagogical suggestions based on the observed outcomes.

虽然教育领域在理解学生反馈素养方面取得了进展,但对其对反馈参与和学生写作成绩的影响的探讨仍然不够。此外,跨语言视角尚未被引入学生反馈素养的文献中,尽管这种方法在 L1 和 L2 学习研究中得到了越来越多的应用。本研究探讨了 L1 和 L2 写作反馈素养之间的关系,以及它们如何促进 L2 反馈参与和 L2 写作表现。研究收集了中国某大学英语专业231名大二学生的数据。结构方程模型分析结果显示,学生的L1写作反馈素养对其L2写作反馈素养有积极影响。此外,L1写作反馈素养通过L2写作反馈素养和L2反馈参与对L2写作成绩产生间接影响。这些发现强调了L1写作反馈素养在L2发展中的关键作用,并为阐明学生反馈素养与反馈参与之间的密切关系提供了实证证据。研究最后根据观察到的结果提出了教学建议。
{"title":"Effects of writing feedback literacies on feedback engagement and writing performance: A cross-linguistic perspective","authors":"","doi":"10.1016/j.asw.2024.100889","DOIUrl":"10.1016/j.asw.2024.100889","url":null,"abstract":"<div><p>While the educational field has made progress in comprehending student feedback literacy, its impact on feedback engagement and student writing performance remains insufficiently explored. Furthermore, the cross-linguistic perspective has not yet been introduced to the literature on student feedback literacy, even though this approach has seen increased utilization in both L1 and L2 learning research. The current study examined the relationship between L1 and L2 writing feedback literacies and how they may contribute to L2 feedback engagement and L2 writing performance. Data were collected from 231 English major sophomore students from a Chinese university. The structural equation modeling analyses results showed that students’ L1 writing feedback literacy had a positive effect on their L2 writing feedback literacy. Further, L1 writing feedback literacy exerted an indirect effect on L2 writing performance via L2 writing feedback literacy and L2 feedback engagement. These findings underscore the pivotal role of L1 writing feedback literacy in L2 development and provide empirical evidence elucidating the close relationship between student feedback literacy and feedback engagement. The study concludes with pedagogical suggestions based on the observed outcomes.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142149877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the multi-dimensional human mind: Model-based and text-based approaches 探索多维人类思维:基于模型和基于文本的方法
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-01 DOI: 10.1016/j.asw.2024.100878

In this study, we conceptualize two approaches, model-based and text-based, grounded on mental models and discourse comprehension theories, to computerized summary analysis. We juxtapose the model-based approach with the text-based approach to explore shared knowledge dimensions and associated measures from both approaches and use them to examine changes in students' summaries over time. We used 108 cases in which we computed model-based and text-based measures for two versions of students' summaries (i.e., initial and final revisions), resulting in a total of 216 observations. We used correlations, Principal Components Analysis (PCA), and Linear Mixed-Effects models. This exploratory investigation suggested a shortlist of text-based measures, and the findings of the PCA demonstrated that both model-based and text-based measures explained the three-dimensional model (i.e., surface, structure, and semantic). Overall, model-based measures were better for tracking changes in the surface dimension, while text-based measures were descriptive of the structure dimension. Both approaches worked well for the semantic dimension. The tested text-based measures can serve as a cross-reference to evaluate students' summaries along with the model-based measures. The current study shows the potential of using multidimensional measures to provide formative feedback on students' knowledge structure and writing styles along the three dimensions.

在本研究中,我们以心智模型和话语理解理论为基础,将基于模型和基于文本的两种方法概念化,用于计算机化摘要分析。我们将基于模型的方法与基于文本的方法并列,以探索这两种方法的共享知识维度和相关测量方法,并用它们来研究学生摘要随时间的变化。我们使用了 108 个案例,对两个版本的学生总结(即初始和最终修订版)计算了基于模型和基于文本的测量值,共得出 216 个观测值。我们使用了相关分析、主成分分析(PCA)和线性混合效应模型。这项探索性调查提出了一份基于文本的衡量标准短名单,PCA 的结果表明,基于模型的衡量标准和基于文本的衡量标准都能解释三维模型(即表面、结构和语义)。总体而言,基于模型的测量方法更适合跟踪表面维度的变化,而基于文本的测量方法则能描述结构维度的变化。这两种方法在语义维度上都有很好的效果。经过测试的基于文本的测量方法可以作为交叉参考,与基于模型的测量方法一起评估学生的摘要。目前的研究表明,使用多维度测量方法可以对学生在三个维度上的知识结构和写作风格提供形成性反馈。
{"title":"Exploring the multi-dimensional human mind: Model-based and text-based approaches","authors":"","doi":"10.1016/j.asw.2024.100878","DOIUrl":"10.1016/j.asw.2024.100878","url":null,"abstract":"<div><p>In this study, we conceptualize two approaches, model-based and text-based, grounded on mental models and discourse comprehension theories, to computerized summary analysis. We juxtapose the model-based approach with the text-based approach to explore shared knowledge dimensions and associated measures from both approaches and use them to examine changes in students' summaries over time. We used 108 cases in which we computed model-based and text-based measures for two versions of students' summaries (i.e., initial and final revisions), resulting in a total of 216 observations. We used correlations, Principal Components Analysis (PCA), and Linear Mixed-Effects models. This exploratory investigation suggested a shortlist of text-based measures, and the findings of the PCA demonstrated that both model-based and text-based measures explained the three-dimensional model (i.e., surface, structure, and semantic). Overall, model-based measures were better for tracking changes in the surface dimension, while text-based measures were descriptive of the structure dimension. Both approaches worked well for the semantic dimension. The tested text-based measures can serve as a cross-reference to evaluate students' summaries along with the model-based measures. The current study shows the potential of using multidimensional measures to provide formative feedback on students' knowledge structure and writing styles along the three dimensions.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141954088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Corrigendum to “Assessing metacognition-based student feedback literacy for academic writing” [Assessing Writing 59 (2024) 100811] 基于元认知的学生学术写作反馈素养评估》更正 [Assessing Writing 59 (2024) 100811]
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-01 DOI: 10.1016/j.asw.2024.100869
{"title":"Corrigendum to “Assessing metacognition-based student feedback literacy for academic writing” [Assessing Writing 59 (2024) 100811]","authors":"","doi":"10.1016/j.asw.2024.100869","DOIUrl":"10.1016/j.asw.2024.100869","url":null,"abstract":"","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S107529352400062X/pdfft?md5=bf2d5c4044b982a0307751dcc279b061&pid=1-s2.0-S107529352400062X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142095273","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Examining teacher’s evaluative language in written, audio and screencast feedback on EFL learners’ writing from the appraisal framework: A linguistic perspective 从评价框架审视教师在书面、音频和截屏反馈中对英语学习者写作的评价性语言:语言学视角
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-01 DOI: 10.1016/j.asw.2024.100871
Murad Abdu Saeed , Atef AbuSa'aleek , Mohammed Abdullah Alharbi

Technology facilitates teacher corrective feedback on students' writing, but there is a need to examine how written, audio and screencast modes affect teacher's evaluative language of electronic (e-) feedback from linguistic approaches. By using the engagement resources of the appraisal framework within Systemic Functional Linguistics, this study examined the effect of written, audio and screencast modes on the instructor's evaluative language in his e-feedback on writing and the text revisions of 15 pairs of Saudi EFL learners. The linguistic analysis of the e-feedback revealed that the instructor's engagement resources differed across the three e-feedback modes. Specifically, the screencast and audio e-feedback modes were dominated by expanding resources (resources expanding the space for dialogue) as opposed to the prevalence of contracting resources (resources limiting/shutting down the space for dialogue) in the written feedback mode. Moreover, the audio and screencast feedback modes contained more statements and suggestions whereas the written feedback mode was dominated by commands/orders and suggested corrections. The content analysis revealed that the screencast e-feedback mode addressed a higher number of global issues in writing; however, the audio and written e-feedback modes addressed a higher number of local issues in writing. Despite the higher overall rate of successful text revisions resulting from the screencast and audio e-feedback modes, no significant differences were found except in relation to students' global text revisions. The study offers useful pedagogical implications for instructors in effectively responding to students' writing.

技术为教师纠正学生的写作提供了便利,但有必要从语言学的角度研究书面、音频和截屏模式如何影响教师对电子(e-)反馈的评价性语言。本研究利用系统功能语言学评价框架中的参与资源,考察了书面、音频和截屏模式对教师在对 15 对沙特 EFL 学习者的写作和文本修改进行电子反馈时的评价性语言的影响。对电子反馈的语言分析表明,在三种电子反馈模式中,教师的参与资源各不相同。具体而言,截屏和音频电子反馈模式以扩展资源(扩大对话空间的资源)为主,而书面反馈模式则以收缩资源(限制/关闭对话空间的资源)为主。此外,音频和截屏反馈模式包含更多的陈述和建议,而书面反馈模式则以命令/指令和建议更正为主。内容分析显示,截屏电子反馈模式解决了更多写作中的全局性问题;然而,音频和书面电子反馈模式解决了更多写作中的局部性问题。尽管截屏电子反馈模式和音频电子反馈模式的总体文本修改成功率更高,但除了学生的全局性文本修改外,没有发现其他显著差异。这项研究为教师有效回应学生的写作提供了有益的教学启示。
{"title":"Examining teacher’s evaluative language in written, audio and screencast feedback on EFL learners’ writing from the appraisal framework: A linguistic perspective","authors":"Murad Abdu Saeed ,&nbsp;Atef AbuSa'aleek ,&nbsp;Mohammed Abdullah Alharbi","doi":"10.1016/j.asw.2024.100871","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100871","url":null,"abstract":"<div><p>Technology facilitates teacher corrective feedback on students' writing, but there is a need to examine how written, audio and screencast modes affect teacher's evaluative language of electronic (e-) feedback from linguistic approaches. By using the engagement resources of the appraisal framework within Systemic Functional Linguistics, this study examined the effect of written, audio and screencast modes on the instructor's evaluative language in his e-feedback on writing and the text revisions of 15 pairs of Saudi EFL learners. The linguistic analysis of the e-feedback revealed that the instructor's engagement resources differed across the three e-feedback modes. Specifically, the screencast and audio e-feedback modes were dominated by expanding resources (resources expanding the space for dialogue) as opposed to the prevalence of contracting resources (resources limiting/shutting down the space for dialogue) in the written feedback mode. Moreover, the audio and screencast feedback modes contained more statements and suggestions whereas the written feedback mode was dominated by commands/orders and suggested corrections. The content analysis revealed that the screencast e-feedback mode addressed a higher number of global issues in writing; however, the audio and written e-feedback modes addressed a higher number of local issues in writing. Despite the higher overall rate of successful text revisions resulting from the screencast and audio e-feedback modes, no significant differences were found except in relation to students' global text revisions. The study offers useful pedagogical implications for instructors in effectively responding to students' writing.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141543227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Beyond accuracy gains: Investigating the impact of individual and collaborative feedback processing on L2 writing development 超越准确性的提高:调查个人和协作反馈处理对 L2 写作发展的影响
IF 4.2 1区 文学 Q1 EDUCATION & EDUCATIONAL RESEARCH Pub Date : 2024-07-01 DOI: 10.1016/j.asw.2024.100876

Despite the burgeoning research on exploring learner engagement with feedback, how second language (L2) learners’ engagement with feedback in different processing conditions influences their subsequent writing development is under-explored. This study examines the effects of individual and collaborative processing (languaging) of teacher feedback on Chinese lower-secondary school EFL learners’ writing development. Eighty-one students aged 13–14 with A1-A2 levels of English proficiency (according to the Common European Framework of Reference) from two classes and two experienced English teachers participated in the study. Students were provided with comprehensive teacher feedback and were asked to process feedback provided on three writing tasks through either individual written or collaborative oral languaging over six weeks. Pre-, post-, and delayed post-tests were administered. Students’ writing development was analysed using complexity, accuracy, and fluency measures, as well as content and organisation writing scores. Findings showed that the two conditions did not influence students’ writing complexity and fluency differently, while only the collaborative oral languaging condition contributed to students’ sustainable accuracy gains. Results based on the analytic writing scores suggested that students in the two conditions significantly improved content and organisation scores over time. Pedagogical and research implications regarding implementing the two feedback processing conditions are discussed.

尽管探索学习者参与反馈的研究方兴未艾,但对第二语言(L2)学习者在不同处理条件下参与反馈如何影响其后续写作发展的研究尚不充分。本研究探讨了个人和合作处理(语言处理)教师反馈对中国初中 EFL 学习者写作发展的影响。来自两个班级、年龄在 13-14 岁、英语水平在 A1-A2 级(根据《欧洲共同参考框架》)的 81 名学生和两名经验丰富的英语教师参与了本研究。学生们获得了教师提供的全面反馈,并被要求在六周内通过个人书面或合作口头语言来处理针对三项写作任务提供的反馈。进行了前测、后测和延迟后测。通过复杂性、准确性、流畅性以及写作内容和组织得分,对学生的写作发展进行了分析。结果表明,两种条件对学生写作的复杂性和流畅性没有不同的影响,而只有口头语言协作条件有助于学生持续提高写作的准确性。基于分析性写作得分的结果表明,随着时间的推移,两种条件下的学生在内容和组织方面的得分都有显著提高。本文讨论了实施两种反馈处理条件的教学和研究意义。
{"title":"Beyond accuracy gains: Investigating the impact of individual and collaborative feedback processing on L2 writing development","authors":"","doi":"10.1016/j.asw.2024.100876","DOIUrl":"10.1016/j.asw.2024.100876","url":null,"abstract":"<div><p>Despite the burgeoning research on exploring learner engagement with feedback, how second language (L2) learners’ engagement with feedback in different processing conditions influences their subsequent writing development is under-explored. This study examines the effects of individual and collaborative processing (languaging) of teacher feedback on Chinese lower-secondary school EFL learners’ writing development. Eighty-one students aged 13–14 with A1-A2 levels of English proficiency (according to the Common European Framework of Reference) from two classes and two experienced English teachers participated in the study. Students were provided with comprehensive teacher feedback and were asked to process feedback provided on three writing tasks through either individual written or collaborative oral languaging over six weeks. Pre-, post-, and delayed post-tests were administered. Students’ writing development was analysed using complexity, accuracy, and fluency measures, as well as content and organisation writing scores. Findings showed that the two conditions did not influence students’ writing complexity and fluency differently, while only the collaborative oral languaging condition contributed to students’ sustainable accuracy gains. Results based on the analytic writing scores suggested that students in the two conditions significantly improved content and organisation scores over time. Pedagogical and research implications regarding implementing the two feedback processing conditions are discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":null,"pages":null},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000692/pdfft?md5=f166583fc6f801f5b2a71d5e058cf1ce&pid=1-s2.0-S1075293524000692-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141844063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Assessing Writing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1