Assessing Writing最新文献

英文中文

Assessing academic language in tenth grade essays using natural language processing

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-28 DOI: 10.1016/j.asw.2025.100921

Andrew Potter , Mitchell Shortt , Maria Goldshtein , Rod D. Roscoe

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to which features related to academic language explained variance in human-assigned scores of writing quality in a large corpus of source-based argumentative essays (n = 20,820) written by 10th grade students. Using NLP tools, we identified and then calculated linguistic features from essays related to the lexical, syntactic, cohesion, and rhetorical features of academic language. Consistent with prior research findings, results from a hierarchical linear regression revealed that AL features explained 8 % of variance in writing quality when controlling for essay length. The most important AL features included cohesion with the source text, academic wording, and global cohesion. Implications for integrating NLP-produced measures of AL in writing assessment and automated writing evaluation (AWE) systems are discussed.

{"title":"Assessing academic language in tenth grade essays using natural language processing","authors":"Andrew Potter , Mitchell Shortt , Maria Goldshtein , Rod D. Roscoe","doi":"10.1016/j.asw.2025.100921","DOIUrl":"10.1016/j.asw.2025.100921","url":null,"abstract":"<div><div>Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to which features related to academic language explained variance in human-assigned scores of writing quality in a large corpus of source-based argumentative essays (n = 20,820) written by 10th grade students. Using NLP tools, we identified and then calculated linguistic features from essays related to the lexical, syntactic, cohesion, and rhetorical features of academic language. Consistent with prior research findings, results from a hierarchical linear regression revealed that AL features explained 8 % of variance in writing quality when controlling for essay length. The most important AL features included cohesion with the source text, academic wording, and global cohesion. Implications for integrating NLP-produced measures of AL in writing assessment and automated writing evaluation (AWE) systems are discussed.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100921"},"PeriodicalIF":4.2,"publicationDate":"2025-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143519751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Predicting inappropriate source use from scores of language use, source comprehension, and organizational features: A study using generalized linear models

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-25 DOI: 10.1016/j.asw.2025.100934

Kwangmin Lee , Ray J.T. Liao , I.-Chun Vera Hsiao , Junhee Park , Yafei Ye

This paper examines the extent to which inappropriate source use – verbatim source use and patchwriting – can be predicted by scores of other textual features that are commonly evaluated in second/foreign language (L2) integrated writing assessment. 246 advanced-level English as a Foreign Language (EFL) test-takers enrolled in a Chinese higher education institution provided integrated essays that required both summary and argumentation. All the collected essays were rated by two experienced raters and checked for interrater reliability by way of generalizability theory. Then, a series of generalized linear models was compared to identify the best-fitting model that explained the relationship between the independent variables and inappropriate source use. Results indicated that the zero-inflated beta-binomial provided the best fit to the data, with approximately 43.67 % of the data estimated to be an extra zero. Next, parameter estimates of this model included (1) non-significant effects of language use and source comprehension on inappropriate source use and (2) a significantly negative effect of organizational features on the dependent variable. This suggests that focusing on organizational features, operationalized herein as organization, coherence, development of ideas, and authorial voice, can help L2 test-takers reduce reliance on inappropriate source use. Implications for research and practice are discussed.

{"title":"Predicting inappropriate source use from scores of language use, source comprehension, and organizational features: A study using generalized linear models","authors":"Kwangmin Lee , Ray J.T. Liao , I.-Chun Vera Hsiao , Junhee Park , Yafei Ye","doi":"10.1016/j.asw.2025.100934","DOIUrl":"10.1016/j.asw.2025.100934","url":null,"abstract":"<div><div>This paper examines the extent to which inappropriate source use – verbatim source use and patchwriting – can be predicted by scores of other textual features that are commonly evaluated in second/foreign language (L2) integrated writing assessment. 246 advanced-level English as a Foreign Language (EFL) test-takers enrolled in a Chinese higher education institution provided integrated essays that required both summary and argumentation. All the collected essays were rated by two experienced raters and checked for interrater reliability by way of generalizability theory. Then, a series of generalized linear models was compared to identify the best-fitting model that explained the relationship between the independent variables and inappropriate source use. Results indicated that the zero-inflated beta-binomial provided the best fit to the data, with approximately 43.67 % of the data estimated to be an extra zero. Next, parameter estimates of this model included (1) non-significant effects of <em>language use</em> and <em>source comprehension</em> on inappropriate source use and (2) a significantly negative effect of <em>organizational features</em> on the dependent variable. This suggests that focusing on <em>organizational features</em>, operationalized herein as organization, coherence, development of ideas, and authorial voice, can help L2 test-takers reduce reliance on inappropriate source use. Implications for research and practice are discussed.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100934"},"PeriodicalIF":4.2,"publicationDate":"2025-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143488644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Towards a better understanding of integrated writing performance: The influence of literacy strategy use and independent language skills

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-12 DOI: 10.1016/j.asw.2025.100922

Xinhua Zhu , Yiwen Sun , Yaping Liu , Wandong Xu , Choo Mui Cheong

This study explores the influence mechanism of literacy strategy use and independent language skills (e.g., reading and writing) on integrated writing (IW) performance. 322 Secondary Four students from four schools in Hong Kong completed single-text reading, multiple-text reading, independent writing, and IW tasks, along with questionnaires investigating their reading strategy use and IW strategy use. Path analyses revealed that multiple-text reading and independent writing had comparable significant impacts on IW, mediating the influence of single-text comprehension. In addition, reading strategy use impacted IW indirectly through independent literacy skills and IW strategy use, while IW strategies exerted a direct influence on IW. Our findings underscore the critical role of language skills in mediating the influence of reading strategies on IW performance among young first language (L1) learners. The implications for research and practice, are discussed, emphasizing the complexity of the IW construct and the need for balanced language skills and strategy instruction to enhance IW task performance.

{"title":"Towards a better understanding of integrated writing performance: The influence of literacy strategy use and independent language skills","authors":"Xinhua Zhu , Yiwen Sun , Yaping Liu , Wandong Xu , Choo Mui Cheong","doi":"10.1016/j.asw.2025.100922","DOIUrl":"10.1016/j.asw.2025.100922","url":null,"abstract":"<div><div>This study explores the influence mechanism of literacy strategy use and independent language skills (e.g., reading and writing) on integrated writing (IW) performance. 322 Secondary Four students from four schools in Hong Kong completed single-text reading, multiple-text reading, independent writing, and IW tasks, along with questionnaires investigating their reading strategy use and IW strategy use. Path analyses revealed that multiple-text reading and independent writing had comparable significant impacts on IW, mediating the influence of single-text comprehension. In addition, reading strategy use impacted IW indirectly through independent literacy skills and IW strategy use, while IW strategies exerted a direct influence on IW. Our findings underscore the critical role of language skills in mediating the influence of reading strategies on IW performance among young first language (L1) learners. The implications for research and practice, are discussed, emphasizing the complexity of the IW construct and the need for balanced language skills and strategy instruction to enhance IW task performance.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100922"},"PeriodicalIF":4.2,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143394388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Designing a rating scale for an integrated reading-writing test: A needs-oriented approach

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-12 DOI: 10.1016/j.asw.2025.100918

Aynur Ismayilli Karakoҫ , Peter Gu , Rachael Ruegg

To meet the current trends in higher education, there is accountability on EAP programmes to prepare and assess students’ access to higher education. Thus, multimodal tasks including integrated writing (IW) assessments have seen a resurgence because they arguably closely mirror academic writing. However, test practicality constraints and variability in the use and format of these assessments mean rating scales often fall short in substantiating the central claims of IW assessment. We developed an integrated reading-writing scale taking into account reading-writing requirements and empirical research on IW tests designed to assess readiness for first-year humanities and social science courses. We approached test development as part of the ongoing validation efforts, detailing the considerations involved in the scale development process. We argue that alignment with academic writing requirements should guide the development of IW tests, thereby acknowledging and comprehending nuances of academic writing. The paper demonstrates considerations and decisions in scale design as the validation process from the start, which is a reminder that assessment is not just a quantitative exercise but a multifaceted process.

{"title":"Designing a rating scale for an integrated reading-writing test: A needs-oriented approach","authors":"Aynur Ismayilli Karakoҫ , Peter Gu , Rachael Ruegg","doi":"10.1016/j.asw.2025.100918","DOIUrl":"10.1016/j.asw.2025.100918","url":null,"abstract":"<div><div>To meet the current trends in higher education, there is accountability on EAP programmes to prepare and assess students’ access to higher education. Thus, multimodal tasks including integrated writing (IW) assessments have seen a resurgence because they arguably closely mirror academic writing. However, test practicality constraints and variability in the use and format of these assessments mean rating scales often fall short in substantiating the central claims of IW assessment. We developed an integrated reading-writing scale taking into account reading-writing requirements and empirical research on IW tests designed to assess readiness for first-year humanities and social science courses. We approached test development as part of the ongoing validation efforts, detailing the considerations involved in the scale development process. We argue that alignment with academic writing requirements should guide the development of IW tests, thereby acknowledging and comprehending nuances of academic writing. The paper demonstrates considerations and decisions in scale design as the validation process from the start, which is a reminder that assessment is not just a quantitative exercise but a multifaceted process.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100918"},"PeriodicalIF":4.2,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143394387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Modeling the interplay between teacher support, anxiety and grit in predicting feedback-seeking behavior in L2 writing

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-11 DOI: 10.1016/j.asw.2025.100920

Ya Zhang , Zhanhao Jiang

The introduction of feedback-seeking behavior (FSB) into second language (L2) writing has advanced the understanding of the role of learners as proactive seekers rather than passive recipients of feedback. Nevertheless, the existing literature has primarily focused on identifying personal conative factors as antecedents of FSB in L2 writing, often neglecting the impact of environmental, emotional, and personality trait variables. To address this gap, this study recruited 213 English as a foreign language (EFL) learners to examine how an environmental factor (EFL teacher support), a personal emotional factor (anxiety), and a personal personality factor (grit) individually and jointly predict FSB in L2 writing within the Chinese tertiary context. Structural equation modeling (SEM) results revealed that EFL teacher support directly and positively predicted the two dimensions of FSB, viz. feedback monitoring and feedback inquiry. The mediation analysis demonstrated that EFL teacher support indirectly predicted the two dimensions of FSB via the sole mediation of grit and via the chain mediation of grit and anxiety. However, anxiety did not exhibit a significant mediating effect between EFL teacher support and the two dimensions of FSB. The implications for L2 writing instruction are discussed, and potential avenues for future research are identified.

{"title":"Modeling the interplay between teacher support, anxiety and grit in predicting feedback-seeking behavior in L2 writing","authors":"Ya Zhang , Zhanhao Jiang","doi":"10.1016/j.asw.2025.100920","DOIUrl":"10.1016/j.asw.2025.100920","url":null,"abstract":"<div><div>The introduction of feedback-seeking behavior (FSB) into second language (L2) writing has advanced the understanding of the role of learners as proactive seekers rather than passive recipients of feedback. Nevertheless, the existing literature has primarily focused on identifying personal conative factors as antecedents of FSB in L2 writing, often neglecting the impact of environmental, emotional, and personality trait variables. To address this gap, this study recruited 213 English as a foreign language (EFL) learners to examine how an environmental factor (EFL teacher support), a personal emotional factor (anxiety), and a personal personality factor (grit) individually and jointly predict FSB in L2 writing within the Chinese tertiary context. Structural equation modeling (SEM) results revealed that EFL teacher support directly and positively predicted the two dimensions of FSB, viz. feedback monitoring and feedback inquiry. The mediation analysis demonstrated that EFL teacher support indirectly predicted the two dimensions of FSB via the sole mediation of grit and via the chain mediation of grit and anxiety. However, anxiety did not exhibit a significant mediating effect between EFL teacher support and the two dimensions of FSB. The implications for L2 writing instruction are discussed, and potential avenues for future research are identified.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100920"},"PeriodicalIF":4.2,"publicationDate":"2025-02-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143378797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Validation of the individual and collective self-efficacy scale for teaching writing in post-secondary faculty

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-10 DOI: 10.1016/j.asw.2025.100923

Kim M. Mitchell , Johnson Li , Rasheda Rabbani

Faculty actions in the classroom are known to impact student writing self-efficacy and academic achievement. The purpose of this paper was to validate Locke and Johnston’s Individual and Collective Self-Efficacy for Teaching Writing Scales, a tool originally validated in high school teachers, in a new population of post-secondary faculty. Exploratory and confirmatory factor analysis methods were used in two studies with independent samples of multidisciplinary faculty (N = 281) for the exploratory factor analysis (Study 1) and nursing discipline specific faculty (N = 187) for the confirmatory factor analysis (Study 2). Three factors were identified in the questionnaire which maintained the essence of the theoretical structure proposed by Locke and Johnston. Factor 1 was named Context and Process Competencies, Factor 2 Textural Competencies, and Factor 3 Motivational Competencies. This factor structure was confirmed with acceptable goodness of fit in the confirmatory factor analysis Study 2. Learning to be a teacher of writing is a developmental process and this measurement tool has important validation information that speaks to its usefulness in understanding that process.

{"title":"Validation of the individual and collective self-efficacy scale for teaching writing in post-secondary faculty","authors":"Kim M. Mitchell , Johnson Li , Rasheda Rabbani","doi":"10.1016/j.asw.2025.100923","DOIUrl":"10.1016/j.asw.2025.100923","url":null,"abstract":"<div><div>Faculty actions in the classroom are known to impact student writing self-efficacy and academic achievement. The purpose of this paper was to validate Locke and Johnston’s Individual and Collective Self-Efficacy for Teaching Writing Scales, a tool originally validated in high school teachers, in a new population of post-secondary faculty. Exploratory and confirmatory factor analysis methods were used in two studies with independent samples of multidisciplinary faculty (N = 281) for the exploratory factor analysis (Study 1) and nursing discipline specific faculty (N = 187) for the confirmatory factor analysis (Study 2). Three factors were identified in the questionnaire which maintained the essence of the theoretical structure proposed by Locke and Johnston. Factor 1 was named Context and Process Competencies, Factor 2 Textural Competencies, and Factor 3 Motivational Competencies. This factor structure was confirmed with acceptable goodness of fit in the confirmatory factor analysis Study 2. Learning to be a teacher of writing is a developmental process and this measurement tool has important validation information that speaks to its usefulness in understanding that process.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100923"},"PeriodicalIF":4.2,"publicationDate":"2025-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143378798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

How L2 student writers engage with automated feedback: A longitudinal perspective

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-02-07 DOI: 10.1016/j.asw.2025.100919

Li Xiaosa , Ke Ping

Recent qualitative research on L2 students’ use of AWE (automated writing evaluation) feedback reveals that learner engagement is not simply a binary process of accepting or rejecting suggestions; rather, it is influenced by various individual and contextual factors. Building on this foundation, the present study investigates how three Chinese EFL (English as a foreign language) learners at different proficiency levels engaged with feedback from Youdao Writing, a local AWE system, over a 16-week semester. Data were collected through screen-capture recordings, stimulated recalls and semi-structured interviews, focusing on their engagement at the affective, behavioral and cognitive levels. The findings reveal significant individual and longitudinal differences in the students’ experiences, perceptions, and emotional responses. These insights highlight the complexity of student engagement with automated feedback and suggest that instructional practices in EFL contexts should account for these individual and longitudinal differences to enhance the effectiveness of feedback. The study concludes with recommendations for integrating AWE feedback in a way that can foster deeper learner engagement and facilitate writing development.

{"title":"How L2 student writers engage with automated feedback: A longitudinal perspective","authors":"Li Xiaosa , Ke Ping","doi":"10.1016/j.asw.2025.100919","DOIUrl":"10.1016/j.asw.2025.100919","url":null,"abstract":"<div><div>Recent qualitative research on L2 students’ use of AWE (automated writing evaluation) feedback reveals that learner engagement is not simply a binary process of accepting or rejecting suggestions; rather, it is influenced by various individual and contextual factors. Building on this foundation, the present study investigates how three Chinese EFL (English as a foreign language) learners at different proficiency levels engaged with feedback from <em>Youdao Writing</em>, a local AWE system, over a 16-week semester. Data were collected through screen-capture recordings, stimulated recalls and semi-structured interviews, focusing on their engagement at the affective, behavioral and cognitive levels. The findings reveal significant individual and longitudinal differences in the students’ experiences, perceptions, and emotional responses. These insights highlight the complexity of student engagement with automated feedback and suggest that instructional practices in EFL contexts should account for these individual and longitudinal differences to enhance the effectiveness of feedback. The study concludes with recommendations for integrating AWE feedback in a way that can foster deeper learner engagement and facilitate writing development.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100919"},"PeriodicalIF":4.2,"publicationDate":"2025-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143223731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The influence of working memory and proficiency on phraseological growth: A longitudinal study of adjective-noun combinations in Chinese EFL learners’ argumentative writing

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-01-29 DOI: 10.1016/j.asw.2025.100915

Lujie Zheng , Sheena Kaur , Azlin Zaiti Zainal

Phraseological knowledge has gained popularity as a critical predictor of writing assessment in second and foreign language (L2/FL) learner corpus research. However, past phraseological studies on learners with different levels of language competency have overlooked multidimensional collocational indices and the potential influence of cognitive characteristics. This study, employing multiple collocational measures, tracks the growth of adjective-noun combinations in the English argumentative writings of a longitudinal cohort of 148 Chinese EFL learners over four months and explores the effects of language proficiency and working memory (WM) on their phraseological growth. Our findings revealed a general upward pattern in learners’ overall development, despite some slight fluctuations. Notably, the mixed-effects models indicated that time alone had a negative impact on learners’ use of high-frequency, diverse, and strongly associated combinations. However, language proficiency and WM modulated this process, as learners with higher proficiency or greater WM demonstrated temporal improvement across most indices. The interplay among time, language proficiency, and WM presented a more complex image in which high-proficient learners showed a sloping trend on all collocational variables as WM capacity increased, suggesting a potential impact of cognitive overload. These findings offer valuable insights for teaching and identify prospective directions for future research into phraseological knowledge development.

{"title":"The influence of working memory and proficiency on phraseological growth: A longitudinal study of adjective-noun combinations in Chinese EFL learners’ argumentative writing","authors":"Lujie Zheng , Sheena Kaur , Azlin Zaiti Zainal","doi":"10.1016/j.asw.2025.100915","DOIUrl":"10.1016/j.asw.2025.100915","url":null,"abstract":"<div><div>Phraseological knowledge has gained popularity as a critical predictor of writing assessment in second and foreign language (L2/FL) learner corpus research. However, past phraseological studies on learners with different levels of language competency have overlooked multidimensional collocational indices and the potential influence of cognitive characteristics. This study, employing multiple collocational measures, tracks the growth of adjective-noun combinations in the English argumentative writings of a longitudinal cohort of 148 Chinese EFL learners over four months and explores the effects of language proficiency and working memory (WM) on their phraseological growth. Our findings revealed a general upward pattern in learners’ overall development, despite some slight fluctuations. Notably, the mixed-effects models indicated that time alone had a negative impact on learners’ use of high-frequency, diverse, and strongly associated combinations. However, language proficiency and WM modulated this process, as learners with higher proficiency or greater WM demonstrated temporal improvement across most indices. The interplay among time, language proficiency, and WM presented a more complex image in which high-proficient learners showed a sloping trend on all collocational variables as WM capacity increased, suggesting a potential impact of cognitive overload. These findings offer valuable insights for teaching and identify prospective directions for future research into phraseological knowledge development.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100915"},"PeriodicalIF":4.2,"publicationDate":"2025-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143129908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Does student assessment literacy matter between motivational constructs and engagement in L2 writing? A survey of Chinese EFL undergraduates

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-01-27 DOI: 10.1016/j.asw.2025.100916

Jian Xu , Yao Zheng

While the literature has established the impacts of L2 motivation, growth mindsets, and academic buoyancy on engagement, their relationships in L2 writing contexts remain relatively under-explored. Additionally, the potential mediating role of student writing assessment literacy (SWAL) in the aforementioned relationships warrants further investigation. Therefore, the present study aims to examine both the direct and indirect relationships among L2 writing motivation, growth mindsets, academic buoyancy, SWAL, and engagement as perceived by university students through questionnaire survey. Questionnaire data were gathered from a sample of 425 university students, with structural equation modeling employed for data analysis. Regarding the direct relationships, results showed that L2 writing motivation, growth mindsets, academic buoyancy, and SWAL all positively predicted L2 writing engagement; only L2 writing motivation and academic buoyancy positively predicted SWAL. In terms of the indirect relationships, SWAL mediated the relationship between L2 writing motivation and engagement, and between academic buoyancy and L2 writing engagement. Gender did not result in variations in the mediation model. Pedagogical implications for improving students’ writing motivation, assessment literacy, and engagement are discussed.

{"title":"Does student assessment literacy matter between motivational constructs and engagement in L2 writing? A survey of Chinese EFL undergraduates","authors":"Jian Xu , Yao Zheng","doi":"10.1016/j.asw.2025.100916","DOIUrl":"10.1016/j.asw.2025.100916","url":null,"abstract":"<div><div>While the literature has established the impacts of L2 motivation, growth mindsets, and academic buoyancy on engagement, their relationships in L2 writing contexts remain relatively under-explored. Additionally, the potential mediating role of student writing assessment literacy (SWAL) in the aforementioned relationships warrants further investigation. Therefore, the present study aims to examine both the direct and indirect relationships among L2 writing motivation, growth mindsets, academic buoyancy, SWAL, and engagement as perceived by university students through questionnaire survey. Questionnaire data were gathered from a sample of 425 university students, with structural equation modeling employed for data analysis. Regarding the direct relationships, results showed that L2 writing motivation, growth mindsets, academic buoyancy, and SWAL all positively predicted L2 writing engagement; only L2 writing motivation and academic buoyancy positively predicted SWAL. In terms of the indirect relationships, SWAL mediated the relationship between L2 writing motivation and engagement, and between academic buoyancy and L2 writing engagement. Gender did not result in variations in the mediation model. Pedagogical implications for improving students’ writing motivation, assessment literacy, and engagement are discussed.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"64 ","pages":"Article 100916"},"PeriodicalIF":4.2,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143129909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Investigating the effectiveness of scaffolded feedback on EFL Saudi students' writing accuracy: A longitudinal classroom-based study

IF 4.2 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Assessing Writing

Pub Date : 2025-01-01 DOI: 10.1016/j.asw.2024.100910

Abdulaziz Alshahrani , Neomy Storch

Despite the growing body of research on feedback provided to L2 learners on their writing, few studies have investigated the use of a scaffolded approach to feedback. Sociocultural scholars argue that for feedback to be effective it needs to be scaffolded – dynamic and aligned to the learner’s ability to correct their errors (Aljaafreh & Lantolf, 1994). Although research on scaffolded feedback have found it to improve L2 writing accuracy, most of this research has been small-scale, using one-on-one conferences. This larger classroom-based study aimed to examine the effectiveness of scaffolded written feedback and students’ perceptions of this feedback approach. The study was quasi-experimental and implemented over one academic semester. The participants were 71 male students of intermediate English proficiency, majoring in English at a large Saudi university. They were divided into two groups: one group received scaffolded feedback; the other group received unscaffolded (indirect) feedback. The feedback targeted eight grammatical structures. Findings from the immediate and delayed post-tests showed that both groups improved in their overall writing accuracy over time, with no difference evident between the two groups. Moreover, both groups showed similar improvements in six of the eight targeted grammatical structures. The scaffolded feedback group showed greater improvement than their counterparts only on two structures: subject-verb agreement and singular-plural agreement. Interview findings showed that the scaffolded feedback group liked this approach mainly because of its novelty but preferred scaffolding only when it increased in explicitness. We conclude by considering whether and how scaffolded feedback can be provided in classroom settings.

{"title":"Investigating the effectiveness of scaffolded feedback on EFL Saudi students' writing accuracy: A longitudinal classroom-based study","authors":"Abdulaziz Alshahrani , Neomy Storch","doi":"10.1016/j.asw.2024.100910","DOIUrl":"10.1016/j.asw.2024.100910","url":null,"abstract":"<div><div>Despite the growing body of research on feedback provided to L2 learners on their writing, few studies have investigated the use of a scaffolded approach to feedback. Sociocultural scholars argue that for feedback to be effective it needs to be scaffolded – dynamic and aligned to the learner’s ability to correct their errors (Aljaafreh & Lantolf, 1994). Although research on scaffolded feedback have found it to improve L2 writing accuracy, most of this research has been small-scale, using one-on-one conferences. This larger classroom-based study aimed to examine the effectiveness of scaffolded written feedback and students’ perceptions of this feedback approach. The study was quasi-experimental and implemented over one academic semester. The participants were 71 male students of intermediate English proficiency, majoring in English at a large Saudi university. They were divided into two groups: one group received scaffolded feedback; the other group received unscaffolded (indirect) feedback. The feedback targeted eight grammatical structures. Findings from the immediate and delayed post-tests showed that both groups improved in their overall writing accuracy over time, with no difference evident between the two groups. Moreover, both groups showed similar improvements in six of the eight targeted grammatical structures. The scaffolded feedback group showed greater improvement than their counterparts only on two structures: subject-verb agreement and singular-plural agreement. Interview findings showed that the scaffolded feedback group liked this approach mainly because of its novelty but preferred scaffolding only when it increased in explicitness. We conclude by considering whether and how scaffolded feedback can be provided in classroom settings.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"63 ","pages":"Article 100910"},"PeriodicalIF":4.2,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143137050","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

下一页尾页

类型

全部化学•材料生命科学医学物理工程技术环境•农林材料科学地球科学法学管理学化学环境科学与生态学计算机科学教育学经济学农林科学人文科学生物学数学物理与天体物理心理学综合性期刊其他工业工程理学历史学农学文学信息工程

数据库

全部 ACS Publications Elsevier ieeexplore Springer The Royal Society of Chemistry Wiley

期刊

Assessing Writing

全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.

﹀