首页 > 最新文献

Language Assessment Quarterly最新文献

英文 中文
Examining the Scoring of Content Integration in a Listening-Speaking Test: A G-Theory Analysis 基于g理论的听说考试内容整合评分研究
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-05-27 DOI: 10.1080/15434303.2023.2242334
Rongchan Lin
ABSTRACT Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a listening-speaking test in Chinese. International students who were non-native speakers of Chinese took the test that comprised two retell tasks and an oral presentation linked by an academic scenario. They were scored for content integration, organization, delivery, and language control for all three tasks. Multivariate generalizability theory (G-theory) was used to investigate the functioning of content integration in the analytic rubric of the retell tasks and oral presentation respectively. Overall, this study aimed to illuminate issues on dependability and construct validity for the two task types, focusing on content integration particularly. The findings suggested that content integration functioned differently to some extent when compared with the other dimensions studied.
现实世界中的交流往往需要对不同来源的内容进行解释、评价和整合。然而,在现有的研究中,将内容整合到话语中的能力似乎没有得到明确的评分。本研究将内容整合应用于汉语听说测试的分析性评分。非母语为汉语的国际学生参加的测试包括两个复述任务和一个与学术场景相关的口头陈述。他们对所有三个任务的内容集成、组织、交付和语言控制进行了评分。运用多元概化理论(G-theory)分别研究了内容整合在复述任务和口头陈述分析中的功能。总体而言,本研究旨在阐明两种任务类型的信度和结构效度问题,特别是内容整合问题。研究结果表明,与研究的其他维度相比,内容整合的功能在某种程度上有所不同。
{"title":"Examining the Scoring of Content Integration in a Listening-Speaking Test: A G-Theory Analysis","authors":"Rongchan Lin","doi":"10.1080/15434303.2023.2242334","DOIUrl":"https://doi.org/10.1080/15434303.2023.2242334","url":null,"abstract":"ABSTRACT Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a listening-speaking test in Chinese. International students who were non-native speakers of Chinese took the test that comprised two retell tasks and an oral presentation linked by an academic scenario. They were scored for content integration, organization, delivery, and language control for all three tasks. Multivariate generalizability theory (G-theory) was used to investigate the functioning of content integration in the analytic rubric of the retell tasks and oral presentation respectively. Overall, this study aimed to illuminate issues on dependability and construct validity for the two task types, focusing on content integration particularly. The findings suggested that content integration functioned differently to some extent when compared with the other dimensions studied.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44781591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Meta-Analysis of Accommodation Effects for English Learners: Considering Possible Moderators 英语学习者适应效应的元分析:考虑可能的调节因素
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-05-27 DOI: 10.1080/15434303.2023.2237499
Nathalie L. Marinho, S. Witmer, Nicole Jess, S. Roschmann
ABSTRACT The use of accommodations is often recommended to remove barriers to academic testing among English Learners (ELs). However, it is unclear whether accommodations are particularly effective at improving ELs’ test scores. A growing foundation of empirical work has explored this topic. We conducted a meta-analysis that examined several possible moderators of accommodation effectiveness for improving EL test performance. Results showed substantial variability among estimates, an overall small positive significant effect on test scores and a statistically significant positive effect for indirect linguistic supports and combined accommodations compared to native language accommodations.
摘要:通常建议使用便利设施来消除英语学习者(EL)的学业测试障碍。然而,目前尚不清楚住宿是否对提高ELs的考试成绩特别有效。越来越多的实证研究对这一主题进行了探索。我们进行了一项荟萃分析,研究了调节有效性对改善EL测试表现的几种可能的调节因素。结果显示,与母语适应相比,估计值之间存在显著差异,对考试成绩的总体正显著影响较小,对间接语言支持和综合适应的正显著影响具有统计学意义。
{"title":"A Meta-Analysis of Accommodation Effects for English Learners: Considering Possible Moderators","authors":"Nathalie L. Marinho, S. Witmer, Nicole Jess, S. Roschmann","doi":"10.1080/15434303.2023.2237499","DOIUrl":"https://doi.org/10.1080/15434303.2023.2237499","url":null,"abstract":"ABSTRACT The use of accommodations is often recommended to remove barriers to academic testing among English Learners (ELs). However, it is unclear whether accommodations are particularly effective at improving ELs’ test scores. A growing foundation of empirical work has explored this topic. We conducted a meta-analysis that examined several possible moderators of accommodation effectiveness for improving EL test performance. Results showed substantial variability among estimates, an overall small positive significant effect on test scores and a statistically significant positive effect for indirect linguistic supports and combined accommodations compared to native language accommodations.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42273933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparability Between Graded Readers and the Common Test in Japan in Terms of Text Difficulty Perceived by Learners 分级阅读与日本普通测试在学习者感知文本难度方面的可比性
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-05-27 DOI: 10.1080/15434303.2023.2237497
Yuya Arai
ABSTRACT Proponents of extensive reading argue that test-oriented language teaching and learning could discourage extensive reading practice. However, this has not been examined empirically. Given the possibility that the consistency of reading texts used in extensive reading and entrance examinations is one source of washback, the present study employed a two-facet Rasch measurement to examine the comparability between graded readers and the Common Test in Japan in terms of text difficulty perceived by Japanese high school students. It was found that perceived difficulty of the Common Test texts was not statistically different from that of some graded reader texts, providing positive evidence for the consistency between the Common Test and graded reader texts. Implications for future research on the relationship between entrance examinations and extensive reading are discussed in detail based on study findings and limitations.
泛读的支持者认为应试型语言教学会阻碍泛读的实践。然而,这还没有经过实证检验。考虑到广泛阅读和入学考试中使用的阅读文本的一致性可能是反作用的一个来源,本研究采用两方面的Rasch测量来检验分级读者和日本普通测试在日本高中生感知的文本难度方面的可比性。我们发现通用测试文本的感知难度与一些分级阅读文本的感知难度没有统计学差异,这为通用测试和分级阅读文本之间的一致性提供了积极的证据。根据研究结果和局限性,详细讨论了入学考试与广泛阅读关系的未来研究意义。
{"title":"Comparability Between Graded Readers and the Common Test in Japan in Terms of Text Difficulty Perceived by Learners","authors":"Yuya Arai","doi":"10.1080/15434303.2023.2237497","DOIUrl":"https://doi.org/10.1080/15434303.2023.2237497","url":null,"abstract":"ABSTRACT Proponents of extensive reading argue that test-oriented language teaching and learning could discourage extensive reading practice. However, this has not been examined empirically. Given the possibility that the consistency of reading texts used in extensive reading and entrance examinations is one source of washback, the present study employed a two-facet Rasch measurement to examine the comparability between graded readers and the Common Test in Japan in terms of text difficulty perceived by Japanese high school students. It was found that perceived difficulty of the Common Test texts was not statistically different from that of some graded reader texts, providing positive evidence for the consistency between the Common Test and graded reader texts. Implications for future research on the relationship between entrance examinations and extensive reading are discussed in detail based on study findings and limitations.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48061279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Canadian English Language Proficiency Index Program (CELPIP) Test 加拿大英语能力指数项目(CELPIP)测试
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-05-27 DOI: 10.1080/15434303.2023.2237487
Melissa McLeod, Liying Cheng
ABSTRACT The Canadian English Language Proficiency Index Program (CELPIP) Test was designed for immigration and citizenship in Canada. CELPIP is a computer-based English-language proficiency test which covers all four skills. This test review provides a description of the test and its construct, tasks, and delivery. Then, it appraises CELPIP for reliability, fairness, and validity before identifying future directions for research.
摘要加拿大英语能力指数项目(CELPIP)测试是为加拿大移民和公民身份而设计的。CELPIP是一项基于计算机的英语语言能力测试,涵盖所有四项技能。本测试综述提供了对测试及其结构、任务和交付的描述。然后,在确定未来的研究方向之前,它对CELPIP的可靠性、公平性和有效性进行了评估。
{"title":"The Canadian English Language Proficiency Index Program (CELPIP) Test","authors":"Melissa McLeod, Liying Cheng","doi":"10.1080/15434303.2023.2237487","DOIUrl":"https://doi.org/10.1080/15434303.2023.2237487","url":null,"abstract":"ABSTRACT The Canadian English Language Proficiency Index Program (CELPIP) Test was designed for immigration and citizenship in Canada. CELPIP is a computer-based English-language proficiency test which covers all four skills. This test review provides a description of the test and its construct, tasks, and delivery. Then, it appraises CELPIP for reliability, fairness, and validity before identifying future directions for research.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46730674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Causal Explanation Speaking Tasks to Assess Young EFL learners’ Speaking Ability: The Effects of Age, Cognitive, and L2 Linguistic Development 用因果解释演讲任务评估年轻英语学习者的演讲能力:年龄、认知和二语语言发展的影响
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-05-10 DOI: 10.1080/15434303.2023.2206811
Wenjun Ding, Guoxing Yu
ABSTRACT This paper examined to what extent causal explanation speaking tasks (CESTs) are cognitively appropriate for assessing young language learners’ (YLLs) L2 speaking. Ninety-six YLLs (48 from Grade 4 and 6 each) in China performed two CESTs in both L1 (Chinese) and L2 (English). They also completed receptive and productive L2 vocabulary size tests. We examined how their CEST performance scores, choice of causal antecedents, and speech utterances were related with language modes of the tasks (L1 vs. L2), grade levels, and L2 vocabulary sizes. L2 CEST performance scores were found to have significant positive correlations with L2 productive vocabulary size. CESTs were found to be generally cognitively appropriate for YLLs because their high scores in L1 performance indicated that performing CESTs is within their L1 capacity. By examining causal connectives used by YLLs, we found that learners from both age groups had cognitive ability sufficient to verbalise causality. Yet YLLs’ cognitive ability to interpret and verbalise mental states is still developing and reasoning between causal antecedents that have competing causal relationship with the final state can be cognitively challenging. We discussed the findings with reference to the design of cognitively appropriate CESTs that can assess both language and thinking skills. 本文研究了因果解释口语任务从认知层面来说是否适宜测评儿童语言学习者的二语口语能力。九十六名中国的儿童语言学习者(四年级与六年级各四十八名)分别用第一语言(汉语)和第二语言(英语)完成了两个因果解释口语任务。他们还完成了接受性和产出性二语词汇测试。我们分析了他们的因果解释口语任务的表现分数、对前因的选择和语言产出这三者与完成任务所使用的语言 (一语和二语)、所在年级和二语词汇量之间的关系。我们发现因果解释口语任务的二语表现分数与二语产出性词汇量之间呈显著正相关。他们用第一语言完成因果解释口语任务所获得的高分数说明完成这项任务在他们的一语能力范围之内,因此我们认为因果解释口语任务对于儿童语言学习者来说总体上是认知适宜的。通过分析儿童语言学习者使用因果连词的情况,我们还发现这两个年龄组的学习者拥有充分的认知能力来口头表达因果关系。不过儿童语言学习者理解和口头表达心理状态的能力尚处于发展阶段,他们对具有相互竞争关系的前因进行逻辑推导时会存在认知上的挑战。我们对研究结果的讨论主要涉及如何设计认知适宜的并能够同时测评语言和思维技能的因果解释口语任务。
ABSTRACT This paper optimized to what external cause explanation speaking tasks (CESTs) are cognitively appropriate for assessing young language learners' (YLLs) L2 speaking Ninety six YLLs (48 from Grade 4 and 6 each) in China performed two CESTs in both L1 (Chinese) and L2 (English) They also completed positive and productive L2 vocabulary size tests We examined how their CEST performance scores, choice of causal obligations, and speech utterances were related with language modes of the tasks (L1 vs. L2), grade levels, and L2 vocabulary sizes L2 CEST performance scores were found to have significant positive correlations with L2 productive vocabulary size CESTs were found to be generally cognitively appropriate for YLLs because their high scores in L1 performance indicated that performing CESTs are within their L1 capacity By examining causal connections used by YLLs, we found that learners from both age groups have cognitive ability sufficient to balance causality Yes YLLs' cognitive ability to interpret and reconcile mental states is still developing and reasoning between cause antagonists that have competitive cause relationships with the final state can be cognitively challenging We discussed the findings with reference to the design of coherent appropriate CESTs that can assess both language and thinking skills This article investigates whether causal interpretation oral tasks are suitable for assessing the second language speaking ability of children's language learners from a cognitive perspective. Ninety six Chinese children's language learners (48 in each of the fourth and sixth grades) completed two causal interpretation oral tasks in their first language (Chinese) and second language (English), respectively. They also completed receptive and productive second language vocabulary tests. We analyzed the relationship between their performance scores, choice of antecedents, and language output in causal interpretation oral tasks, as well as the language used to complete the task (first and second languages), grade, and second language vocabulary. We found a significant positive correlation between second language performance scores and second language productive vocabulary in causal interpretation oral tasks. The high scores obtained by them in completing the causal interpretation oral task in their first language indicate that completing this task is within their first language proficiency range. Therefore, we believe that the causal interpretation oral task is generally cognitively appropriate for children's language learners. By analyzing the use of causal conjunctions by children's language learners, we also found that these two age groups of learners have sufficient cognitive ability to verbally express causal relationships. However, the ability of children's language learners to understand and verbally express their psychological state is still in the developmental stage, and they face cognitive challenges when logically inferring
{"title":"Using Causal Explanation Speaking Tasks to Assess Young EFL learners’ Speaking Ability: The Effects of Age, Cognitive, and L2 Linguistic Development","authors":"Wenjun Ding, Guoxing Yu","doi":"10.1080/15434303.2023.2206811","DOIUrl":"https://doi.org/10.1080/15434303.2023.2206811","url":null,"abstract":"ABSTRACT This paper examined to what extent causal explanation speaking tasks (CESTs) are cognitively appropriate for assessing young language learners’ (YLLs) L2 speaking. Ninety-six YLLs (48 from Grade 4 and 6 each) in China performed two CESTs in both L1 (Chinese) and L2 (English). They also completed receptive and productive L2 vocabulary size tests. We examined how their CEST performance scores, choice of causal antecedents, and speech utterances were related with language modes of the tasks (L1 vs. L2), grade levels, and L2 vocabulary sizes. L2 CEST performance scores were found to have significant positive correlations with L2 productive vocabulary size. CESTs were found to be generally cognitively appropriate for YLLs because their high scores in L1 performance indicated that performing CESTs is within their L1 capacity. By examining causal connectives used by YLLs, we found that learners from both age groups had cognitive ability sufficient to verbalise causality. Yet YLLs’ cognitive ability to interpret and verbalise mental states is still developing and reasoning between causal antecedents that have competing causal relationship with the final state can be cognitively challenging. We discussed the findings with reference to the design of cognitively appropriate CESTs that can assess both language and thinking skills. 本文研究了因果解释口语任务从认知层面来说是否适宜测评儿童语言学习者的二语口语能力。九十六名中国的儿童语言学习者(四年级与六年级各四十八名)分别用第一语言(汉语)和第二语言(英语)完成了两个因果解释口语任务。他们还完成了接受性和产出性二语词汇测试。我们分析了他们的因果解释口语任务的表现分数、对前因的选择和语言产出这三者与完成任务所使用的语言 (一语和二语)、所在年级和二语词汇量之间的关系。我们发现因果解释口语任务的二语表现分数与二语产出性词汇量之间呈显著正相关。他们用第一语言完成因果解释口语任务所获得的高分数说明完成这项任务在他们的一语能力范围之内,因此我们认为因果解释口语任务对于儿童语言学习者来说总体上是认知适宜的。通过分析儿童语言学习者使用因果连词的情况,我们还发现这两个年龄组的学习者拥有充分的认知能力来口头表达因果关系。不过儿童语言学习者理解和口头表达心理状态的能力尚处于发展阶段,他们对具有相互竞争关系的前因进行逻辑推导时会存在认知上的挑战。我们对研究结果的讨论主要涉及如何设计认知适宜的并能够同时测评语言和思维技能的因果解释口语任务。","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42183412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning-Oriented Language Assessment: Putting Theory into Practice 以学习为导向的语言评价:理论与实践的结合
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-03-11 DOI: 10.1080/15434303.2023.2181174
Fatimah M. M. Aseeri
{"title":"Learning-Oriented Language Assessment: Putting Theory into Practice","authors":"Fatimah M. M. Aseeri","doi":"10.1080/15434303.2023.2181174","DOIUrl":"https://doi.org/10.1080/15434303.2023.2181174","url":null,"abstract":"","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46188165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Teaching and Testing Second Language Pragmatics and Interaction: A Practical Guide 第二语言语用学与互动教学与测试:实用指南
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-03-11 DOI: 10.1080/15434303.2023.2181173
Dunlai Lin, Senlin Liu
Pragmatics — how social context affects the way we do things with language — plays a critical role in managing social interaction and interpersonal relationships. Despite decades of research on second language (L2) pragmatics, practical resources for teaching and assessing L2 pragmatics have continued to remain relatively scarce. Teaching and testing second language pragmatics and interaction: A practical guide by Roever (2022) is the first comprehensive hands-on guide written for language practitioners who wish to interweave aspects of pragmatics into their classroom teaching, curriculum design
语用学——社会环境如何影响我们用语言做事的方式——在管理社会互动和人际关系方面起着关键作用。尽管对第二语言语用学进行了数十年的研究,但用于教学和评估第二语言语用学的实用资源仍然相对匮乏。教学和测试第二语言语用学和互动:Roever(2022)的实践指南是第一本为希望将语用学的各个方面融入课堂教学和课程设计的语言从业者编写的综合实践指南
{"title":"Teaching and Testing Second Language Pragmatics and Interaction: A Practical Guide","authors":"Dunlai Lin, Senlin Liu","doi":"10.1080/15434303.2023.2181173","DOIUrl":"https://doi.org/10.1080/15434303.2023.2181173","url":null,"abstract":"Pragmatics — how social context affects the way we do things with language — plays a critical role in managing social interaction and interpersonal relationships. Despite decades of research on second language (L2) pragmatics, practical resources for teaching and assessing L2 pragmatics have continued to remain relatively scarce. Teaching and testing second language pragmatics and interaction: A practical guide by Roever (2022) is the first comprehensive hands-on guide written for language practitioners who wish to interweave aspects of pragmatics into their classroom teaching, curriculum design","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48546277","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Aligning Language Frameworks: An Example with the CLB and CEFR 协调语言框架:以CLB和CEFR为例
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2023-03-08 DOI: 10.1080/15434303.2023.2184266
B. North, E. Piccardo
ABSTRACT This paper presents a methodology for directly aligning ‘can do’ frameworks to each other. The methodology, inspired by the manual for relating examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment (CEFR) (Council of Europe, 2009) and Kane’s (2004, 2013) interpretative argument, takes account of both the horizontal dimension (content analysis) and the vertical dimension (benchmarking with Multifaceted Rasch Modelling – MFRM). The paper exemplifies the application of the methodology by introducing the research conducted to align the Canadian Language Benchmarks (CLB)/ Niveaux de compétence linguistique canadiens (NCLC) to the CEFR, presenting the resulting alignment, and discussing the rationale for the choices made.
摘要本文提出了一种直接将“可行”框架相互对齐的方法。该方法受到《欧洲语言参考框架:学习、教学、评估(CEFR)》(欧洲委员会,2009年)和Kane(20042013年)解释性论点相关考试手册的启发,同时考虑了横向维度(内容分析)和纵向维度(多方面Rasch建模基准——MFRM)。本文通过介绍为使加拿大语言基准(CLB)/加拿大新竞争语言学(NCLC)与加拿大语言基准一致而进行的研究,展示了由此产生的一致性,并讨论了所做选择的基本原理,举例说明了该方法的应用。
{"title":"Aligning Language Frameworks: An Example with the CLB and CEFR","authors":"B. North, E. Piccardo","doi":"10.1080/15434303.2023.2184266","DOIUrl":"https://doi.org/10.1080/15434303.2023.2184266","url":null,"abstract":"ABSTRACT This paper presents a methodology for directly aligning ‘can do’ frameworks to each other. The methodology, inspired by the manual for relating examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment (CEFR) (Council of Europe, 2009) and Kane’s (2004, 2013) interpretative argument, takes account of both the horizontal dimension (content analysis) and the vertical dimension (benchmarking with Multifaceted Rasch Modelling – MFRM). The paper exemplifies the application of the methodology by introducing the research conducted to align the Canadian Language Benchmarks (CLB)/ Niveaux de compétence linguistique canadiens (NCLC) to the CEFR, presenting the resulting alignment, and discussing the rationale for the choices made.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2023-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49338693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Promoting Learning Potential among Students of L2 Chinese through Dynamic Assessment 通过动态评估促进第二语言汉语学生的学习潜力
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2022-12-23 DOI: 10.1080/15434303.2022.2156870
Lin Jia, Jian-Yong Cai, Jianqi Wang
ABSTRACT In Dynamic Assessment (DA), the observation that individuals respond differently to support, or mediation, is important for diagnoses of development. The concept of learning potential refers to openness to mediation, i.e., the extent of change to performance when mediation is available, which may suggest learners will need less overall instruction to develop. The current study investigates this prediction and the premise that aligning DA mediation with learner needs promotes development. Mediation, as a systematic interactional process, is more likely to appropriately identify learner needs that are sensitive to future development. Thirty-four secondary school learners of L2 Chinese participating in a two-month study abroad in China completed narration tasks following an instructional intervention, one group receiving DA mediation and the other explicit feedback. The bα (把)-construction, recognized as particularly challenging for learners of Chinese, was the focal language feature. Analysis revealed significant differences, with the group receiving DA mediation showing greater improvement with mediation and more accuracy during independent functioning.
在动态评估(DA)中,观察个体对支持或调解的不同反应对发展的诊断是重要的。学习潜力的概念是指对中介的开放程度,即当中介存在时,学习者的表现变化的程度,这可能意味着学习者需要更少的整体指导来发展。本研究对这一预测进行了研究,并提出了将数据学习中介与学习者需求结合起来促进发展的前提。调解作为一个系统的互动过程,更有可能恰当地识别对未来发展敏感的学习者需求。34名参加为期两个月的中国留学的中学第二语言汉语学习者在教学干预后完成了叙述任务,一组接受DA调解,另一组接受外显反馈。对汉语学习者来说特别具有挑战性的“bα”结构是重点语言特征。分析显示了显著的差异,接受DA调解的组表现出更大的调解改善和更准确的独立功能。
{"title":"Promoting Learning Potential among Students of L2 Chinese through Dynamic Assessment","authors":"Lin Jia, Jian-Yong Cai, Jianqi Wang","doi":"10.1080/15434303.2022.2156870","DOIUrl":"https://doi.org/10.1080/15434303.2022.2156870","url":null,"abstract":"ABSTRACT In Dynamic Assessment (DA), the observation that individuals respond differently to support, or mediation, is important for diagnoses of development. The concept of learning potential refers to openness to mediation, i.e., the extent of change to performance when mediation is available, which may suggest learners will need less overall instruction to develop. The current study investigates this prediction and the premise that aligning DA mediation with learner needs promotes development. Mediation, as a systematic interactional process, is more likely to appropriately identify learner needs that are sensitive to future development. Thirty-four secondary school learners of L2 Chinese participating in a two-month study abroad in China completed narration tasks following an instructional intervention, one group receiving DA mediation and the other explicit feedback. The bα (把)-construction, recognized as particularly challenging for learners of Chinese, was the focal language feature. Analysis revealed significant differences, with the group receiving DA mediation showing greater improvement with mediation and more accuracy during independent functioning.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2022-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47276982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Advancing L2 Dynamic Assessment: Innovations in Chinese Contexts 推进二语动态评估:中国语境下的创新
IF 2.9 2区 文学 Q1 Arts and Humanities Pub Date : 2022-12-15 DOI: 10.1080/15434303.2022.2158465
M. E. Poehner, J. Lantolf
ABSTRACT This introduction to the special issue, L2 Dynamic Assessment Research in China, examines the theoretical foundations of Dynamic Assessment (DA) in the writings of L. S. Vygotsky, with particular attention to the concepts of praxis, mediation, and zone of proximal development, while also recognizing contributions from notable DA researchers such as Israeli psychologist and educator Reuven Feuerstein. Trends in the general and L2 DA research literatures are considered, including: flexible, open-ended mediation (interactionist DA) and standardized, scripted mediation (interventionist DA); formats of embedding mediation in assessment procedures (so-called ‘sandwich’ and ‘cake’ formats of DA); DA administered in classroom and group settings; DA in formal testing contexts, including computerized DA procedures; mediated scores and learning potential scores; and uses of learner profiles resulting from DA to inform instructional enrichment programs. Each article in the special issue reports original research conducted by scholars in China. How the individual studies take up and extend trends in L2 DA research is explained. Given that learning activities and the thinking associated with them are deeply saturated in specific cultural practices and norms, it is argued that extension of DA principles to new cultural contexts, such as those reported in the special issue, is informative not only for assessment researchers in China but for the international community of assessment scholars, and it is essential for the continued development of DA frameworks.
摘要本期特刊《二语动态评估研究在中国》的引言探讨了维果茨基著作中动态评估的理论基础,特别关注实践、中介和近端发展区的概念,同时也认可以色列心理学家和教育家Reuven Feuerstein等著名DA研究人员的贡献。一般趋势和L2 考虑了DA研究文献,包括:灵活、开放的中介(互动型DA)和标准化、脚本化的中介(干预型DA);在评估程序中嵌入调解的格式(DA的所谓“三明治”和“蛋糕”格式);在课堂和小组环境中管理DA;正式测试环境中的DA,包括计算机化的DA程序;中介得分和学习潜力得分;以及使用DA产生的学习者档案来为教学丰富程序提供信息。特刊中的每一篇文章都报道了中国学者进行的原创研究。个别研究如何吸收和扩展L2的趋势 对DA研究进行了解释。鉴于学习活动及其相关思维深深地渗透在特定的文化实践和规范中,有人认为,将DA原则扩展到新的文化背景中,例如特刊中报道的那些文化背景,不仅对中国的评估研究人员,而且对国际评估学者社会都是有益的,这对于DA框架的持续发展至关重要。
{"title":"Advancing L2 Dynamic Assessment: Innovations in Chinese Contexts","authors":"M. E. Poehner, J. Lantolf","doi":"10.1080/15434303.2022.2158465","DOIUrl":"https://doi.org/10.1080/15434303.2022.2158465","url":null,"abstract":"ABSTRACT This introduction to the special issue, L2 Dynamic Assessment Research in China, examines the theoretical foundations of Dynamic Assessment (DA) in the writings of L. S. Vygotsky, with particular attention to the concepts of praxis, mediation, and zone of proximal development, while also recognizing contributions from notable DA researchers such as Israeli psychologist and educator Reuven Feuerstein. Trends in the general and L2 DA research literatures are considered, including: flexible, open-ended mediation (interactionist DA) and standardized, scripted mediation (interventionist DA); formats of embedding mediation in assessment procedures (so-called ‘sandwich’ and ‘cake’ formats of DA); DA administered in classroom and group settings; DA in formal testing contexts, including computerized DA procedures; mediated scores and learning potential scores; and uses of learner profiles resulting from DA to inform instructional enrichment programs. Each article in the special issue reports original research conducted by scholars in China. How the individual studies take up and extend trends in L2 DA research is explained. Given that learning activities and the thinking associated with them are deeply saturated in specific cultural practices and norms, it is argued that extension of DA principles to new cultural contexts, such as those reported in the special issue, is informative not only for assessment researchers in China but for the international community of assessment scholars, and it is essential for the continued development of DA frameworks.","PeriodicalId":46873,"journal":{"name":"Language Assessment Quarterly","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2022-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46414186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Language Assessment Quarterly
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1