首页 > 最新文献

Studies in Language Assessment最新文献

英文 中文
Anthony Green. Exploring Language Assessment and Testing: Language in Action 安东尼·格林。探索语言评估和测试:语言在行动
Q4 LINGUISTICS Pub Date : 2015-01-01 DOI: 10.58379/uzbz3766
S. Davidson
n/a
N/A
{"title":"Anthony Green. Exploring Language Assessment and Testing: Language in Action","authors":"S. Davidson","doi":"10.58379/uzbz3766","DOIUrl":"https://doi.org/10.58379/uzbz3766","url":null,"abstract":"<jats:p>n/a</jats:p>","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"51 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80999532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using corpus complexity analysis to refine a holistic ESL writing placement rubric 使用语料库复杂性分析,以完善整体的ESL写作布局规则
Q4 LINGUISTICS Pub Date : 2015-01-01 DOI: 10.58379/evsp6047
J. R. Gevara
The purpose of this study is to determine if corpus analysis tools can identify linguistic features within writing placement samples that are significantly different between levels within a higher education language program. Although commercial tests are widely used for placement decisions, local performance assessments have become more common compliments that better adhere to communicative language teaching. At the university where this study was conducted, raters use a holistic rubric to score students’ responses to one academic topic. The scoring process is fast when rates agree but too time consuming when raters search for information to resolve disagreements. Writing placement samples from 123 former students’ essays at an Intensive English Program were used to compile a corpus. I divided the writing samples into four folders that correspond with the program levels and analyzed the folders using syntactic, lexical, and essay complexity analyzers. I utilized the robustness of the ANOVA to account for assumption violations. Data that violated the normality assumption were first analyzed using the Kruskal-Wallis Test. Those variables showing significant differences between levels were then analyzed using ANOVA and the appropriate post-hoc tests. Results show significant between group differences with lexical and word types and tokens, complex nominal, verb phrases, and ideas. I discuss the interpretation of these variables as well as show how administrators used this information to revise the rubric from Version I to Version II. Broader implications from this study are the use of corpus research tools to operationalize performance for the purposes of model building.
本研究的目的是确定语料库分析工具是否可以识别高等教育语言课程中不同水平的写作放置样本中的语言特征。尽管商业测试被广泛用于学生的分班决定,但当地的表现评估已经成为更普遍的赞美,它更好地坚持了交际性语言教学。在进行这项研究的大学里,评分者使用一个整体的标准来给学生对一个学术主题的反应打分。当评分者意见一致时,评分过程很快,但当评分者搜索信息以解决分歧时,评分过程太耗时。从123名前英语强化课程学生的文章中抽取写作位置样本,用于编制语料库。我将写作样本分为四个文件夹,这些文件夹与程序级别相对应,并使用语法、词汇和文章复杂性分析器分析这些文件夹。我利用方差分析的稳健性来解释假设违反。违反正态性假设的数据首先使用Kruskal-Wallis检验进行分析。然后使用方差分析和适当的事后检验对显示水平之间显著差异的变量进行分析。结果显示,组间在词汇和词类型、符号、复杂名词、动词短语和思想方面存在显著差异。我将讨论这些变量的解释,并展示管理员如何使用这些信息将标题从Version I修改为Version II。本研究的更广泛含义是使用语料库研究工具来为模型构建的目的操作性能。
{"title":"Using corpus complexity analysis to refine a holistic ESL writing placement rubric","authors":"J. R. Gevara","doi":"10.58379/evsp6047","DOIUrl":"https://doi.org/10.58379/evsp6047","url":null,"abstract":"The purpose of this study is to determine if corpus analysis tools can identify linguistic features within writing placement samples that are significantly different between levels within a higher education language program. Although commercial tests are widely used for placement decisions, local performance assessments have become more common compliments that better adhere to communicative language teaching. At the university where this study was conducted, raters use a holistic rubric to score students’ responses to one academic topic. The scoring process is fast when rates agree but too time consuming when raters search for information to resolve disagreements. Writing placement samples from 123 former students’ essays at an Intensive English Program were used to compile a corpus. I divided the writing samples into four folders that correspond with the program levels and analyzed the folders using syntactic, lexical, and essay complexity analyzers. I utilized the robustness of the ANOVA to account for assumption violations. Data that violated the normality assumption were first analyzed using the Kruskal-Wallis Test. Those variables showing significant differences between levels were then analyzed using ANOVA and the appropriate post-hoc tests. Results show significant between group differences with lexical and word types and tokens, complex nominal, verb phrases, and ideas. I discuss the interpretation of these variables as well as show how administrators used this information to revise the rubric from Version I to Version II. Broader implications from this study are the use of corpus research tools to operationalize performance for the purposes of model building.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76242920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Towards improved language assessment of written health professional communication: the case of the Occupational English Test 改善卫生专业书面沟通的语言评估:以职业英语测试为例
Q4 LINGUISTICS Pub Date : 2015-01-01 DOI: 10.58379/mfbr6523
U. Knoch, T. McNamara, R. Woodward‐Kron, C. Elder, E. Manias, E. Flynn, Ying Zhang
n/a
N/A
{"title":"Towards improved language assessment of written health professional communication: the case of the Occupational English Test","authors":"U. Knoch, T. McNamara, R. Woodward‐Kron, C. Elder, E. Manias, E. Flynn, Ying Zhang","doi":"10.58379/mfbr6523","DOIUrl":"https://doi.org/10.58379/mfbr6523","url":null,"abstract":"<jats:p>n/a</jats:p>","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90334909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Development of a Spanish generic writing skills scale for the Colombian Graduate Skills Assessment (Saber Pro) 哥伦比亚研究生技能评估西班牙语通用写作技能量表的开发(Saber Pro)
Q4 LINGUISTICS Pub Date : 2015-01-01 DOI: 10.58379/dayb9070
A. Ducasse, Kathryn Hill
While many higher education institutions list the generic skills their graduates are intended to acquire during a course of study (Barrie, 2006), the relevant skills are rarely directly assessed at graduation. In Colombia, exit assessment is compulsory for all post-secondary training and education. To this end, a Spanish-language version of the Australian Graduate Skills Assessment (GSA) was developed for the Colombian context. However, problems were identified with the reliability of the Spanish version of the GSA writing scale. This paper describes the process of replacing the original version of the Spanish-language version of the GSA scale (an intuitively based writing scale) with an empirically based scale developed using a question tree method. Forty raters constructed two holistic (combined trait) and three analytic (individual trait) writing scales using benchmarked scripts from a previous test administration. The five scales were then trialled. Comparison of the scales showed the eight-level holistic scale provided the widest distribution of scores. This research provides insights into generic writing skill testing for higher education graduates in Colombia. In addition, the study uniquely provides a detailed description of the development of empirically-based analytic and holistic scales for assessing the writing of Spanish-L1 speaking graduates in Colombia.
虽然许多高等教育机构列出了毕业生在学习过程中想要获得的通用技能(Barrie, 2006),但很少在毕业时直接评估相关技能。在哥伦比亚,所有中学后培训和教育都必须进行毕业评估。为此,针对哥伦比亚的情况制定了西班牙语版的澳大利亚毕业生技能评估(GSA)。然而,西班牙语版GSA写作量表的可靠性存在问题。本文描述了用问题树方法开发的基于经验的GSA量表(基于直觉的写作量表)取代原来的西班牙语版GSA量表(基于直觉的写作量表)的过程。40名评分者使用来自先前测试管理的基准脚本构建了两个整体(组合特征)和三个分析(个体特征)写作量表。然后测试了这五种量表。量表比较显示,8级整体量表提供了最广泛的分数分布。这项研究为哥伦比亚高等教育毕业生的通用写作技能测试提供了见解。此外,该研究独特地详细描述了基于经验的分析和整体量表的发展,用于评估哥伦比亚说西班牙语- l1的毕业生的写作。
{"title":"Development of a Spanish generic writing skills scale for the Colombian Graduate Skills Assessment (Saber Pro)","authors":"A. Ducasse, Kathryn Hill","doi":"10.58379/dayb9070","DOIUrl":"https://doi.org/10.58379/dayb9070","url":null,"abstract":"While many higher education institutions list the generic skills their graduates are intended to acquire during a course of study (Barrie, 2006), the relevant skills are rarely directly assessed at graduation. In Colombia, exit assessment is compulsory for all post-secondary training and education. To this end, a Spanish-language version of the Australian Graduate Skills Assessment (GSA) was developed for the Colombian context. However, problems were identified with the reliability of the Spanish version of the GSA writing scale. This paper describes the process of replacing the original version of the Spanish-language version of the GSA scale (an intuitively based writing scale) with an empirically based scale developed using a question tree method. Forty raters constructed two holistic (combined trait) and three analytic (individual trait) writing scales using benchmarked scripts from a previous test administration. The five scales were then trialled. Comparison of the scales showed the eight-level holistic scale provided the widest distribution of scores. This research provides insights into generic writing skill testing for higher education graduates in Colombia. In addition, the study uniquely provides a detailed description of the development of empirically-based analytic and holistic scales for assessing the writing of Spanish-L1 speaking graduates in Colombia.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82689566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
International assessment and local contexts: A case study of an English language initiative in higher educatoin institutes in Egypt 国际评估和地方背景:埃及高等教育机构英语语言倡议的案例研究
Q4 LINGUISTICS Pub Date : 2015-01-01 DOI: 10.58379/xasg6414
H. Khalifa, Nahal Khabbazbashi, Samar Abdelsalam, Mohsen Elmahdy Said
Within the long-term objectives of English language reform in higher education (HE) institutes across Egypt and increasing employability in the global job market, the Center for Advancement of Postgraduate Studies and Research in Cairo University (CAPSCU), Cambridge English Language Assessment and the British Council (Egypt) have implemented a multi-phase upskilling program aimed at enhancing the workplace language skills of socially disadvantaged undergraduates, developing teachers’ pedagogical knowledge and application, providing both students and teachers with a competitive edge in the job markets through internationally recognised certification and the introduction of 21st century skills such as digital-age literacy and effective communication in HE, and, lastly, integrating international standards for teaching, learning and assessment within the local context. This paper reports on a mixed methods research study aimed at evaluating the effectiveness of this initiative and its impact at the micro and macro levels. The research focused on language progression, learner autonomy, motivation towards digital learning and assessment, improvements in pedagogical knowledge and teaching practices. Standardised assessment, attitudinal and perceptions surveys, and observational data were used. Findings suggested a positive impact of the upskilling program, illustrated how international collaborations can provide the necessary skills for today’s global job market, and highlighted areas for consideration for upscaling the initiative.
为了实现埃及高等教育机构英语语言改革的长期目标,提高全球就业市场的就业能力,开罗大学研究生学习和研究促进中心(CAPSCU)、剑桥英语语言评估和英国文化协会(埃及)实施了一项多阶段技能提升计划,旨在提高社会弱势本科生的工作场所语言技能。发展教师的教学知识和应用,通过国际认可的认证,并在高等教育中引入21世纪的技能,如数字时代的素养和有效的沟通,为学生和教师在就业市场上提供竞争优势,最后,在本地环境中整合国际教学、学习和评估标准。本文报告了一项混合方法研究,旨在评估该倡议的有效性及其在微观和宏观层面的影响。研究的重点是语言进步、学习者自主、对数字化学习和评估的动机、教学知识和教学实践的改进。采用了标准化评估、态度和看法调查以及观察数据。调查结果显示了技能提升计划的积极影响,说明了国际合作如何为当今的全球就业市场提供必要的技能,并强调了扩大该计划需要考虑的领域。
{"title":"International assessment and local contexts: A case study of an English language initiative in higher educatoin institutes in Egypt","authors":"H. Khalifa, Nahal Khabbazbashi, Samar Abdelsalam, Mohsen Elmahdy Said","doi":"10.58379/xasg6414","DOIUrl":"https://doi.org/10.58379/xasg6414","url":null,"abstract":"Within the long-term objectives of English language reform in higher education (HE) institutes across Egypt and increasing employability in the global job market, the Center for Advancement of Postgraduate Studies and Research in Cairo University (CAPSCU), Cambridge English Language Assessment and the British Council (Egypt) have implemented a multi-phase upskilling program aimed at enhancing the workplace language skills of socially disadvantaged undergraduates, developing teachers’ pedagogical knowledge and application, providing both students and teachers with a competitive edge in the job markets through internationally recognised certification and the introduction of 21st century skills such as digital-age literacy and effective communication in HE, and, lastly, integrating international standards for teaching, learning and assessment within the local context. This paper reports on a mixed methods research study aimed at evaluating the effectiveness of this initiative and its impact at the micro and macro levels. The research focused on language progression, learner autonomy, motivation towards digital learning and assessment, improvements in pedagogical knowledge and teaching practices. Standardised assessment, attitudinal and perceptions surveys, and observational data were used. Findings suggested a positive impact of the upskilling program, illustrated how international collaborations can provide the necessary skills for today’s global job market, and highlighted areas for consideration for upscaling the initiative.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"69 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83533737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Using an English self-assessment tool to validate an English Placement Test 使用英语自我评估工具来验证英语分班考试
Q4 LINGUISTICS Pub Date : 2015-01-01 DOI: 10.58379/rphi9026
Zhi Li
This study aimed to develop and use a contextualized self-assessment of English proficiency as a tool to validate an English Placement Test (MEPT) at a large Midwestern university in the U.S. More specifically, the self-assessment tool was expected to provide evidence for the extrapolation inference within an argument-based validity framework. 217 English as a second language (ESL) students participated in this study in the 2014 spring semester and 181 of them provided valid responses to the self-assessment. The results of a Rasch model-based item analysis indicated that the self-assessment items exhibited acceptable reliabilities and good item discrimination. There were no misfitting items in the self-assessment and the Likert scale used in the self-assessment functioned well. The results from confirmatory factor analysis indicated that a hypothesized correlated four-factor model fitted the self-assessment data. However, the multitrait-multimethod analyses revealed weak to moderate correlation coefficients between participants’ self-assessment and their performances on both the MEPT and the TOEFL iBT. Possible factors contributing to this relationship were discussed. Nonetheless, given the acceptable psychometric quality and a clear factor structure of the self-assessment, this could be a promising tool in providing evidence for the extrapolation inference of the placement test score interpretation and use.
本研究旨在开发和使用情境化英语水平自我评估作为工具来验证美国中西部一所大型大学的英语分班考试(MEPT)。更具体地说,该自我评估工具有望为基于论证的有效性框架内的外推推理提供证据。本研究于2014年春季学期对217名英语作为第二语言(ESL)学生进行了调查,其中181名学生在自我评估中给出了有效的回答。基于Rasch模型的项目分析结果表明,自评项目具有可接受的信度和良好的项目辨别能力。自评中不存在不拟合项目,自评使用的李克特量表功能良好。验证性因子分析的结果显示,一个假设的相关四因子模型拟合了自评数据。然而,多特征-多方法分析显示,参与者的自我评价与他们在MEPT和托福网考中的表现之间存在弱至中等的相关系数。讨论了造成这种关系的可能因素。然而,考虑到自我评估的可接受的心理测量质量和清晰的因素结构,这可能是一个有前途的工具,为分班考试成绩解释和使用的外推推断提供证据。
{"title":"Using an English self-assessment tool to validate an English Placement Test","authors":"Zhi Li","doi":"10.58379/rphi9026","DOIUrl":"https://doi.org/10.58379/rphi9026","url":null,"abstract":"This study aimed to develop and use a contextualized self-assessment of English proficiency as a tool to validate an English Placement Test (MEPT) at a large Midwestern university in the U.S. More specifically, the self-assessment tool was expected to provide evidence for the extrapolation inference within an argument-based validity framework. 217 English as a second language (ESL) students participated in this study in the 2014 spring semester and 181 of them provided valid responses to the self-assessment. The results of a Rasch model-based item analysis indicated that the self-assessment items exhibited acceptable reliabilities and good item discrimination. There were no misfitting items in the self-assessment and the Likert scale used in the self-assessment functioned well. The results from confirmatory factor analysis indicated that a hypothesized correlated four-factor model fitted the self-assessment data. However, the multitrait-multimethod analyses revealed weak to moderate correlation coefficients between participants’ self-assessment and their performances on both the MEPT and the TOEFL iBT. Possible factors contributing to this relationship were discussed. Nonetheless, given the acceptable psychometric quality and a clear factor structure of the self-assessment, this could be a promising tool in providing evidence for the extrapolation inference of the placement test score interpretation and use.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"5 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2015-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90074762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
The use of semi-scripted speech in a listening placement test for university students 在大学生听力分班测试中使用半脚本演讲
Q4 LINGUISTICS Pub Date : 2014-01-01 DOI: 10.58379/qflf1241
M. Clark
This paper describes the feasibility of using semi-scripted spoken lectures as stimulus materials in a test of academic listening. The context for this study was the development of a revised test of academic listening designed to place enrolled university students into one of two levels of a language support course for non-native speakers. Because academic listening often involves listening to monologic speech such as lectures (Ferris & Tagg, 1996a), and because ‘authentic’ spoken language is qualitatively different to scripted speech (Biber et al., 2004), the revised test uses semi-scripted spoken mini-lectures as stimulus passages rather than relying on scripted material. Test questions were developed using only the informational elements that four model comprehenders, proficient English listeners (both native and non-native), were able to retain from a single hearing of the passages. Test data from 222 students were analysed using a Rasch methodology. Results show that this test development method did result in testable content that was appropriately targeted at the population of interest, though several aspects of the process could be improved. The paper concludes with some recommendations for using semi-scripted language in academic listening tests.
本文描述了在学术听力测试中使用半脚本口语演讲作为刺激材料的可行性。本研究的背景是制定一项修订后的学术听力测试,旨在将入学的大学生分为两个级别,分别参加针对非母语人士的语言支持课程。因为学术听力通常涉及听单一的演讲,如讲座(Ferris & Tagg, 1996a),而且因为“真实的”口语在本质上不同于脚本演讲(Biber et al., 2004),修订后的测试使用半脚本的口语迷你讲座作为刺激段落,而不是依赖脚本材料。测试问题只使用四个模型理解者,精通英语的听众(母语和非母语)能够从一次听力中记住的信息元素来开发。使用Rasch方法分析了222名学生的测试数据。结果表明,这种测试开发方法确实产生了适当地针对感兴趣人群的可测试内容,尽管该过程的几个方面可以得到改进。文章最后对在学术听力测试中使用半脚本语言提出了一些建议。
{"title":"The use of semi-scripted speech in a listening placement test for university students","authors":"M. Clark","doi":"10.58379/qflf1241","DOIUrl":"https://doi.org/10.58379/qflf1241","url":null,"abstract":"This paper describes the feasibility of using semi-scripted spoken lectures as stimulus materials in a test of academic listening. The context for this study was the development of a revised test of academic listening designed to place enrolled university students into one of two levels of a language support course for non-native speakers. Because academic listening often involves listening to monologic speech such as lectures (Ferris & Tagg, 1996a), and because ‘authentic’ spoken language is qualitatively different to scripted speech (Biber et al., 2004), the revised test uses semi-scripted spoken mini-lectures as stimulus passages rather than relying on scripted material. Test questions were developed using only the informational elements that four model comprehenders, proficient English listeners (both native and non-native), were able to retain from a single hearing of the passages. Test data from 222 students were analysed using a Rasch methodology. Results show that this test development method did result in testable content that was appropriately targeted at the population of interest, though several aspects of the process could be improved. The paper concludes with some recommendations for using semi-scripted language in academic listening tests.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"14 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74418277","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
Determining aspects of text difficulty for the Sign Language of the Netherlands (NGT) Functional Assessment instrument 确定荷兰手语(NGT)功能评估工具的文本难度方面
Q4 LINGUISTICS Pub Date : 2014-01-01 DOI: 10.58379/qghs6327
Annieck van den Broek-Laven, E. Boers-Visker, B. V. D. Bogaerde, Hogeschool Utrecht
In this paper we describe our work in progress on the development of a set of criteria to predict text difficulty in Sign Language of the Netherlands (NGT). These texts are used in a four year bachelor program, which is being brought in line with the Common European Framework of Reference for Languages (Council of Europe, 2001). Production and interaction proficiency are assessed through the NGT Functional Assessment instrument, adapted from the Sign Language Proficiency Interview (Caccamise & Samar, 2009). With this test we were able to determine that after one year of NGT-study students produce NGT at CEFR-level A2, after two years they sign at level B1, and after four years they are proficient in NGT on CEFR-level B2. As a result of that we were able to identify NGT texts that were matched to the level of students at certain stages in their studies with a CEFR-level. These texts were then analysed for sign familiarity, morpheme-sign rate, use of space and use of non-manual signals. All of these elements appear to be relevant for the determination of a good alignment between the difficulty of NGT signed texts and the targeted CEFR level, although only the morpheme-sign rate appears to be a decisive indicator.
在本文中,我们描述了我们在开发一套标准来预测荷兰手语(NGT)文本难度方面的工作进展。这些文本用于四年制学士课程,该课程符合欧洲共同语言参考框架(欧洲委员会,2001年)。生产能力和互动能力通过NGT功能评估工具进行评估,该工具改编自手语能力访谈(Caccamise & Samar, 2009)。通过这个测试,我们能够确定,经过一年的NGT学习,学生产生的NGT达到了cefr A2级,两年后他们达到了B1级,四年后他们熟练掌握了cefr B2级的NGT。因此,我们能够识别出NGT文本,这些文本与处于特定学习阶段的学生的cefr水平相匹配。然后分析这些文本的符号熟悉度,语素-符号率,空间使用和非手动信号的使用。所有这些因素似乎都与确定NGT签名文本的难度与目标CEFR水平之间的良好一致性有关,尽管只有语素-符号率似乎是一个决定性的指标。
{"title":"Determining aspects of text difficulty for the Sign Language of the Netherlands (NGT) Functional Assessment instrument","authors":"Annieck van den Broek-Laven, E. Boers-Visker, B. V. D. Bogaerde, Hogeschool Utrecht","doi":"10.58379/qghs6327","DOIUrl":"https://doi.org/10.58379/qghs6327","url":null,"abstract":"In this paper we describe our work in progress on the development of a set of criteria to predict text difficulty in Sign Language of the Netherlands (NGT). These texts are used in a four year bachelor program, which is being brought in line with the Common European Framework of Reference for Languages (Council of Europe, 2001). Production and interaction proficiency are assessed through the NGT Functional Assessment instrument, adapted from the Sign Language Proficiency Interview (Caccamise & Samar, 2009). With this test we were able to determine that after one year of NGT-study students produce NGT at CEFR-level A2, after two years they sign at level B1, and after four years they are proficient in NGT on CEFR-level B2. As a result of that we were able to identify NGT texts that were matched to the level of students at certain stages in their studies with a CEFR-level. These texts were then analysed for sign familiarity, morpheme-sign rate, use of space and use of non-manual signals. All of these elements appear to be relevant for the determination of a good alignment between the difficulty of NGT signed texts and the targeted CEFR level, although only the morpheme-sign rate appears to be a decisive indicator.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86697436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
C. Coombe, P. Davidson, B. O’Sullivan & S. Stoynoff. The Cambridge guide to second language assessment C. Coombe, P. Davidson, B. O 'Sullivan & S. Stoynoff。剑桥第二语言评估指南
Q4 LINGUISTICS Pub Date : 2014-01-01 DOI: 10.58379/cwjj2079
Naoki Ikeda
n/a
N/A
{"title":"C. Coombe, P. Davidson, B. O’Sullivan & S. Stoynoff. The Cambridge guide to second language assessment","authors":"Naoki Ikeda","doi":"10.58379/cwjj2079","DOIUrl":"https://doi.org/10.58379/cwjj2079","url":null,"abstract":"<jats:p>n/a</jats:p>","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"19 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90662435","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The effect of assessment of peer feedback on the quantity and quality of feedback given 评价同伴反馈对反馈数量和质量的影响
Q4 LINGUISTICS Pub Date : 2014-01-01 DOI: 10.58379/nmwl6229
Rachel Ruegg
There has been a great deal of debate about the value of peer feedback in L2 writing classes. Different aspects of the way peer feedback is implemented have been found to contribute to its effectiveness. The purpose of the current study is to ascertain whether the assessment of feedback given by peers increases the quantity or quality of feedback given. The study investigated two intact classes at a Japanese university. Both groups used peer feedback on every preliminary draft for an entire year. One was assessed only on the final draft of each essay and the other on the feedback they gave to their peers in addition to the final drafts. The feedback given by students was analysed and compared between the two groups. It was found that the feedback-assessed group covered more points, wrote more comments, longer comments, more words overall, made more marks on partners’ drafts, and made more specific comments than the product-assessed group. However, no significant difference was found between the accuracy of feedback in the two groups. The results suggest that if instructors want peer readers to give more feedback and to give more specific feedback, the feedback given by students should be assessed.
关于第二语言写作课堂上同伴反馈的价值,一直存在着大量的争论。实施同伴反馈的方式的不同方面已被发现有助于其有效性。本研究的目的是要确定对同伴所给予的反馈的评估是否增加了所给予的反馈的数量或质量。这项研究调查了日本一所大学的两个完整班级。两个小组在一整年的时间里,对每个初稿都采用了同行的反馈意见。其中一组只对每篇文章的最终草稿进行评估,另一组除了对最终草稿进行评估外,还对他们给同龄人的反馈进行评估。对两组学生的反馈进行分析比较。结果发现,与产品评估组相比,反馈评估组涵盖了更多的要点,写了更多的评论,更长的评论,总体上的字数更多,在合作伙伴的草稿上做了更多的标记,并做出了更具体的评论。然而,两组之间反馈的准确性没有显著差异。结果表明,如果教师希望同行读者给出更多的反馈,并给出更具体的反馈,则应评估学生给出的反馈。
{"title":"The effect of assessment of peer feedback on the quantity and quality of feedback given","authors":"Rachel Ruegg","doi":"10.58379/nmwl6229","DOIUrl":"https://doi.org/10.58379/nmwl6229","url":null,"abstract":"There has been a great deal of debate about the value of peer feedback in L2 writing classes. Different aspects of the way peer feedback is implemented have been found to contribute to its effectiveness. The purpose of the current study is to ascertain whether the assessment of feedback given by peers increases the quantity or quality of feedback given. The study investigated two intact classes at a Japanese university. Both groups used peer feedback on every preliminary draft for an entire year. One was assessed only on the final draft of each essay and the other on the feedback they gave to their peers in addition to the final drafts. The feedback given by students was analysed and compared between the two groups. It was found that the feedback-assessed group covered more points, wrote more comments, longer comments, more words overall, made more marks on partners’ drafts, and made more specific comments than the product-assessed group. However, no significant difference was found between the accuracy of feedback in the two groups. The results suggest that if instructors want peer readers to give more feedback and to give more specific feedback, the feedback given by students should be assessed.","PeriodicalId":29650,"journal":{"name":"Studies in Language Assessment","volume":"44 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2014-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73560257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
Studies in Language Assessment
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1