Challenges and Benefits of Developing CEFR for Languages-Aligned Writing Assessments for Thai EFL Learners: A Case Study on Yala Rajabhat University Test of English Proficiency

Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal
{"title":"Challenges and Benefits of Developing CEFR for Languages-Aligned Writing Assessments for Thai EFL Learners: A Case Study on Yala Rajabhat University Test of English Proficiency","authors":"Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal","doi":"10.24093/awej/vol15no1.22","DOIUrl":null,"url":null,"abstract":"This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.","PeriodicalId":505235,"journal":{"name":"Arab World English Journal","volume":"19 15","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Arab World English Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.24093/awej/vol15no1.22","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
为泰国 EFL 学习者开发与语言 CEFR 一致的写作评估的挑战和益处:Yala Rajabhat 大学英语水平测试案例研究
本研究旨在探讨本地标准化测试--亚拉拉贾巴特大学英语水平测试(YRU-TEP)--针对特定地区的发展情况,并与另一个标准化测试--英语发现--相比,探讨该测试与《欧洲语言共同参考框架》的一致性。本研究侧重于泰国英语作为外语学习者的语境。在编写测试项目时,专家小组对每个项目所评估的每项技能的目标进行了讨论,并达成了一致意见,因此采用了 "能做到"(Can-Do)陈述。同时,专家们还通过 "项目目标一致性指数 "对每个项目进行了评估。通过有目的的随机抽样,共有三百个实验组的应试者参与其中。为了探究 YRU-TEP 是否与 CEFR 能力水平相一致,我们还采用了另一个标准化测试,即由 ETS 开发的 "英语发现"。实验测试者参加了这两项测试,并按照分数线计算分数,以确定两者是否相当。结果显示,98.67% 的分数具有相同的 CEFR 水平。然而,在这种情况下实施与 CEFR 接轨的写作评估存在挑战。要应对这些挑战,就必须根据泰国的国情调整 CEFR,确保文化相关性,完善评估标准,并有效管理资源。这项工作有助于规范语言能力评估实践,提高英语语言教育的质量,尤其是像 YRU-TEP 这样的本地测试。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Exploring Challenges and Impacts: Insights from School Teachers in Virtual Learning Environments Saudia EFL Students’ Attitudes toward the Usage of Web-Enhanced Language Learning Evaluating the Effects of Artificial Intelligence Homework Assistance Tools on High School Students’ Academic Performance and Personal Development Digital Collaborative Learning: Promoting Reading Comprehension and Vocabulary among Saudi University English Majors A Content Analysis of Lesson Starters in English Language YouTube Videos
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1