Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal
{"title":"为泰国 EFL 学习者开发与语言 CEFR 一致的写作评估的挑战和益处:Yala Rajabhat 大学英语水平测试案例研究","authors":"Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal","doi":"10.24093/awej/vol15no1.22","DOIUrl":null,"url":null,"abstract":"This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.","PeriodicalId":505235,"journal":{"name":"Arab World English Journal","volume":"19 15","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Challenges and Benefits of Developing CEFR for Languages-Aligned Writing Assessments for Thai EFL Learners: A Case Study on Yala Rajabhat University Test of English Proficiency\",\"authors\":\"Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal\",\"doi\":\"10.24093/awej/vol15no1.22\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.\",\"PeriodicalId\":505235,\"journal\":{\"name\":\"Arab World English Journal\",\"volume\":\"19 15\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Arab World English Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.24093/awej/vol15no1.22\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Arab World English Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.24093/awej/vol15no1.22","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Challenges and Benefits of Developing CEFR for Languages-Aligned Writing Assessments for Thai EFL Learners: A Case Study on Yala Rajabhat University Test of English Proficiency
This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.