Tim Stoeckel , Hung Tan Ha , Duyen Thi Bich Nguyen , Christopher Nicklin
{"title":"扩展匹配的第二语言词汇测试形式能否弥合意义识别和意义回忆之间的差距?","authors":"Tim Stoeckel , Hung Tan Ha , Duyen Thi Bich Nguyen , Christopher Nicklin","doi":"10.1016/j.rmal.2024.100109","DOIUrl":null,"url":null,"abstract":"<div><p>Meaning-recognition and meaning-recall vocabulary tests are commonly used to assess knowledge of the form-meaning link as it relates to the receptive skills. Although meaning-recognition is generally more convenient, think-aloud protocols have revealed that in comparison to meaning-recall, meaning-recognition is more susceptible to blind guessing and the use of construct-irrelevant test strategies. Perhaps because of this, meaning-recall tends to be a stronger predictor of reading ability. Following Budescu (1988), this article reports on three studies that investigated an extended-matching test (EMT) format that was designed to address these limitations of meaning-recognition while retaining its convenience. An EMT with 90 target words was developed. It contained three clusters, each with a 30:130 ratio of target words to Vietnamese L2 response options. In comparison to meaning-recall criterion measures, the EMT did not meaningfully differ in terms of internal reliability, mean scores, and, importantly, the strength of the correlation with reading comprehension scores. The consistency of correct/incorrect response classifications ranged from 83 % to 86 %. These initial findings suggest that the EMT format may be used interchangeably with meaning-recall for many research purposes.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100109"},"PeriodicalIF":0.0000,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Can an extended-matching second-language vocabulary test format bridge the gap between meaning-recognition and meaning-recall?\",\"authors\":\"Tim Stoeckel , Hung Tan Ha , Duyen Thi Bich Nguyen , Christopher Nicklin\",\"doi\":\"10.1016/j.rmal.2024.100109\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Meaning-recognition and meaning-recall vocabulary tests are commonly used to assess knowledge of the form-meaning link as it relates to the receptive skills. Although meaning-recognition is generally more convenient, think-aloud protocols have revealed that in comparison to meaning-recall, meaning-recognition is more susceptible to blind guessing and the use of construct-irrelevant test strategies. Perhaps because of this, meaning-recall tends to be a stronger predictor of reading ability. Following Budescu (1988), this article reports on three studies that investigated an extended-matching test (EMT) format that was designed to address these limitations of meaning-recognition while retaining its convenience. An EMT with 90 target words was developed. It contained three clusters, each with a 30:130 ratio of target words to Vietnamese L2 response options. In comparison to meaning-recall criterion measures, the EMT did not meaningfully differ in terms of internal reliability, mean scores, and, importantly, the strength of the correlation with reading comprehension scores. The consistency of correct/incorrect response classifications ranged from 83 % to 86 %. These initial findings suggest that the EMT format may be used interchangeably with meaning-recall for many research purposes.</p></div>\",\"PeriodicalId\":101075,\"journal\":{\"name\":\"Research Methods in Applied Linguistics\",\"volume\":\"3 2\",\"pages\":\"Article 100109\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research Methods in Applied Linguistics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2772766124000156\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Methods in Applied Linguistics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772766124000156","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Can an extended-matching second-language vocabulary test format bridge the gap between meaning-recognition and meaning-recall?
Meaning-recognition and meaning-recall vocabulary tests are commonly used to assess knowledge of the form-meaning link as it relates to the receptive skills. Although meaning-recognition is generally more convenient, think-aloud protocols have revealed that in comparison to meaning-recall, meaning-recognition is more susceptible to blind guessing and the use of construct-irrelevant test strategies. Perhaps because of this, meaning-recall tends to be a stronger predictor of reading ability. Following Budescu (1988), this article reports on three studies that investigated an extended-matching test (EMT) format that was designed to address these limitations of meaning-recognition while retaining its convenience. An EMT with 90 target words was developed. It contained three clusters, each with a 30:130 ratio of target words to Vietnamese L2 response options. In comparison to meaning-recall criterion measures, the EMT did not meaningfully differ in terms of internal reliability, mean scores, and, importantly, the strength of the correlation with reading comprehension scores. The consistency of correct/incorrect response classifications ranged from 83 % to 86 %. These initial findings suggest that the EMT format may be used interchangeably with meaning-recall for many research purposes.