Hana Vonkova , Ondrej Papajoanu , Angie Moore , Katerina Kralova
{"title":"Examining how students overclaim their English as a foreign language knowledge: A novel use of the overclaiming technique","authors":"Hana Vonkova , Ondrej Papajoanu , Angie Moore , Katerina Kralova","doi":"10.1016/j.stueduc.2024.101338","DOIUrl":null,"url":null,"abstract":"<div><p>Student self-reports of knowledge are widely used by researchers and educators, though their accuracy has been questioned due to potential biases. The overclaiming technique (OCT), based on the familiarity ratings of existing (reals) and non-existing (foils) items, has been used to identify accuracy and exaggeration in respondents’ self-reports. We developed an original English OCT measure specifically for students who learn English as a foreign language (EFL). Our sample consists of Czech lower secondary students (N = 1391). We show that students’ foil claiming relates to their gender, EFL exposure at school, at home, in their free time, and through peers, but not to their school type. School type, however, is a relevant factor in the claiming of reals. Warning about foils relates to lower foil claiming. Further research could examine students’ understanding of OCT items through cognitive interviews and extend the use of the OCT to other foreign languages.</p></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"81 ","pages":"Article 101338"},"PeriodicalIF":2.6000,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Studies in Educational Evaluation","FirstCategoryId":"95","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0191491X24000178","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Student self-reports of knowledge are widely used by researchers and educators, though their accuracy has been questioned due to potential biases. The overclaiming technique (OCT), based on the familiarity ratings of existing (reals) and non-existing (foils) items, has been used to identify accuracy and exaggeration in respondents’ self-reports. We developed an original English OCT measure specifically for students who learn English as a foreign language (EFL). Our sample consists of Czech lower secondary students (N = 1391). We show that students’ foil claiming relates to their gender, EFL exposure at school, at home, in their free time, and through peers, but not to their school type. School type, however, is a relevant factor in the claiming of reals. Warning about foils relates to lower foil claiming. Further research could examine students’ understanding of OCT items through cognitive interviews and extend the use of the OCT to other foreign languages.
学生对知识的自我报告被研究人员和教育工作者广泛使用,但由于潜在的偏差,其准确性受到质疑。过度声称技术(OCT)基于对现有(真实)和不存在(陪衬)项目的熟悉程度评分,已被用于识别受访者自我报告中的准确性和夸大性。我们专门为将英语作为外语(EFL)学习的学生开发了一种原创的英语 OCT 测量方法。我们的样本包括捷克初中学生(N = 1391)。我们的研究表明,学生的铝箔自称与他们的性别、在学校、家里、课余时间以及通过同伴接触 EFL 的情况有关,但与学校类型无关。然而,学校类型是影响学生声称真实的一个相关因素。对箔片的警告与较低的箔片认读率有关。进一步的研究可以通过认知访谈来考察学生对 OCT 项目的理解,并将 OCT 的使用扩展到其他外语。
期刊介绍:
Studies in Educational Evaluation publishes original reports of evaluation studies. Four types of articles are published by the journal: (a) Empirical evaluation studies representing evaluation practice in educational systems around the world; (b) Theoretical reflections and empirical studies related to issues involved in the evaluation of educational programs, educational institutions, educational personnel and student assessment; (c) Articles summarizing the state-of-the-art concerning specific topics in evaluation in general or in a particular country or group of countries; (d) Book reviews and brief abstracts of evaluation studies.