In international education studies, the different-language test versions need to be equally difficult to read and answer for the test to be valid. To ensure comparability, several quality control procedures have been developed. Among these, surprisingly little attention has been paid to judgmental reviews and their ability to identify language-related sources of bias. Also, the reviews have often failed in identifying biases. This paper explored whether it is possible to improve the ability of judgmental reviews to identify language-related sources of bias. A new review was made of two Finnish items which in the PISA (Programme for International Student Assessment) 2000 reading test showed differential item functioning but for which no clear language-related explanations were found in the review in 2000. The items were compared systematically, at all linguistic levels, to the corresponding items in the English and French source versions, at the same time taking into account the cognitive processes required to answer them and students’ written responses to them. Language-related explanations were found for both items which may have led to differences in performance, suggesting that it is possible to make judgmental reviews better able to identify language-related bias. Suggestions are given on how to do this.
{"title":"International Education Studies: Increasing Their Linguistic Comparability by Developing Judgmental Reviews","authors":"Inga Arffman","doi":"10.5402/2012/179824","DOIUrl":"https://doi.org/10.5402/2012/179824","url":null,"abstract":"In international education studies, the different-language test versions need to be equally difficult to read and answer for the test to be valid. To ensure comparability, several quality control procedures have been developed. Among these, surprisingly little attention has been paid to judgmental reviews and their ability to identify language-related sources of bias. Also, the reviews have often failed in identifying biases. This paper explored whether it is possible to improve the ability of judgmental reviews to identify language-related sources of bias. A new review was made of two Finnish items which in the PISA (Programme for International Student Assessment) 2000 reading test showed differential item functioning but for which no clear language-related explanations were found in the review in 2000. The items were compared systematically, at all linguistic levels, to the corresponding items in the English and French source versions, at the same time taking into account the cognitive processes required to answer them and students’ written responses to them. Language-related explanations were found for both items which may have led to differences in performance, suggesting that it is possible to make judgmental reviews better able to identify language-related bias. Suggestions are given on how to do this.","PeriodicalId":202265,"journal":{"name":"ISRN Education","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2012-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126610471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Time has been argued by several influential approaches as essential for understanding learning and teaching processes. In e-learning, however, the traditional time limits of such processes are modified, which implies challenges and possibilities for e-learning research. This paper is aimed at understanding how time is included in empirical e-learning research literature. With this aim in mind, the paper presents a qualitative review of 24 e-learning papers. Five issues are analysed: the conception of time, its inclusion in an explicative model, its inclusion in the research process, the analytical units, and the data used in the study of time. Based on our analysis, we discuss some implications and potentialities for e-learning research on the relations between time and learning.
{"title":"Time in e-learning research: a qualitative review of the empirical consideration of time in research into e-learning","authors":"E. Barberá, M. Clarà","doi":"10.5402/2012/640802","DOIUrl":"https://doi.org/10.5402/2012/640802","url":null,"abstract":"Time has been argued by several influential approaches as essential for understanding learning and teaching processes. In e-learning, however, the traditional time limits of such processes are modified, which implies challenges and possibilities for e-learning research. This paper is aimed at understanding how time is included in empirical e-learning research literature. With this aim in mind, the paper presents a qualitative review of 24 e-learning papers. Five issues are analysed: the conception of time, its inclusion in an explicative model, its inclusion in the research process, the analytical units, and the data used in the study of time. Based on our analysis, we discuss some implications and potentialities for e-learning research on the relations between time and learning.","PeriodicalId":202265,"journal":{"name":"ISRN Education","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2012-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114609362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：