Yixiao Dong, Denis G. Dumas, D. Clements, Crystal Day-Hess, Julie Sarama
{"title":"Evaluating the Consequential Validity of the Research-Based Early Mathematics Assessment","authors":"Yixiao Dong, Denis G. Dumas, D. Clements, Crystal Day-Hess, Julie Sarama","doi":"10.1177/07342829231165812","DOIUrl":null,"url":null,"abstract":"Consequential validity (often referred to as “test fairness” in practice) is an essential aspect of educational measurement. This study evaluated the consequential validity of the Research-Based Early Mathematics Assessment (REMA). A sample of 627 children from PreK to second grade was collected using the short form of the REMA. We conducted two sets of analyses with different foci (item- or scale-level) for validation: differential item functioning (DIF) and consequential validity ratio (CVR) analyses. The analyses focused on the demographic subgroups of gender, English Language Learner status, and race/ethnicity. We found a low percentage of DIF items (less than 3%) and high CVRs (ranging from 96 to 98%). Both findings support the consequential validity and thus “fairness” of the REMA.","PeriodicalId":51446,"journal":{"name":"Journal of Psychoeducational Assessment","volume":"41 1","pages":"575 - 582"},"PeriodicalIF":1.5000,"publicationDate":"2023-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Psychoeducational Assessment","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/07342829231165812","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PSYCHOLOGY, EDUCATIONAL","Score":null,"Total":0}
引用次数: 0
Abstract
Consequential validity (often referred to as “test fairness” in practice) is an essential aspect of educational measurement. This study evaluated the consequential validity of the Research-Based Early Mathematics Assessment (REMA). A sample of 627 children from PreK to second grade was collected using the short form of the REMA. We conducted two sets of analyses with different foci (item- or scale-level) for validation: differential item functioning (DIF) and consequential validity ratio (CVR) analyses. The analyses focused on the demographic subgroups of gender, English Language Learner status, and race/ethnicity. We found a low percentage of DIF items (less than 3%) and high CVRs (ranging from 96 to 98%). Both findings support the consequential validity and thus “fairness” of the REMA.
期刊介绍:
The Journal of Psychoeducational Assessment (JPA) publishes contemporary and important information focusing on psychological and educational assessment research and evidence-based practices as well as assessment instrumentation. JPA is well known internationally for the quality of published assessment-related research, theory and practice papers, and book and test reviews. The methodologically sound and impiricially-based studies and critical test and book reviews will be of particular interest to all assessment specialists including practicing psychologists, psychoeducational consultants, educational diagnosticians and special educators.