How justified are the criticisms of bias against the OECD's global competence framework?

Abstract

In psychometric terms, bias is defined as the failure to ensure the psychological equivalence of the latent traits and related items intended to be measured by measurement procedures for different groups and therefore the measurements produce results in favor of or against at least one group. There has been both public and scientific criticism that it contains bias in terms of some features such as the OECD's global competence framework is designed according to the principles of the western liberal tradition, that students interpret words and expressions in some items differently, that their understanding of poverty and privilege is limited, and that students' lack of access to communication tools due to socio-economic conditions. In this research, we examined whether the OECD's global competence framework presented to students in the PISA 2018 assessment is statistically biased in terms of sociological features that encompass and even go beyond criticisms of the framework. In this context, we used six international classification indices and analyzed data on around 143 thousand students from 27 PISA participating countries. We believe that results will clarify criticisms of bias in the OECD's global competence framework.