Studying the Context Effect of Family Norms on Gender Role Attitudes: an Experimental Design

The measurement of gender role attitudes has been found to be problematic in previous studies, especially in comparative perspective. The present study adopts a novel approach and investigates the position of the gender role attitudes scale in the questionnaire as a potential source of bias. In particular, the present study aims at assessing the context effect of the family norms question on the measurement of gender role attitudes by adopting the theoretical perspective of the construal model of attitudes, according to which the adjacent questions constitute the context for interpreting and answering a stimulus. The study employs data from the CROss-National Online Survey panel, which was fielded in 2017 and contained an experiment where the order of the questions under investigation varied. The reliability, validity and invariance of the measurement of gender role attitudes across experimental settings and countries (Estonia, Great Britain and Slovenia) are explored adopting several analytical techniques, such as regression models and multiple-group confirmatory factor analysis. Differences between experimental settings emerged, suggesting that the questionnaire context matters for the validity and stability of the gender role attitudes items; however, the lack of patterns hinders general conclusions on what is the order of questions yielding better measurement of the gender role attitudes scale. Clear differences among the countries indicate that the cultural context may interact with the question context. Finally, we stress that the measurement is overall poor, urging to find a better formulation of the items measuring gender role attitudes.