A Tree-Based Approach to Identifying Response Styles with Anchoring Vignettes

Abstract

ABSTRACT Survey score interpretations are often plagued by sources of construct-irrelevant variation, such as response styles. In this study, we propose the use of an IRTree Model to account for response styles by making use of self-report items and anchoring vignettes. Specifically, we investigate how the IRTree approach with anchoring vignettes compares to traditional approaches that either do not include anchoring vignettes or do not account for response styles. We analyze secondary data using four different models: 1) total score; 2) graded response model; 3) IRTree without the consideration of anchoring vignettes, and 4) IRTree considering anchoring vignettes. We found significant differences in trait estimates from models that account for response styles compared to those that do not. Additionally, we found differences in trait estimates between the IRTree Models when considering anchoring vignettes and when not. Model comparisons suggest that trait differences are due to adjusting for acquiescence response style.