The Effect of Device Type on Achievement: Evidence from a Quasi-Experimental Design

Abstract

ABSTRACT As more states move to universal computer-based assessments, an emergent issue concerns the effect that device type might have on student results. Although, several research studies have explored device effects, most of these studies focused on the differences between tablets and desktops/laptops. In the current study, we distinguish between different types of devices to better examine the differences. Specifically, we used Indiana state assessment results from grades 3 and 8 and a propensity score weighting method to see if a student took the assessment on another device, would they have received the same score? Our findings suggest that there are significant differences by device type in both grades. In particular, iPad and Chromebook devices produced higher achievement when compared to Mac and PC devices. At the extreme, these differences amounted to close to a third of a standard deviation on the achievement scale.