From the total survey error framework to an error framework for digital traces of humans: translation tutorial

Abstract

The digital traces of hundreds of millions of people offer increasingly comprehensive pictures of both individuals and groups on different platforms, but also allow inferences about broader target populations beyond those platforms. Studying the errors that can occur when digital traces are used to learn about humans and social phenomena is essential. Many similar errors also affect survey estimates, which survey designers have been addressing for decades, most notably using the Total Survey Error Framework (TSE). In this tutorial, we first introduce the audience to the concepts and guidelines of the TSE and how they are applied by survey practitioners in the social sciences. Second, we introduce our own conceptual framework to diagnose, understand, and avoid errors that may occur in studies that are based on digital traces of humans.