An empirical exploration of the subjectivity problem of information qualities

Abstract

Information qualities such as usefulness, accuracy, and comprehensiveness are to some extent subjective. Information resources have different meanings to different people and at different moments. This apparent subjectivity hinders indexing based on qualities for retrieval and filtering purposes. We conceptualize this as the subjectivity problem and address it through two studies. Study One explores whether, on public fora, people consider qualities as claims they should agree upon. Study Two explores, through a vignettes study, which conditions foster this inter-subjective validity of quality claims. We conclude that information qualities become agreeable given the right set of conditions. We discuss the need for transparency about information qualities and quality considerations in order to offer these conditions to end users.