The Evolution of User Knowledge during Search-as-Learning Sessions: A Benchmark and Baseline

Abstract

In this paper, we present a new benchmark collection that shows how 404 users’ knowledge changed over the course of a search-as-learning session. We estimate the knowledge a user gains from each visited document and monitor knowledge change on a document-by-document basis. We describe the specifics of how this collection was created and provide a use case that illustrates potential future applications.