2nd International EvalUMAP Workshop (EvalUMAP2017) Chairs' Preface & Organization

Abstract

It is our great pleasure to welcome you to the UMAP 2017 EvalUMAP workshop. The purpose of this workshop series is to establish comparative evaluation tasks and a suitable framework to support researchers in the user modelling and personalisation research field in comparing their research to that of others. In 2016 we discussed the key challenges in performing such comparative evaluations. This year we focus on the challenges of identifying appropriate datasets and methods. In particular, the planned outcomes of the workshop this year are as follows: (1) Understand the challenges and requirements related to the design of a shared task approach in User Modeling, Adaptation and Personalization space, (2) identify suitable and publicly accessible datasets that overcome the previous identified challenges and requirements and (3) using the identified datasets start designing shared evaluation tasks that will be performed throughout 2017 and be presented at UMAP 2018.