Development of web-based crowdsourcing framework used for video quality assessment

Crowdsourcing as a new approach in the field of Quality of Experience (QoE) and an alternative to the traditional subjective laboratory testing has become popular and gradually expanded. In recent years several crowdsourcing web-based frameworks have been developed. In this paper we present a web-based crowdsourcing framework developed by multimedia team at our Department of Multimedia and Information-Communication Technology. The paper also deals with a description of term crowdsourcing in a general form as well as in a context of quality assessment. Furthermore, some differences between laboratory and crowdsourcing approaches are written. Moreover, several of the well-known existing frameworks are described.