Using GWAP to Generate Informative Descriptions for Artwork Images on a Live Streaming Platform

Abstract

This paper proposes a method for creating informative descriptive sentences for artwork images by using “Games With a Purpose,” or GWAP on a live streaming platform. In existing studies, automatic annotation of images did not perform well, in particular, for artwork images such as Ukiyo-e. On the other hand, existing studies on GWAP, the concept of using games for human to address problems that computer cannot solve, demonstrated how games can exploit human intelligence in labeling images. With a huge number of audiences watching games live streaming on Twitch and other similar services nowadays, we propose a solution that makes chatting of audiences become an effective means for generating valuable descriptions for artwork images, Ukiyo-e images in this study, as well as promoting the interaction between the audiences and the game.