Contrasts and similarities between two audio research communities in evaluating auditory artefacts

Abstract

The design of auditory artefacts has been establishing its practice as a scientific area for more than 20 years, with a crucial element in this process being how to properly evaluate acoustic outputs. In this paper, we sought to map the evaluation methods applied in a general search inside two main audio-focused conferences: Audio Mostly and the International Conference on Auditory Display (ICAD). Revisiting last year's editions, as well as a keyword-based search in the last ten years, we attempted to gather and classify each evaluation method according to the level of user involvement, their role, and the authors intentions in using each method. We propose an initial mapping for this gathering, in a framework of evaluation approaches which can reinforce and expand current practices in the creation of auditory artefacts.