Dimensions for the design and evaluation of multimodal videogames for the cognition of people who are blind

Abstract

Multimodal serious video games are relevant tools to enhance the cognitive skills of people who are blind. For this purpose, it is necessary that designers and developers be able to create interfaces and interactions using the multimodal elements properly. Thus, there is a need to know the relevant elements for such applications, as well as to understand their roles and relationships. In this paper, we propose and discuss a 4-dimension classification: Interface, Interaction, Cognition, and Evaluation. Such classification was assembled from the features related to the design and evaluation of 21 multimodal video games and environments, identified via a bibliographic review based on the systematic review approach. Besides, we classify and discuss the 21 multimodal applications into the proposed classification.