Towards Situation Awareness and Attention Guidance in a Multiplayer Environment using Augmented Reality and Carcassonne

Abstract

Augmented reality (AR) games are a rich environment for researching and testing computational systems that provide subtle user guidance and training. In particular computer systems that aim to augment a user’s situation awareness benefit from the range of sensors and computing power available in AR headsets. The main focus of this work-in-progress paper is the introduction of the concept of the individualized Situation Awareness-based Attention Guidance (SAAG) system used to increase humans’ situating awareness and the augmented reality version of the board game Carcassonne for validation and evaluation of SAAG. Furthermore, we present our initial work in developing the SAAG pipeline, the generation of game state encodings, the development and training of a game AI, and the design of situation modeling and eye-tracking processes.