Use of Augmented Reality to Train Sensemaking in High-Stakes Medical Environments

Abstract

We present a framework for using augmented reality (AR) to train sensemaking skills in combat medics and civilian emergency medical personnel. AR and other extended reality technologies create engaging training environments, but their effectiveness on training outcomes is not yet clear. One benefit of AR is that it can enhance simulation training with realism and context that naturalistic decision-making (NDM) models emphasize. We describe four key elements of sensemaking that leverage the strengths of AR: perceptual skills, assessment skills, mental models, and generating/evaluating hypotheses. We discuss how AR can be used to train each of these four elements, along with design implications. A focus on naturalistic tasks and environments while designing AR-based simulation training will likely lead to training that is not only engaging but also effective.