A 3D application to familiarize children with sign language and assess the potential of avatars and motion capture for learning movement

Abstract

In order to explore the potentialities of 3D tools for teaching and learning movements, we are developing a prototype of a 3D application that will give children a first contact with sign language through an interactive 3D signing avatar. It is not yet a finalized teaching tool but rather the first step in the process of exploring the possibilities given by a 3D character moving in a 3D environment to "connect" a child with a world of movement that he has to memorise and become familiar with. Our approach relies heavily on the fact that we have implemented a process to record movements of the body, the face, the eyes, and the fingers and transpose them onto an "avatar" with maximal accuracy and fidelity [3,5].