Speech-based Multimodal Interaction in Virtual Environments: Research at the Thomson-CSF Corporate Research Laboratories

Abstract

The Thomson-CSF Corporate Research Laboratories are investigating the issues of user-interface design, spoken and multimodal interaction design and realization in virtual environments. This paper describes our technical approach to speech-enabled multimodal virtual environments, based on our past achievements in the multimodal interaction domain, and presents our main supporting projects in this area. These projects involve augmented reality for maintenance, military situation building and assessment, and collaborative virtual environments.