Intelligent user interfaces

Abstract

Summary form only given. Humans communicate through natural modalities such as speech, sketching, facial expressions and gestures. Even eye-gaze and forces felt through physical interaction supply subtle, but important, bits of information in human-human communication. However, our communication with computers is primarily over ancient hardware such as mice and keyboards. A new generation of user interfaces, called intelligent or natural user interfaces is on the rise. These interfaces advocate smart and natural interaction that are also engaging and fun. In this tutorial, we well briefly survey the filed of intelligent user interfaces, give examples of existing systems. We will discuss supporting technologies (such as classification, regression, computer vision, and tracking), and supporting hardware including haptic interfaces, pen-based devices, camera and microphone arrays. We will also cover interaction design tools, design principles and techniques including wizard-of-oz evaluations, and paper prototypes.