Active wearable vision sensor: recognition of human activities and environments

To realize a symbiotic relationship between humans and computers, it is crucial to estimate the external and internal state of the human by observation. One promising approach is to acquire the same visual information as the human acquires. We introduce our wearable vision sensor, which is equipped with a pair of active stereo cameras and a gaze-direction detector. From the visual information obtained by the wearable vision sensor, we present three basic three functionalities: 3D gaze point detection and image retrieval, 3D digitization of a hand-held object, and the measurement of a walking trajectory.