An Intelligent Guiding System using Face Information and Vision-based Mouse-Interaction User Interface

Abstract

A guiding system is a specific mechanism that is used for providing key responses or information for the visitors. However, traditional guiding systems certainty have several disadvantages such like without real-time interaction with users and monotonous. This paper presents an intelligent guiding system, which allows a user to real-time interact with it without any additional auxiliaries. At first, a real-time front-view face detection using Harr-like features is used to decide when the guiding system should wake up and become interactive with the user. After system initialization, we keep on finding some feature points within the detected face area. Then we estimate the orientation of user's head via pyramidal Lucas-Kanade optical flow tracking. The performance of vision-based mouse-interaction in our system could be reached to 20 fps and people could get the right response in 1.9 seconds averagely under Pentium IV 1G Hz PC. Compared to the traditional guiding system, our system has more flexibility. Information providers could choose a suitable display equipment according to the surround environment. With the comparison to other non-vision-based input devices such like gloves or markers, our system offers a simple, useful and economical solution for the real-time interaction between the user and computer