Cross-domain applications of multimodal human-computer interfaces

Abstract

Summary form only given. Developed multimodal interfaces for education applications and for disabled people are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with mouth gestures and audio interface for speech stretching for hearing impaired and stuttering people and intelligent pen allowing for diagnosing and ameliorating developmental dyslexia. The eye-gaze tracking system named “CyberEye” is presented including the method of analysis of visual activity of patients remaining in vegetative state helping to assessment of their awareness. The scent emitting multimodal computer interface is also discussed. A new approach to diagnosing Parkinson's disease is shown which is used to evaluate motor and behavioral symptoms of the neurodegenerative disease. The paper is concluded with some more topics & demonstrations of technologies developed for applications to intelligent surveillance systems, environment monitoring systems and automated solutions for enhancement of degraded audio recordings.