Immersive virtual 3D environment based on 499 fps hand gesture interface

Abstract

This paper presents an immersive and highly responsive virtual 3D environment. By combining state of the art 3D display device zSpace and a high speed 499 fps hand gesture interface system a truly immersive system is achieved. Truly immersive virtual 3D environment can only be achieved with low latency interaction. Utilizing high speed camera, the system is capable of detecting two hands simultaneously. The system offers temporal congruency, spatial congruency, and intuitive interaction. The system offers temporal congruency by having a end-to-end latency of only 27.7 ms. It also offers spatial congruency with an accuracy of less than 3mm. It also provides intuitive interaction by allowing the user to use simple hand gestures to interact with the system. Small and fast movements can be detected easily in this system. Therefore, this system is suitable for settings where reflex speed response is required from the user. The possibility to operate using bare hand also offers a convenience in setting where hand hygiene is important such as in medical surgery.