Evaluation of usability improvement of contactless human interface with visual, auditory, and tactile sensation for aerial display

Abstract

We revealed the optimal feedback parameters of visual, auditory, and tactile modalities in the operation of aerial display and determined that aerial display could be further improved for use of as a contactless human interface by multimodal feedback combining these parameters. We proposed applying a vibration motor to the sole of the foot instead of fingertips to provide vibration as tactile feedback to operate the aerial display. Sensory evaluation tests were carried out to evaluate the optimal feedback parameters for operating the aerial display in three senses: visual (image change); auditory (touch tone); and tactile (vibration), and to evaluate the effect on the operation with a combination of these parameters. We analyzed the variance of the experimental data using Scheffé’s method for obtaining significance levels of paired comparisons. We found that the combination of two or three modalities rather than only a single modality makes the aerial display easy to operate.