A Speech Promotion System by Using Embodied Entrainment Objects of Spoken Words and a Listener Character for Joint Attention

Abstract

We have developed a speech promotion system that presents images retrieved based on spoken words on a display and shows the auto-generated nodding reaction of the search images with a listener character. The online image search function can respond to various utterances of the user. In this research, in order to speed up the time to present images, we prepare not only the online image search function but also the pre-stored image call function. Moreover, the listener character in the system moves to look at the image at the same time that it appears. This character's motion prompts the user to observe the image by joint attention guidance. Thus, the system promotes user's speech by the auto-generated nodding reaction of the listener character and images related to spoken words.