Exploring distilled spirits brewing: Utilizing multimodal interaction and intelligent virtual avatars in a VR liquor culture museum

Abstract

The distilled liquor brewing technique is one of China’s national-level intangible cultural heritages, and it has a rich history. In order to enhance public awareness and understanding of this technique, previous researchers have utilized digital technologies such as virtual reality to create virtual museums for disseminating and showcasing its cultural significance. However, existing virtual museums often employ passive roaming displays, lacking interactivity, immersion, and engagement, which makes it challenging to attract the younger generation. This paper introduces a multimodal interactive virtual liquor culture museum system. By incorporating sensory feedback such as visual, auditory, tactile, and temperature cues, participants can learn about and experience the art of distilled liquor brewing. Within the museum, three virtual avatars (visitor, guide, poet) are implemented and powered by advanced language models, enabling continuous dialogue and interactive gameplay with participants and enhancing immersion and interest. The study, validated through evaluations involving 30 participants, demonstrates the usability and effectiveness of the System.