Immersive experience of Chinese poems and paintings

Abstract

Chinese painting incorporated with poems is famous for its distinct characteristics and unspeakable moods. Ink lines are used to depict scenes in paintings while concise words are used to describe scenes and events in poems, making for a beautiful yet enigmatic art style. Such an art style requires viewers to patiently examine the details and attempt to understand the meaning, which creates a barrier for a wide audience to relish and disseminate it. The condition can be effectively improved with immersive and interactive animation techniques. In this paper, we present the design and production of an interactive 3D animation entitled "Illustrating Ten Poems" based on the famous Chinese painting with the same name. Compared with viewing the original painting, the animation provides immersive scene reconstruction in Chinese painting style, interactive characters and visual-audio experience. Rather than complete three-dimensional reconstruction, we attempted some innovative methods which proved to be effective and efficient in Chinese painting style artwork production.