Journal of My Journey: Seamless Interaction in Virtuality and Reality with Digital Fabrication and Sensory Feedback

Abstract

Whether in virtuality or reality, the decisions or actions pursue the goal we acquire in the virtual or real world. Besides, the decision or action that the users make in virtuality or reality only affects one physical or virtual environment. Previous works have revealed the concept of substitutional reality that utilizes the physical environment to enhance the immersive experience. However, there was no trace that the event in virtuality has parallel happened in the physical space. We present Journal of My Journey, an extended reality system with digital fabrication and sensory feedback for seamless interaction in virtuality and reality. The user’s behavior in the virtuality does affect reality. To show the ideal, we developed an immersive game to explore the possibilities of bringing sensory feedback from the real world to help with puzzle-solving in the game and exporting the output of the decisions made by the players perform in the virtual world into reality by using digital fabrication.