Humanoid avatar motion capture recording system in virtual lab for educational tutorials

Abstract

Flowing with the development of XX, virtual reality and augmented reality applications have been sprung up. More and more e-learning systems use the technology of AR and VR. Take VR for instance, with the powerful devices, the experiment can be much more immersive for immersive learning. But, by the professional division of labor, teachers or the designers of teaching materials is hard to making a content in VR or AR applications. In 3D virtual environment, it's not easy to making animations for 3D human models. Therefore, we made a recording system to make it convenient and effortless for teachers to create teaching materials in 3D e-learning system. We use Kinect V2 as sensors to capture the motion mapped form human body to the virtual character, and the facial expression mapped form human face, and the status of virtual objects which you can control the virtual character to interact with. Also the voice will be recorded synchronously. And the data will be exported as files. The animation files include the motions, facial expressions, the status of virtual objects and the voice. The animations recorded by our system can replay synchronously, and using in the virtual lab or virtual classroom as the tutorials and instructions.