Creating a live real-time performance-captured digital human

Abstract

Epic Games teamed up with Ninja Theory, Cubic Motion, and 3Lateral to create the world's first believable human driven live by an actress within an Unreal Engine game world. The project was developed in seven weeks thanks to breakthrough advances in Unreal Engine character technology, real-time facial solving, digital face scanning and rigging, and beautiful art. In this demonstration, body, face, and voice are all captured live in real time and recorded to create a real-time scene.