LumoSpheres: real-time tracking of flying objects and image projection for a volumetric display

Abstract

This paper proposes a method for real-time tracking of flying objects and image projection onto them for developing a particle-based volumetric 3D display. The first section describes the concept using high-speed cameras and projectors for a particle-based volumetric 3D display. Our solution suggests a prediction model with kinematic laws and uses Kalman Filters to address latency issues within the projector-camera system. We conducted experiments to show the accuracy of the image projection. We also present an application of our method in entertainment, Digital Juggling.