Sonification of a juggling performance using spatial audio

We developed a new musical instrument by equipping juggling balls with accelerometers, gyroscopes, and WiFi sensors. The system measures acceleration and rotation, allowing us to distinguish between ball movement and static states. We can determine the direction of each throw based on the acceleration data. A movement-driven instrument animates the virtual audio source position based on the throw direction. A different synthesizer is assigned to each ball, resulting in a synesthetic experience. The system integrates the juggling patterns simulator with OSC and MIDI API, allowing real-time rhythm generation and composition.