Collaborative real-time speaker identification for wearable systems

Abstract

We present an unsupervised speaker identification system for personal annotations of conversations and meetings. The system dynamically learns new speakers and recognizes already known speakers using one audio channel and speech-independent modeling. Multiple personal systems could collaborate in robust unsupervised speaker identification and online learning. The system was optimized for real-time operation on a DSP system that can be worn during daily activities. The system was evaluated on the freely available 24-speaker Augmented Multiparty Interaction dataset. For 5 s recognition time, the system achieves 81% recognition rate. Collaboration between four identification systems resulted in a performance increase of up to 17%, however even two collaborating systems yield an performance improvement. A prototypical wearable DSP implementation could continuously operate for more than 8 hours from a 4.1 Ah battery.