Poster: Sonicnect: Accurate Hands-Free Gesture Input System with Smart Acoustic Sensing

Abstract

This work presents Sonicnect, an acoustic sensing system with smartphone that enables accurate hands-free gesture input. Sonicnect leverages the embedded microphone in the smartphone to capture the subtle audio signals generated with fingers touching on the table. It supports 9 commonly used gestures (click, flip, scroll and zoom, etc) with above 92% recognition accuracy, and the minimum gesture movement could be 2cm. Distinguishable features are then extracted by exploiting spatio-temporal and frequency properties of the subtle audio signals. We conduct extensive real environment experiments to evaluate its performance. The results validate the effectiveness and robustness of Sonicnect.