Poster: Sonicnect: Accurate hands-free gesture input system with smart acoustic sensing

• Main Authors: CHANG, Maotian, LI, Ping, YANG, Panlong, Jie XIONG, TIAN, Chang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2016
• Subjects: Acoustic sensing; Audio signal; Gesture input; Hands-free; Recognition accuracy; Spatio temporal; Computer Sciences; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/3393; https://ink.library.smu.edu.sg/context/sis_research/article/4394/viewcontent/PosterSonicnectAccuratehands_freegestureinputsystemwithsmartacousticsensing.pdf
• Institution: Singapore Management University

This work presents Sonicnect, an acoustic sensing system with smartphone that enables accurate hands-free gesture input. Sonicnect leverages the embedded microphone in the smartphone to capture the subtle audio signals generated with fingers touching on the table. It supports 9 commonly used gestures (click, flip, scroll and zoom, etc) with above 92% recognition accuracy, and the minimum gesture movement could be 2cm. Distinguishable features are then extracted by exploiting spatio-temporal and frequency properties of the subtle audio signals. We conduct extensive real environment experiments to evaluate its performance. The results validate the effectiveness and robustness of Sonicnect.