Learning gestures from WiFi: a Siamese recurrent convolutional architecture

We propose a gesture recognition system that leverages existing WiFi infrastructures and learns gestures from Channel State Information (CSI) measurements. Having developed an innovative OpenWrt-based platform for commercial WiFi devices to extract CSI data, we propose a novel deep Siamese represent...

全面介紹

Saved in:
書目詳細資料
Main Authors: Yang, Jianfei, Zou, Han, Zhou, Yuxun, Xie, Lihua
其他作者: School of Electrical and Electronic Engineering
格式: Article
語言:English
出版: 2022
主題:
在線閱讀:https://hdl.handle.net/10356/162593
標簽: 添加標簽
沒有標簽, 成為第一個標記此記錄!
實物特徵
總結:We propose a gesture recognition system that leverages existing WiFi infrastructures and learns gestures from Channel State Information (CSI) measurements. Having developed an innovative OpenWrt-based platform for commercial WiFi devices to extract CSI data, we propose a novel deep Siamese representation learning architecture for one-shot gesture recognition. Technically, our model extends the capacity of spatio-temporal patterns learning for the standard Siamese structure by incorporating convolutional and bidirectional recurrent neural networks. More importantly, the representation learning is ameliorated by our Siamese framework and transferable pairwise loss which helps to remove structured noise such as individual heterogeneity and various measurement conditions during domain-different training. Meanwhile, our Siamese model also enables one-shot learning for higher availability in reality. We prototype our system on commercial WiFi routers. The experiments demonstrate that our model outperforms state-of-the-art solutions for temporal-spatial representation learning and achieves satisfactory results under one-shot conditions.