AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation methods are predominantly evaluated under controlled laboratory conditions with sophisticated vision models to acquire accur...
Saved in:
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2025
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/181961 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-181961 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1819612025-01-06T04:43:15Z AdaPose: toward cross-site device-free human pose estimation with commodity WiFi Zhou, Yunjiao Yang, Jianfei Huang, He Xie, Lihua School of Electrical and Electronic Engineering School of Mechanical and Aerospace Engineering Engineering Domain adaptation Feature alignment WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation methods are predominantly evaluated under controlled laboratory conditions with sophisticated vision models to acquire accurately labeled data. Furthermore, WiFi channel state information (CSI) is highly sensitive to environmental variables, and direct application of a pretrained model to a new environment may yield suboptimal results due to domain shift. In this article, we propose a domain adaptation algorithm, AdaPose, designed specifically for WiFi-based pose estimation. The proposed method aims to identify consistent human poses that are highly resistant to environmental dynamics and WiFi signal noises. To achieve this goal, we introduce instance-wise consistency alignment loss that aligns domain shifts considering instance-wise pose distribution variance, and cross-environment channel enhancement module that enhances WiFi CSI feature representation by emphasizing channel-wise similarity between source and target domains. We conduct extensive experiments on both our self-collected pose estimation data set and a large public MM-Fi data set. The results demonstrate the effectiveness and robustness of AdaPose in eliminating domain shift, thereby facilitating the widespread application of WiFi-based pose estimation in smart cities. Ministry of Education (MOE) This work was supported by the Ministry of Education, Singapore, through AcRF TIER 1 under Grant RG64/23. 2025-01-06T04:43:15Z 2025-01-06T04:43:15Z 2024 Journal Article Zhou, Y., Yang, J., Huang, H. & Xie, L. (2024). AdaPose: toward cross-site device-free human pose estimation with commodity WiFi. IEEE Internet of Things Journal, 11(24), 40255-40267. https://dx.doi.org/10.1109/JIOT.2024.3452670 2327-4662 https://hdl.handle.net/10356/181961 10.1109/JIOT.2024.3452670 2-s2.0-85203511259 24 11 40255 40267 en RG64/23 IEEE Internet of Things Journal © 2024 IEEE. All rights reserved. |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering Domain adaptation Feature alignment |
spellingShingle |
Engineering Domain adaptation Feature alignment Zhou, Yunjiao Yang, Jianfei Huang, He Xie, Lihua AdaPose: toward cross-site device-free human pose estimation with commodity WiFi |
description |
WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation methods are predominantly evaluated under controlled laboratory conditions with sophisticated vision models to acquire accurately labeled data. Furthermore, WiFi channel state information (CSI) is highly sensitive to environmental variables, and direct application of a pretrained model to a new environment may yield suboptimal results due to domain shift. In this article, we propose a domain adaptation algorithm, AdaPose, designed specifically for WiFi-based pose estimation. The proposed method aims to identify consistent human poses that are highly resistant to environmental dynamics and WiFi signal noises. To achieve this goal, we introduce instance-wise consistency alignment loss that aligns domain shifts considering instance-wise pose distribution variance, and cross-environment channel enhancement module that enhances WiFi CSI feature representation by emphasizing channel-wise similarity between source and target domains. We conduct extensive experiments on both our self-collected pose estimation data set and a large public MM-Fi data set. The results demonstrate the effectiveness and robustness of AdaPose in eliminating domain shift, thereby facilitating the widespread application of WiFi-based pose estimation in smart cities. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Zhou, Yunjiao Yang, Jianfei Huang, He Xie, Lihua |
format |
Article |
author |
Zhou, Yunjiao Yang, Jianfei Huang, He Xie, Lihua |
author_sort |
Zhou, Yunjiao |
title |
AdaPose: toward cross-site device-free human pose estimation with commodity WiFi |
title_short |
AdaPose: toward cross-site device-free human pose estimation with commodity WiFi |
title_full |
AdaPose: toward cross-site device-free human pose estimation with commodity WiFi |
title_fullStr |
AdaPose: toward cross-site device-free human pose estimation with commodity WiFi |
title_full_unstemmed |
AdaPose: toward cross-site device-free human pose estimation with commodity WiFi |
title_sort |
adapose: toward cross-site device-free human pose estimation with commodity wifi |
publishDate |
2025 |
url |
https://hdl.handle.net/10356/181961 |
_version_ |
1821237175259234304 |