AdaPose: toward cross-site device-free human pose estimation with commodity WiFi

WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation methods are predominantly evaluated under controlled laboratory conditions with sophisticated vision models to acquire accur...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhou, Yunjiao, Yang, Jianfei, Huang, He, Xie, Lihua
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2025
Subjects:
Online Access:https://hdl.handle.net/10356/181961
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-181961
record_format dspace
spelling sg-ntu-dr.10356-1819612025-01-06T04:43:15Z AdaPose: toward cross-site device-free human pose estimation with commodity WiFi Zhou, Yunjiao Yang, Jianfei Huang, He Xie, Lihua School of Electrical and Electronic Engineering School of Mechanical and Aerospace Engineering Engineering Domain adaptation Feature alignment WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation methods are predominantly evaluated under controlled laboratory conditions with sophisticated vision models to acquire accurately labeled data. Furthermore, WiFi channel state information (CSI) is highly sensitive to environmental variables, and direct application of a pretrained model to a new environment may yield suboptimal results due to domain shift. In this article, we propose a domain adaptation algorithm, AdaPose, designed specifically for WiFi-based pose estimation. The proposed method aims to identify consistent human poses that are highly resistant to environmental dynamics and WiFi signal noises. To achieve this goal, we introduce instance-wise consistency alignment loss that aligns domain shifts considering instance-wise pose distribution variance, and cross-environment channel enhancement module that enhances WiFi CSI feature representation by emphasizing channel-wise similarity between source and target domains. We conduct extensive experiments on both our self-collected pose estimation data set and a large public MM-Fi data set. The results demonstrate the effectiveness and robustness of AdaPose in eliminating domain shift, thereby facilitating the widespread application of WiFi-based pose estimation in smart cities. Ministry of Education (MOE) This work was supported by the Ministry of Education, Singapore, through AcRF TIER 1 under Grant RG64/23. 2025-01-06T04:43:15Z 2025-01-06T04:43:15Z 2024 Journal Article Zhou, Y., Yang, J., Huang, H. & Xie, L. (2024). AdaPose: toward cross-site device-free human pose estimation with commodity WiFi. IEEE Internet of Things Journal, 11(24), 40255-40267. https://dx.doi.org/10.1109/JIOT.2024.3452670 2327-4662 https://hdl.handle.net/10356/181961 10.1109/JIOT.2024.3452670 2-s2.0-85203511259 24 11 40255 40267 en RG64/23 IEEE Internet of Things Journal © 2024 IEEE. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering
Domain adaptation
Feature alignment
spellingShingle Engineering
Domain adaptation
Feature alignment
Zhou, Yunjiao
Yang, Jianfei
Huang, He
Xie, Lihua
AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
description WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation methods are predominantly evaluated under controlled laboratory conditions with sophisticated vision models to acquire accurately labeled data. Furthermore, WiFi channel state information (CSI) is highly sensitive to environmental variables, and direct application of a pretrained model to a new environment may yield suboptimal results due to domain shift. In this article, we propose a domain adaptation algorithm, AdaPose, designed specifically for WiFi-based pose estimation. The proposed method aims to identify consistent human poses that are highly resistant to environmental dynamics and WiFi signal noises. To achieve this goal, we introduce instance-wise consistency alignment loss that aligns domain shifts considering instance-wise pose distribution variance, and cross-environment channel enhancement module that enhances WiFi CSI feature representation by emphasizing channel-wise similarity between source and target domains. We conduct extensive experiments on both our self-collected pose estimation data set and a large public MM-Fi data set. The results demonstrate the effectiveness and robustness of AdaPose in eliminating domain shift, thereby facilitating the widespread application of WiFi-based pose estimation in smart cities.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Zhou, Yunjiao
Yang, Jianfei
Huang, He
Xie, Lihua
format Article
author Zhou, Yunjiao
Yang, Jianfei
Huang, He
Xie, Lihua
author_sort Zhou, Yunjiao
title AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
title_short AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
title_full AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
title_fullStr AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
title_full_unstemmed AdaPose: toward cross-site device-free human pose estimation with commodity WiFi
title_sort adapose: toward cross-site device-free human pose estimation with commodity wifi
publishDate 2025
url https://hdl.handle.net/10356/181961
_version_ 1821237175259234304