Human pose estimation using artificial intelligence

Over the past 10 years, human pose estimation (HPE) using artificial intelligence (AI) has gained more and more attention and been used in a range of applications, like human-computer interaction, motion analysis, healthcare, and security. The optimal goal of HPE is to use input data, such as pictur...

全面介紹

Saved in:
書目詳細資料
主要作者: Zheng, Zhoudong
其他作者: Yap Kim Hui
格式: Final Year Project
語言:English
出版: Nanyang Technological University 2024
主題:
在線閱讀:https://hdl.handle.net/10356/176189
標簽: 添加標簽
沒有標簽, 成為第一個標記此記錄!
實物特徵
總結:Over the past 10 years, human pose estimation (HPE) using artificial intelligence (AI) has gained more and more attention and been used in a range of applications, like human-computer interaction, motion analysis, healthcare, and security. The optimal goal of HPE is to use input data, such as pictures and movies, to identify the various body parts and create a representation of the human body, such as skeleton and mesh. By leveraging and comparing different state-of-the-art (SOTA) deep learning models, such as convolutional neural networks (CNNs) and transformer-based structures, it is found out that insufficient learning of spatial-temporal correlation results from the prior approaches’ inability to effectively represent each joint’s solid inter-frame relationship. Among the models, MixSTE and its baseline model, VideoPose3D, have innovative idea to solve the problems. Therefore, the purpose of this report is to improve the accuracy as well as robustness of the 3D HPE by improving the current models. The present model is able to thoroughly and adaptively record long-range spatio-temporal interactions among the skeletal joints through the use of a Dual-stream Spatio-temporal Transformer (DSTformer) coupled with a motion encoder.