Study on quality evaluation of human motion dataset in manufacturing scenario

This study presents a comprehensive framework for evaluating the quality of human manipulation datasets in contributing to efficient human-robot collaboration (HRC) in manufacturing settings. Recognizing the importance of safety and efficiency, we want to achieve the development of robotic systems c...

Full description

Saved in:
Bibliographic Details
Main Author: Nabeel Muhammad Bin Abu Bakar
Other Authors: Su Rong
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/177211
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:This study presents a comprehensive framework for evaluating the quality of human manipulation datasets in contributing to efficient human-robot collaboration (HRC) in manufacturing settings. Recognizing the importance of safety and efficiency, we want to achieve the development of robotic systems capable of planning safe trajectories in anticipation of human actions. We assert that the quality of human motion prediction is contingent upon the quality of the underlying datasets, and thus our work proposes methodologies for appraising human manipulation video datasets based on their adequacy for human landmark extraction, which ultimately impacts their transferability to subsequent analytical models. We examine several intricate assembly operations, then extract relevant human skeletal data and implement a spatiotemporal analysis for effective sample validation and scenario categorization. From this, we extract out the duration taken to complete assembly tasks in an attempt to predict the next task completion duration, allowing for better HRC.