A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks

Human-Cyber-Physical Systems (HCPS), as an emerging paradigm centered around humans, provide a promising direction for the advancement of various domains, such as intelligent manufacturing and aerospace. In contrast to Cyber-Physical Systems (CPS), the development of HCPS emphasizes the expansion of...

Full description

Saved in:
Bibliographic Details
Main Authors: Qi, Wenqian, Chen, Chun-Hsien, Niu, Tongzhi, Lyu, Shuhui, Sun, Shouqian
Other Authors: School of Mechanical and Aerospace Engineering
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/180133
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-180133
record_format dspace
spelling sg-ntu-dr.10356-1801332024-09-18T05:46:23Z A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks Qi, Wenqian Chen, Chun-Hsien Niu, Tongzhi Lyu, Shuhui Sun, Shouqian School of Mechanical and Aerospace Engineering Engineering Multisensory interaction Graph convolutional networks Human-Cyber-Physical Systems (HCPS), as an emerging paradigm centered around humans, provide a promising direction for the advancement of various domains, such as intelligent manufacturing and aerospace. In contrast to Cyber-Physical Systems (CPS), the development of HCPS emphasizes the expansion of human capabilities. Humans no longer solely function as operators or agents working in collaboration with computers and machines but extend their roles to include system design and innovation management. This paper proposes a Multisensory Interaction Framework for HCPS (MS-HCPS) that leverages human senses to facilitate system creation and management. Additionally, the introduced Multisensory Graph Convolutional Network (MS-GCN) model calculates recommendation values for multiple senses, elucidating their relevance to system development. Furthermore, the effectiveness of the proposed framework and model is validated through three practical engineering scenarios. This study explores the research on multisensory interaction in HCPS from a human sensory perspective, aiming to facilitate the progress and development of HCPS across various domains. This work was supported by the National Key R & D Program of China (No. 2020YFC1523301-2). 2024-09-18T05:46:23Z 2024-09-18T05:46:23Z 2024 Journal Article Qi, W., Chen, C., Niu, T., Lyu, S. & Sun, S. (2024). A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks. Advanced Engineering Informatics, 61, 102482-. https://dx.doi.org/10.1016/j.aei.2024.102482 1474-0346 https://hdl.handle.net/10356/180133 10.1016/j.aei.2024.102482 2-s2.0-85187791301 61 102482 en Advanced Engineering Informatics © 2024 Elsevier Ltd. All rights reserved.
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering
Multisensory interaction
Graph convolutional networks
spellingShingle Engineering
Multisensory interaction
Graph convolutional networks
Qi, Wenqian
Chen, Chun-Hsien
Niu, Tongzhi
Lyu, Shuhui
Sun, Shouqian
A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
description Human-Cyber-Physical Systems (HCPS), as an emerging paradigm centered around humans, provide a promising direction for the advancement of various domains, such as intelligent manufacturing and aerospace. In contrast to Cyber-Physical Systems (CPS), the development of HCPS emphasizes the expansion of human capabilities. Humans no longer solely function as operators or agents working in collaboration with computers and machines but extend their roles to include system design and innovation management. This paper proposes a Multisensory Interaction Framework for HCPS (MS-HCPS) that leverages human senses to facilitate system creation and management. Additionally, the introduced Multisensory Graph Convolutional Network (MS-GCN) model calculates recommendation values for multiple senses, elucidating their relevance to system development. Furthermore, the effectiveness of the proposed framework and model is validated through three practical engineering scenarios. This study explores the research on multisensory interaction in HCPS from a human sensory perspective, aiming to facilitate the progress and development of HCPS across various domains.
author2 School of Mechanical and Aerospace Engineering
author_facet School of Mechanical and Aerospace Engineering
Qi, Wenqian
Chen, Chun-Hsien
Niu, Tongzhi
Lyu, Shuhui
Sun, Shouqian
format Article
author Qi, Wenqian
Chen, Chun-Hsien
Niu, Tongzhi
Lyu, Shuhui
Sun, Shouqian
author_sort Qi, Wenqian
title A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
title_short A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
title_full A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
title_fullStr A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
title_full_unstemmed A multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
title_sort multisensory interaction framework for human-cyber–physical system based on graph convolutional networks
publishDate 2024
url https://hdl.handle.net/10356/180133
_version_ 1814047207014268928