Gesture enhanced comprehension of ambiguous human-to-robot instructions
This work demonstrates the feasibility and benefits of using pointing gestures, a naturally-generated additional input modality, to improve the multi-modal comprehension accuracy of human instructions to robotic agents for collaborative tasks.We present M2Gestic, a system that combines neural-based...
Saved in:
Main Authors: | WEERAKOON MUDIYANSELAGE DULANGA KAVEESHA WEERAKOON, SUBBARAJU, Vigneshwaran, KARUMPULLI, Nipuni, TRAN, Minh Anh Tuan, XU, Qianli, TAN, U-Xuan, LIM, Joo Hwee, MISRA, Archan |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2020
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/5369 https://ink.library.smu.edu.sg/context/sis_research/article/6373/viewcontent/26._Gesture_Enhanced_Comprehension_of_Ambiguous_Human_To_Robot_Instructi....pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
Demonstrating multi-modal human instruction comprehension with AR smart glass
by: WEERAKOON, Mudiyanselage Dulanga Kaveesha, et al.
Published: (2023) -
COSM2IC: Optimizing real-time multi-modal instruction comprehension
by: WEERAKOON MUDIYANSELAGE DULANGA KAVEESHA WEERAKOON,, et al.
Published: (2022) -
Poster: Towards efficient spatio-temporal video grounding in pervasive mobile devices
by: WEERAKOON MUDIYANSELAGE, Dulanga Kaveesha, et al.
Published: (2024) -
SoftSkip: Empowering multi-modal dynamic pruning for single-stage referring comprehension
by: WEERAKOON, Dulanga, et al.
Published: (2022) -
Demo abstract: VGGlass - Demonstrating visual grounding and localization synergy with a LiDAR-enabled smart-glass
by: RATHNAYAKE, Darshana, et al.
Published: (2023)