Gesture enhanced comprehension of ambiguous human-to-robot instructions

• Main Authors: WEERAKOON MUDIYANSELAGE DULANGA KAVEESHA WEERAKOON, SUBBARAJU, Vigneshwaran, KARUMPULLI, Nipuni, TRAN, Minh Anh Tuan, XU, Qianli, TAN, U-Xuan, LIM, Joo Hwee, MISRA, Archan
• 格式: text
• 語言: English
• 出版: Institutional Knowledge at Singapore Management University 2020
• 主題: Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• 在線閱讀: https://ink.library.smu.edu.sg/sis_research/5369; https://ink.library.smu.edu.sg/context/sis_research/article/6373/viewcontent/26._Gesture_Enhanced_Comprehension_of_Ambiguous_Human_To_Robot_Instructi....pdf

This work demonstrates the feasibility and benefits of using pointing gestures, a naturally-generated additional input modality, to improve the multi-modal comprehension accuracy of human instructions to robotic agents for collaborative tasks.We present M2Gestic, a system that combines neural-based...