NVP-HRI: zero shot natural voice and posture-based human–robot interaction via large language model

• Main Authors: Lai, Yuzhi, Yuan, Shenghai, Nassar, Youssef, Fan, Mingyu, Weber, Thomas, Rätsch, Matthias
• Other Authors: School of Electrical and Electronic Engineering
• Format: Article
• Language: English
• Published: 2025
• Subjects: Computer and Information Science; Human-robot interaction; Intent recognition; Multi-modality perception; Large language models; Unsupervised interaction
• Online Access: https://hdl.handle.net/10356/182119
• Institution: Nanyang Technological University

Effective Human-Robot Interaction (HRI) is crucial for future service robots in aging societies. Existing solutions are biased toward only well-trained objects, creating a gap when dealing with new objects. Currently, HRI systems using predefined gestures or language tokens for pretrained objects po...