Jointly optimizing sensing pipelines for multimodal mixed reality interaction

• Main Authors: KANATTA GAMAGE, Ramesh Darshana Rathnayake, DE SILVA, Ashen, PUWAKDANDAWA, Dasun, MEEGAHAPOLA, Lakmal, MISRA, Archan, PERERA, Indika
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: Sensor fusion; Mixed reality; Multimodal interactions; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/6780; https://ink.library.smu.edu.sg/context/sis_research/article/7783/viewcontent/Jointly_Optimizing_Sensing_Pipelines_for_Multimodal_Mixed_Reality_Interaction.pdf
• Institution: Singapore Management University

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate comprehension of such multimodal instructions (MMI), on resource-cons...