Novel robotic UI toolset

• Main Author: Liu, Xinyao
• Other Authors: Tang Xiaohong
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Engineering
• Online Access: https://hdl.handle.net/10356/177326
• Institution: Nanyang Technological University

This report delves into integrating Foxglove Studio, a cutting-edge robotics visualization tool, within the broader context of robotic systems development. Mobile robots, with their advanced sensors and control systems, are increasingly becoming integral in sectors where human intervention is limited. Despite their growing adoption, adequate visualization and debugging of robotic data remains a critical challenge, often not addressed by traditional debugging techniques. This report reviews existing visualization solutions like Rviz and Webviz and outlines the limitations of these tools in collaborative and non-engineering environments. Addressing these gaps, this report introduces an innovative approach to enhance the functionality of Foxglove. It details the development of a translation tool that facilitates the integration of UI/UX designs from Figma into Foxglove, enabling a seamless transition from design prototypes to functional panels. However, this method encounters certain constraints with the manual layout conversion logic. To overcome these challenges, we integrate the OpenAI API to automate the process. Following the layout conversion, we employ sample data, local data bag files, and ultimately live ROS2 data to rigorously test the usability of the panels created by our translation tool. The implications of this work are significant. This translator tool will bridge the gap between the designer and engineer, and future developments aim to generalize this tool for broader applications. This would enable designers to contribute directly to the robotic data visualization interface, democratizing the design process within robotics software interaction. The report underscores the importance of user-friendly and accessible technology in robotics, paving the way for inclusive advancements in the field.