Implementation of UI/UX in AR systems to enhance human-machine interaction

• Main Author: Kuo, Yu Chen
• Other Authors: Yeo Song Huat
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2020
• Subjects: Engineering::Mechanical engineering::Mechatronics
• Online Access: https://hdl.handle.net/10356/140992
• Institution: Nanyang Technological University

The rising interest in Industry 4.0 where Augmented Reality becomes part of manufacturing has garnered much attention as to whether augmented reality technology can be implemented in many new technological industries. Augmented reality systems consist of a computer that is able to generate images that overlay onto reality though wearable glasses. These glasses allow the user to move freely in reality with the supplement of information from the glasses inside 3D space. These systems are high versatile and are able to be adapted to manufacturing cells that can allow users to visualize the machinery’s future movements. This is done by overlaying an augmented image of the machine’s next position into the glasses which the user can view as an object in reality. This FYP report presents the approach to designing an application with a fluid user interface to enhance the interaction between machine and humans. The communication is improved with networking capabilities to wirelessly connect to a robot for the exchange of information. The user interface consisted of receiving inputs from the user to establish connections as well as displaying the connection status. Furthermore, the aim to allow the user to communicate with the robot in a hands-free manner through voice recognition required user interface elements which displayed and recognized voice inputs and key command words. Subsequently, the implementation of the user interface was developed in Unity3D and exported as a Universal Windows Program. This application was executed in a microcontroller unit that is portable and allowed users are able to move freely in. Lastly, a user experience survey was planned for a better understanding on the shortcomings of the design of the user interface and experience of using augmented reality glasses.