Remote teleoperation with object detection

• Main Author: Foo, Jun Ming
• Other Authors: Smitha Kavallur Pisharath Gopi
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2023
• Subjects: Engineering::Computer science and engineering
• Online Access: https://hdl.handle.net/10356/166164
• Institution: Nanyang Technological University

In today's digital age, WiFi has become an essential means of communication. However, its coverage area is limited, and it cannot reach remote areas. This project proposes Remote teleoperation of a device on NAT-type networks to resolve the issue. However, operating on NAT-type networks poses a significant challenge, primarily due to CGNAT and its dynamic IP allocation. To overcome this issue, a reliable solution is needed. VPN P2P tunneling is a powerful technology that enables secure and efficient communication over NAT-type networks, facilitating remote teleoperation. For applications requiring object detection, it is performed by the server over the NAT-type networks instead of on the device to provide cloud-based object detection to the teleoperated device, allowing for cheaper hardware implementation of said device. By leveraging these technologies, businesses can achieve enhanced productivity, cost savings, and improved performance in remote teleoperation scenarios. The report presents the final year project to test remote teleoperation of the TurtleBot3 on NAT-type networks with a server providing object detection service through the same network. The final goal is to create a remote robot that can communicate with the operator PC through a carrier grade mobile network (CGNAT) in real-time, with low latency and high reliability.