Deep Reinforcement Learning Based Unmanned Aerial Vehicle (UAV) Control Using 3D Hand Gestures

• Main Authors: Khan, F.S., Mohd, M.N.H., Zulkifli, S.A.B.M., Abro, G.E.M., Kazi, S., Soomro, D.M.
• Format: Article
• Published: Tech Science Press 2022
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85128625765&doi=10.32604%2fcmc.2022.024927&partnerID=40&md5=0ca90aa48129e8bdb703f0dcbca329ad; http://eprints.utp.edu.my/33252/
• Institution: Universiti Teknologi Petronas

The evident change in the design of the autopilot system produced massive help for the aviation industry and it required frequent upgrades. Reinforcement learning delivers appropriate outcomes when considering a continuous environment where the controlling Unmanned Aerial Vehicle (UAV) required maximum accuracy. In this paper, we designed a hybrid framework, which is based on Reinforcement Learning and Deep Learning where the traditional electronic flight controller is replaced by using 3D hand gestures. The algorithm is designed to take the input from 3D hand gestures and integrate with the Deep Deterministic Policy Gradient (DDPG) to receive the best reward and take actions according to 3D hand gestures input. The UAV consist of a Jetson Nano embedded testbed, Global Positioning System (GPS) sensor module, and Intel depth camera. The collision avoidance system based on the polar mask segmentation technique detects the obstacles and decides the best path according to the designed reward function. The analysis of the results has been observed providing best accuracy and computational time using novel design framework when compared with traditional Proportional Integral Derivatives (PID) flight controller. There are six reward functions estimated for 2500, 5000, 7500, and 10000 episodes of training, which have been normalized between 0 to -4000. The best observation has been captured on 2500 episodes where the rewards are calculated for maximum value. The achieved training accuracy of polar mask segmentation for collision avoidance is 86.36. © 2022 Tech Science Press. All rights reserved.