Application of reinforcement learning for autonomous combat
The RoboMaster University AI Challenge (RMUA) is an annual international robotics competition involving 2-versus-2 battle between autonomous robots armed with projectile launcher, where the goal is to cooperate with the ally robot and deplete the enemy robots’ health by shooting projectiles at th...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
Nanyang Technological University
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/158211 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-158211 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1582112023-07-07T19:31:21Z Application of reinforcement learning for autonomous combat Huang, Andrian Lap-Pui Chau School of Electrical and Electronic Engineering elpchau@ntu.edu.sg Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics The RoboMaster University AI Challenge (RMUA) is an annual international robotics competition involving 2-versus-2 battle between autonomous robots armed with projectile launcher, where the goal is to cooperate with the ally robot and deplete the enemy robots’ health by shooting projectiles at them. Due to the nature of the competition, the robots must be able to autonomously perform all tasks pertaining to the competition. With the recent rise in popularity of deep learning, it seems compelling to apply deep reinforcement learning for such tasks, which are doable by traditional methods yet might be difficult to explicitly program or fine-tune. Despite this, the combat robots in RMUA predominantly still use traditional methods as they are tried-and-tested in the competition. Deep reinforcement learning should however still be able to bring benefit to the RMUA combat robot due to its ability to let agents learn without explicit programming, including for rather complex environments. With that in mind, this project seeks to explore the possibility of deep reinforcement learning in RMUA combat robot by applying it for a certain combat task: autonomous enemy aiming and tracking, a task proven difficult due to bullet drop, small hitbox on the enemy robot’s armour, and the bullet’s finite velocity. The result of this project suggests that deep reinforcement learning can be used as an alternative to classical methods, although it may not beat classical methods especially in a simulated environment. Deep reinforcement learning for this task has a lot of room for improvement and can potentially be combined with classical methods. Bachelor of Engineering (Electrical and Electronic Engineering) 2022-06-01T02:16:33Z 2022-06-01T02:16:33Z 2022 Final Year Project (FYP) Huang, A. (2022). Application of reinforcement learning for autonomous combat. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/158211 https://hdl.handle.net/10356/158211 en A3040-211 application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics |
spellingShingle |
Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics Huang, Andrian Application of reinforcement learning for autonomous combat |
description |
The RoboMaster University AI Challenge (RMUA) is an annual international robotics
competition involving 2-versus-2 battle between autonomous robots armed with
projectile launcher, where the goal is to cooperate with the ally robot and deplete the
enemy robots’ health by shooting projectiles at them. Due to the nature of the competition,
the robots must be able to autonomously perform all tasks pertaining to the competition.
With the recent rise in popularity of deep learning, it seems compelling to apply deep
reinforcement learning for such tasks, which are doable by traditional methods yet might
be difficult to explicitly program or fine-tune. Despite this, the combat robots in RMUA
predominantly still use traditional methods as they are tried-and-tested in the competition.
Deep reinforcement learning should however still be able to bring benefit to the RMUA
combat robot due to its ability to let agents learn without explicit programming, including
for rather complex environments. With that in mind, this project seeks to explore the
possibility of deep reinforcement learning in RMUA combat robot by applying it for a
certain combat task: autonomous enemy aiming and tracking, a task proven difficult due
to bullet drop, small hitbox on the enemy robot’s armour, and the bullet’s finite velocity.
The result of this project suggests that deep reinforcement learning can be used as an
alternative to classical methods, although it may not beat classical methods especially in
a simulated environment. Deep reinforcement learning for this task has a lot of room for
improvement and can potentially be combined with classical methods. |
author2 |
Lap-Pui Chau |
author_facet |
Lap-Pui Chau Huang, Andrian |
format |
Final Year Project |
author |
Huang, Andrian |
author_sort |
Huang, Andrian |
title |
Application of reinforcement learning for autonomous combat |
title_short |
Application of reinforcement learning for autonomous combat |
title_full |
Application of reinforcement learning for autonomous combat |
title_fullStr |
Application of reinforcement learning for autonomous combat |
title_full_unstemmed |
Application of reinforcement learning for autonomous combat |
title_sort |
application of reinforcement learning for autonomous combat |
publisher |
Nanyang Technological University |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/158211 |
_version_ |
1772827108824842240 |