Hierarchical multiagent reinforcement learning for maritime traffic management
Increasing global maritime traffic coupled with rapid digitization and automation in shipping mandate developing next generation maritime traffic management systems to mitigate congestion, increase safety of navigation, and avoid collisions in busy and geographically constrained ports (such as Singa...
Saved in:
Main Authors: | , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2020
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/5403 https://ink.library.smu.edu.sg/context/sis_research/article/6406/viewcontent/p1278.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-6406 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-64062021-06-09T01:24:02Z Hierarchical multiagent reinforcement learning for maritime traffic management SINGH, Arambam James KUMAR, Akshat LAU, Hoong Chuin Increasing global maritime traffic coupled with rapid digitization and automation in shipping mandate developing next generation maritime traffic management systems to mitigate congestion, increase safety of navigation, and avoid collisions in busy and geographically constrained ports (such as Singapore's). To achieve these objectives, we model the maritime traffic as a large multiagent system with individual vessels as agents, and VTS (Vessel Traffic Service) authority as a regulatory agent. We develop a hierarchical reinforcement learning approach where vessels first select a high level action based on the underlying traffic flow, and then select the low level action that determines their future speed. We exploit the nature of collective interactions among agents to develop a policy gradient approach that can scale up to large real world problems. We also develop an effective multiagent credit assignment scheme that significantly improves the convergence of policy gradient. Extensive empirical results on synthetic and real world data from one of the busiest port in the world show that our approach consistently performs significantly better than the previous best approach. 2020-05-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/5403 https://ink.library.smu.edu.sg/context/sis_research/article/6406/viewcontent/p1278.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Autonomous agents Multi agent systems Reinforcement learning Service vessels Waterway transportation Artificial Intelligence and Robotics Operations Research, Systems Engineering and Industrial Engineering Transportation |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Autonomous agents Multi agent systems Reinforcement learning Service vessels Waterway transportation Artificial Intelligence and Robotics Operations Research, Systems Engineering and Industrial Engineering Transportation |
spellingShingle |
Autonomous agents Multi agent systems Reinforcement learning Service vessels Waterway transportation Artificial Intelligence and Robotics Operations Research, Systems Engineering and Industrial Engineering Transportation SINGH, Arambam James KUMAR, Akshat LAU, Hoong Chuin Hierarchical multiagent reinforcement learning for maritime traffic management |
description |
Increasing global maritime traffic coupled with rapid digitization and automation in shipping mandate developing next generation maritime traffic management systems to mitigate congestion, increase safety of navigation, and avoid collisions in busy and geographically constrained ports (such as Singapore's). To achieve these objectives, we model the maritime traffic as a large multiagent system with individual vessels as agents, and VTS (Vessel Traffic Service) authority as a regulatory agent. We develop a hierarchical reinforcement learning approach where vessels first select a high level action based on the underlying traffic flow, and then select the low level action that determines their future speed. We exploit the nature of collective interactions among agents to develop a policy gradient approach that can scale up to large real world problems. We also develop an effective multiagent credit assignment scheme that significantly improves the convergence of policy gradient. Extensive empirical results on synthetic and real world data from one of the busiest port in the world show that our approach consistently performs significantly better than the previous best approach. |
format |
text |
author |
SINGH, Arambam James KUMAR, Akshat LAU, Hoong Chuin |
author_facet |
SINGH, Arambam James KUMAR, Akshat LAU, Hoong Chuin |
author_sort |
SINGH, Arambam James |
title |
Hierarchical multiagent reinforcement learning for maritime traffic management |
title_short |
Hierarchical multiagent reinforcement learning for maritime traffic management |
title_full |
Hierarchical multiagent reinforcement learning for maritime traffic management |
title_fullStr |
Hierarchical multiagent reinforcement learning for maritime traffic management |
title_full_unstemmed |
Hierarchical multiagent reinforcement learning for maritime traffic management |
title_sort |
hierarchical multiagent reinforcement learning for maritime traffic management |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2020 |
url |
https://ink.library.smu.edu.sg/sis_research/5403 https://ink.library.smu.edu.sg/context/sis_research/article/6406/viewcontent/p1278.pdf |
_version_ |
1770575446061088768 |