TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control...
Saved in:
Main Author: | |
---|---|
Format: | Final Project |
Language: | Indonesia |
Online Access: | https://digilib.itb.ac.id/gdl/view/67152 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Institut Teknologi Bandung |
Language: | Indonesia |
id |
id-itb.:67152 |
---|---|
spelling |
id-itb.:671522022-08-12T15:04:13ZTRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK Okto Fernandez, Eric Indonesia Final Project traffic control, Reinforcement Learning, Deep Q-Network, reward, pressure, queue length, adaptive INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/67152 Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control systems in Indonesia still utilize classic control algorithm with a predetermined green phase sequence. In this study, an adaptive traffic controller is proposed using a Reinforcement Learning algorithm. Reinforcement Learning algorithm will be applied into SUMO traffic simulation software. In designing control algorithm, a Reinforcement Learning algorithm called Deep- Q Network (DQN) is used. The action taken by DQN is to determine the traffic phase with various rewards, ranging from pressure to providing adaptive loads on pressure and queue length. DQN-based control algorithm with adaptive reward mechanism provide the best performance via vehicle throughput as much as 56,384 vehicles, followed by classic and conventional control method such as Webster (50,366), Max-Pressure (50,541) and Uniform (46,241). The increment of vehicle throughput in a region will increase the region productivity. text |
institution |
Institut Teknologi Bandung |
building |
Institut Teknologi Bandung Library |
continent |
Asia |
country |
Indonesia Indonesia |
content_provider |
Institut Teknologi Bandung |
collection |
Digital ITB |
language |
Indonesia |
description |
Transportation demand has increased in the last few decades as human activities
increase. One of the most negative impact is the increasing level of traffic
congestion. A possible short-term solution for this problem is to utilize an adaptive
traffic control algorithm. Most of the traffic control systems in Indonesia still utilize
classic control algorithm with a predetermined green phase sequence. In this study,
an adaptive traffic controller is proposed using a Reinforcement Learning
algorithm. Reinforcement Learning algorithm will be applied into SUMO traffic
simulation software.
In designing control algorithm, a Reinforcement Learning algorithm called Deep-
Q Network (DQN) is used. The action taken by DQN is to determine the traffic
phase with various rewards, ranging from pressure to providing adaptive loads on
pressure and queue length. DQN-based control algorithm with adaptive reward
mechanism provide the best performance via vehicle throughput as much as 56,384
vehicles, followed by classic and conventional control method such as Webster
(50,366), Max-Pressure (50,541) and Uniform (46,241). The increment of vehicle
throughput in a region will increase the region productivity.
|
format |
Final Project |
author |
Okto Fernandez, Eric |
spellingShingle |
Okto Fernandez, Eric TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
author_facet |
Okto Fernandez, Eric |
author_sort |
Okto Fernandez, Eric |
title |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_short |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_full |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_fullStr |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_full_unstemmed |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_sort |
traffic control based on deep q-network algorithm with adaptive reward mechanism in intersection network |
url |
https://digilib.itb.ac.id/gdl/view/67152 |
_version_ |
1822005358821900288 |