TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control...
Saved in:
Main Author: | |
---|---|
Format: | Final Project |
Language: | Indonesia |
Online Access: | https://digilib.itb.ac.id/gdl/view/67141 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Institut Teknologi Bandung |
Language: | Indonesia |
id |
id-itb.:67141 |
---|---|
spelling |
id-itb.:671412022-08-12T13:37:36ZTRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK Riza Tanwirul Fuad, Muhammad Indonesia Final Project traffic control, Reinforcement Learning, Deep Q-Network, reward, pressure, queue length, adaptive INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/67141 Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control systems in Indonesia still utilize classic control algorithm with a predetermined green phase sequence. In this study, an adaptive traffic controller is proposed using a Reinforcement Learning algorithm. Reinforcement Learning algorithm will be applied into SUMO traffic simulation software. In designing control algorithm, a Reinforcement Learning algorithm called Deep- Q Network (DQN) is used. The action taken by DQN is to determine the traffic phase with various rewards, ranging from pressure to providing adaptive loads on pressure and queue length. DQN-based control algorithm with adaptive reward mechanism provide the best performance via vehicle throughput as much as 56,384 vehicles, followed by classic and conventional control method such as Webster (50,366), Max-Pressure (50,541) and Uniform (46,241). The increment of vehicle throughput in a region will increase the region productivity. text |
institution |
Institut Teknologi Bandung |
building |
Institut Teknologi Bandung Library |
continent |
Asia |
country |
Indonesia Indonesia |
content_provider |
Institut Teknologi Bandung |
collection |
Digital ITB |
language |
Indonesia |
description |
Transportation demand has increased in the last few decades as human activities
increase. One of the most negative impact is the increasing level of traffic
congestion. A possible short-term solution for this problem is to utilize an
adaptive traffic control algorithm. Most of the traffic control systems in Indonesia
still utilize classic control algorithm with a predetermined green phase sequence.
In this study, an adaptive traffic controller is proposed using a Reinforcement
Learning algorithm. Reinforcement Learning algorithm will be applied into
SUMO traffic simulation software.
In designing control algorithm, a Reinforcement Learning algorithm called Deep-
Q Network (DQN) is used. The action taken by DQN is to determine the traffic
phase with various rewards, ranging from pressure to providing adaptive loads
on pressure and queue length. DQN-based control algorithm with adaptive
reward mechanism provide the best performance via vehicle throughput as much
as 56,384 vehicles, followed by classic and conventional control method such as
Webster (50,366), Max-Pressure (50,541) and Uniform (46,241). The increment
of vehicle throughput in a region will increase the region productivity.
|
format |
Final Project |
author |
Riza Tanwirul Fuad, Muhammad |
spellingShingle |
Riza Tanwirul Fuad, Muhammad TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
author_facet |
Riza Tanwirul Fuad, Muhammad |
author_sort |
Riza Tanwirul Fuad, Muhammad |
title |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_short |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_full |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_fullStr |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_full_unstemmed |
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK |
title_sort |
traffic control based on deep q-network algorithm with adaptive reward mechanism in intersection network |
url |
https://digilib.itb.ac.id/gdl/view/67141 |
_version_ |
1822005355620597760 |