TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK

Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control...

Full description

Saved in:
Bibliographic Details
Main Author: Okto Fernandez, Eric
Format: Final Project
Language:Indonesia
Online Access:https://digilib.itb.ac.id/gdl/view/67152
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Institut Teknologi Bandung
Language: Indonesia
id id-itb.:67152
spelling id-itb.:671522022-08-12T15:04:13ZTRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK Okto Fernandez, Eric Indonesia Final Project traffic control, Reinforcement Learning, Deep Q-Network, reward, pressure, queue length, adaptive INSTITUT TEKNOLOGI BANDUNG https://digilib.itb.ac.id/gdl/view/67152 Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control systems in Indonesia still utilize classic control algorithm with a predetermined green phase sequence. In this study, an adaptive traffic controller is proposed using a Reinforcement Learning algorithm. Reinforcement Learning algorithm will be applied into SUMO traffic simulation software. In designing control algorithm, a Reinforcement Learning algorithm called Deep- Q Network (DQN) is used. The action taken by DQN is to determine the traffic phase with various rewards, ranging from pressure to providing adaptive loads on pressure and queue length. DQN-based control algorithm with adaptive reward mechanism provide the best performance via vehicle throughput as much as 56,384 vehicles, followed by classic and conventional control method such as Webster (50,366), Max-Pressure (50,541) and Uniform (46,241). The increment of vehicle throughput in a region will increase the region productivity. text
institution Institut Teknologi Bandung
building Institut Teknologi Bandung Library
continent Asia
country Indonesia
Indonesia
content_provider Institut Teknologi Bandung
collection Digital ITB
language Indonesia
description Transportation demand has increased in the last few decades as human activities increase. One of the most negative impact is the increasing level of traffic congestion. A possible short-term solution for this problem is to utilize an adaptive traffic control algorithm. Most of the traffic control systems in Indonesia still utilize classic control algorithm with a predetermined green phase sequence. In this study, an adaptive traffic controller is proposed using a Reinforcement Learning algorithm. Reinforcement Learning algorithm will be applied into SUMO traffic simulation software. In designing control algorithm, a Reinforcement Learning algorithm called Deep- Q Network (DQN) is used. The action taken by DQN is to determine the traffic phase with various rewards, ranging from pressure to providing adaptive loads on pressure and queue length. DQN-based control algorithm with adaptive reward mechanism provide the best performance via vehicle throughput as much as 56,384 vehicles, followed by classic and conventional control method such as Webster (50,366), Max-Pressure (50,541) and Uniform (46,241). The increment of vehicle throughput in a region will increase the region productivity.
format Final Project
author Okto Fernandez, Eric
spellingShingle Okto Fernandez, Eric
TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
author_facet Okto Fernandez, Eric
author_sort Okto Fernandez, Eric
title TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
title_short TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
title_full TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
title_fullStr TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
title_full_unstemmed TRAFFIC CONTROL BASED ON DEEP Q-NETWORK ALGORITHM WITH ADAPTIVE REWARD MECHANISM IN INTERSECTION NETWORK
title_sort traffic control based on deep q-network algorithm with adaptive reward mechanism in intersection network
url https://digilib.itb.ac.id/gdl/view/67152
_version_ 1822005358821900288