Multi-agent reinforcement learning for traffic signal control through universal communication method

How to coordinate the communication among intersections effectively in real complex traffic scenarios with multi-intersection is challenging. Existing approaches only enable the communication in a heuristic manner without considering the content/importance of information to be shared. In this paper,...

Full description

Saved in:
Bibliographic Details
Main Authors: JIANG, Qize, QIN, Minhao, SHI, Shengmin, SUN, Weiwei Sun, ZHENG, Baihua
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2022
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/7193
https://ink.library.smu.edu.sg/context/sis_research/article/8196/viewcontent/Multi_Agent_Reinforcement_Learning_for_Traffic_Signal_Control_through_UniversalCommunication_Method__3_.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
Description
Summary:How to coordinate the communication among intersections effectively in real complex traffic scenarios with multi-intersection is challenging. Existing approaches only enable the communication in a heuristic manner without considering the content/importance of information to be shared. In this paper, we propose a universal communication form UniComm between intersections. UniComm embeds massive observations collected at one agent into crucial predictions of their impact on its neighbors, which improves the communication efficiency and is universal across existing methods. We also propose a concise network UniLight to make full use of communications enabled by UniComm. Experimental results on real datasets demonstrate that UniComm universally improves the performance of existing state-of-the-art methods, and UniLight significantly outperforms existing methods on a wide range of traffic situations. Source codes are available at https://github.com/ zyr17/UniLight.