Modeling adaptive platoon and reservation based autonomous intersection control: a deep reinforcement learning approach

• Main Authors: Li, Duowei, Wu, Jianping, Zhu, Feng, Chen, Tianyi, Wong, Yiik Diew
• Other Authors: School of Civil and Environmental Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2022
• Subjects: Engineering::Civil engineering::Transportation; Engineering::Computer science and engineering::Computer applications; Connected and Autonomous Vehicle; Adaptive Platoon; Intersection Control; Deep Reinforcement Learning
• Online Access: https://hdl.handle.net/10356/158101; https://heart2022.com/
• Institution: Nanyang Technological University

As a strategy to reduce travel delay and enhance energy efficiency, platooning of connected and autonomous vehicles (CAVs) at non-signalized intersections has become increasingly popular in academia. However, few studies have attempted to model the relation between the optimal platoon size and the traffic conditions around the intersection. To this end, this study proposes an adaptive platoon based autonomous intersection control model powered by deep reinforcement learning (DRL) technique. The model framework has following two levels: the first level adopts a First Come First Serve (FCFS) reservation based policy integrated with a nonconflicting lane selection mechanism to determine vehicles’ passing priority; and the second level applies a deep Q-network algorithm to identify the optimal platoon size based on the real-time traffic condition of an intersection. When being tested on a traffic micro-simulator, our proposed model exhibits superior performances on travel efficiency and fuel conservation as compared to the state-of-the-art methods.