Decentralizing air traffic flow management with blockchain based reinforcement learning

• Main Authors: TA, Nguyen Binh Duong, CHAUDHARY, Umang, TRUONG, Hong-Linh
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/4647; https://ink.library.smu.edu.sg/context/sis_research/article/5650/viewcontent/truong_indin2019.pdf
• Institution: Singapore Management University

We propose and implement a decentralized, intelligent air traffic flow management (ATFM) solution to improve the efficiency of air transportation in the ASEAN region as a whole. Our system, named BlockAgent, leverages the inherent synergy between multi-agent reinforcement learning (RL) for air traffic flow optimization; and the rising blockchain technology for a secure, transparent and decentralized coordination platform. As a result, BlockAgent does not require a centralized authority for effective ATFM operations. We have implemented several novel distributed coordination approaches for RL in BlockAgent. Empirical experiments with real air traffic data concerning regional airports have demonstrated the feasibility and effectiveness of our approach. To the best of our knowledge, this is the first work that considers blockchain-based, distributed RL for ATFM. Index Terms—decentralized optimization, air traffic flow management, blockchain, reinforcement learning, multi-agent systems