Vol.71, No.2, 2022, pp.2225-2247, doi:10.32604/cmc.2022.022952
OPEN ACCESS
ARTICLE
Deep Reinforcement Learning for Addressing Disruptions in Traffic Light Control
  • Faizan Rasheed1, Kok-Lim Alvin Yau2, Rafidah Md Noor3, Yung-Wey Chong4,*
1 School of Engineering and Computer Science, University of Hertfordshire, Hatfield, AL109AB, UK
2 Department of Computing and Information Systems, Sunway University, Subang Jaya, 47500, Malaysia
3 Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur, 50603, Malaysia
4 National Advanced IPv6 Centre, Universiti Sains Malaysia, USM, Penang, 11800, Malaysia
* Corresponding Author: Yung-Wey Chong. Email:
(This article belongs to this Special Issue: Artificial Intelligence Enabled Intelligent Transportation Systems)
Received 24 August 2021; Accepted 27 September 2021; Issue published 07 December 2021
Abstract
This paper investigates the use of multi-agent deep Q-network (MADQN) to address the curse of dimensionality issue occurred in the traditional multi-agent reinforcement learning (MARL) approach. The proposed MADQN is applied to traffic light controllers at multiple intersections with busy traffic and traffic disruptions, particularly rainfall. MADQN is based on deep Q-network (DQN), which is an integration of the traditional reinforcement learning (RL) and the newly emerging deep learning (DL) approaches. MADQN enables traffic light controllers to learn, exchange knowledge with neighboring agents, and select optimal joint actions in a collaborative manner. A case study based on a real traffic network is conducted as part of a sustainable urban city project in the Sunway City of Kuala Lumpur in Malaysia. Investigation is also performed using a grid traffic network (GTN) to understand that the proposed scheme is effective in a traditional traffic network. Our proposed scheme is evaluated using two simulation tools, namely Matlab and Simulation of Urban Mobility (SUMO). Our proposed scheme has shown that the cumulative delay of vehicles can be reduced by up to 30% in the simulations.
Keywords
Artificial intelligence; traffic light control; traffic disruptions; multi-agent deep Q-network; deep reinforcement learning
Cite This Article
F. Rasheed, K. Alvin Yau, R. Md Noor and Y. Chong, "Deep reinforcement learning for addressing disruptions in traffic light control," Computers, Materials & Continua, vol. 71, no.2, pp. 2225–2247, 2022.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.