Multi-agent broad reinforcement learning for intelligent traffic light control

被引:30
|
作者
Zhu, Ruijie [1 ]
Li, Lulu [1 ]
Wu, Shuning [1 ]
Lv, Pei [1 ]
Li, Yafei [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artif Intelligence, Zhengzhou, Peoples R China
基金
美国国家科学基金会;
关键词
Intelligent traffic light control; Deep neural networks; Broad reinforcment learning; Multi -agent deep reinforcement learning;
D O I
10.1016/j.ins.2022.11.062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intelligent traffic light control (ITLC) aims to relieve traffic congestion. Some multi-agent deep reinforcement learning (MADRL) algorithms have been proposed for ITLC, and most of them use deep neural networks to make decisions. However, the abundant parameters of deep structure lead to the time-consuming training process of MADRL. Recently, a broad reinforcement learning (BRL) approach has been proposed to improve the efficiency of training for an agent. Unlike MADRL algorithms that use deep architecture, BRL utilizes a broad architecture. In this paper, we propose a multi-agent broad reinforcement learning (MABRL) algorithm for ITLC. The MABRL algorithm adopts the broad network to process the joint information and updates the parameters using ridge regression. To increase the effectiveness of interaction among agents, we design a dynamic interaction mechanism (DIM) based on the attention mechanism. The DIM enables agents to aggregate information on particular intersections at appropriate moments. We conduct experiments on three different datasets. The results demonstrate that the effectiveness of MABRL outperforms several state-of-the-art algorithms in alleviating traffic congestion with shorter training time. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:509 / 525
页数:17
相关论文
共 50 条
  • [21] Cooperative Multi-Agent Reinforcement Learning Framework for Edge Intelligence-Empowered Traffic Light Control
    Shi, Haiyong
    Liu, Bingyi
    Wang, Enshu
    Han, Weizhen
    Wang, Jinfan
    Cui, Shihong
    Wu, Libing
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 7373 - 7384
  • [22] Application of Traffic Light Control in Oversaturated Urban Network Using Multi-Agent Deep Reinforcement Learning
    Ei Mon, Ei
    Ochiai, Hideya
    Aswakul, Chaodit
    IEEE ACCESS, 2024, 12 : 82384 - 82395
  • [23] STMARL: A Spatio-Temporal Multi-Agent Reinforcement Learning Approach for Cooperative Traffic Light Control
    Wang, Yanan
    Xu, Tong
    Niu, Xin
    Tan, Chang
    Chen, Enhong
    Xiong, Hui
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (06) : 2228 - 2242
  • [24] A Graph Attention Mechanism Based Multi-Agent Reinforcement Learning Method for Efficient Traffic Light Control
    Su, Changqing
    Yan, Yan
    Wang, Tao
    Zhang, Baoxian
    Li, Cheng
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 1332 - 1337
  • [25] ReLight-WCTM: Multi-Agent Reinforcement Learning Approach for Traffic Light Control within a Realistic Traffic Simulation
    Palos, Peter
    Huszak, Arpad
    2021 44TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2021, : 62 - 65
  • [26] PyTSC: A Unified Platform for Multi-Agent Reinforcement Learning in Traffic Signal Control
    Bokade, Rohit
    Jin, Xiaoning
    SENSORS, 2025, 25 (05)
  • [27] Urban Traffic Control Using Distributed Multi-agent Deep Reinforcement Learning
    Kitagawa, Shunya
    Moustafa, Ahmed
    Ito, Takayuki
    PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2019, 11672 : 337 - 349
  • [28] Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control
    Zhao, Yang
    Hu, Jian-Ming
    Gao, Ming-Yang
    Zhang, Zuo
    CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, : 458 - 470
  • [29] Multi-Agent Reinforcement Learning for Traffic Signal Control: Algorithms and Robustness Analysis
    Wu, Chunliang
    Ma, Zhenliang
    Kim, Inhi
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [30] XLight: An interpretable multi-agent reinforcement learning approach for traffic signal control
    Cai, Sibin
    Fang, Jie
    Xu, Mengyun
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 273