Multi-agent broad reinforcement learning for intelligent traffic light control

被引:30
|
作者
Zhu, Ruijie [1 ]
Li, Lulu [1 ]
Wu, Shuning [1 ]
Lv, Pei [1 ]
Li, Yafei [1 ]
Xu, Mingliang [1 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artif Intelligence, Zhengzhou, Peoples R China
基金
美国国家科学基金会;
关键词
Intelligent traffic light control; Deep neural networks; Broad reinforcment learning; Multi -agent deep reinforcement learning;
D O I
10.1016/j.ins.2022.11.062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intelligent traffic light control (ITLC) aims to relieve traffic congestion. Some multi-agent deep reinforcement learning (MADRL) algorithms have been proposed for ITLC, and most of them use deep neural networks to make decisions. However, the abundant parameters of deep structure lead to the time-consuming training process of MADRL. Recently, a broad reinforcement learning (BRL) approach has been proposed to improve the efficiency of training for an agent. Unlike MADRL algorithms that use deep architecture, BRL utilizes a broad architecture. In this paper, we propose a multi-agent broad reinforcement learning (MABRL) algorithm for ITLC. The MABRL algorithm adopts the broad network to process the joint information and updates the parameters using ridge regression. To increase the effectiveness of interaction among agents, we design a dynamic interaction mechanism (DIM) based on the attention mechanism. The DIM enables agents to aggregate information on particular intersections at appropriate moments. We conduct experiments on three different datasets. The results demonstrate that the effectiveness of MABRL outperforms several state-of-the-art algorithms in alleviating traffic congestion with shorter training time. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:509 / 525
页数:17
相关论文
共 50 条
  • [1] A multi-agent reinforcement learning based approach for intelligent traffic signal control
    Benhamza, Karima
    Seridi, Hamid
    Agguini, Meriem
    Bentagine, Amel
    EVOLVING SYSTEMS, 2024, 15 (06) : 2383 - 2397
  • [2] Cooperative Multi-agent Reinforcement Learning Models (CMRLM) for Intelligent Traffic Control
    Vidhate, Deepak A.
    Kulkarni, Parag
    2017 1ST INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND INFORMATION MANAGEMENT (ICISIM), 2017, : 325 - 331
  • [3] Adaptive Multi-Agent Deep Mixed Reinforcement Learning for Traffic Light Control
    Li, Lulu
    Zhu, Ruijie
    Wu, Shuning
    Ding, Wenting
    Xu, Mingliang
    Lu, Jiwen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (02) : 1803 - 1816
  • [4] Multi-agent Reinforcement Learning for Traffic Signal Control
    Prabuchandran, K. J.
    Kumar, Hemanth A. N.
    Bhatnagar, Shalabh
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2014, : 2529 - 2534
  • [5] Intelligent Traffic Light Control Using Distributed Multi-agent Q Learning
    Liu, Ying
    Liu, Lei
    Chen, Wei-Peng
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [6] Adaptive Broad Deep Reinforcement Learning for Intelligent Traffic Light Control
    Zhu, Ruijie
    Wu, Shuning
    Li, Lulu
    Ding, Wenting
    Lv, Ping
    Sui, Luyao
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28496 - 28507
  • [7] A multi-agent approach for intelligent traffic-light control
    Hirankitti, Visit
    Krohkaew, Jaturapith
    Hogger, Chris
    WORLD CONGRESS ON ENGINEERING 2007, VOLS 1 AND 2, 2007, : 116 - 121
  • [8] Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks
    Wu, Tong
    Zhou, Pan
    Liu, Kai
    Yuan, Yali
    Wang, Xiumin
    Huang, Huawei
    Wu, Dapeng Oliver
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (08) : 8243 - 8256
  • [9] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Liu, Dongjiang
    Li, Leixiao
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [10] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Dongjiang Liu
    Leixiao Li
    Scientific Reports, 13