Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions Using Reinforcement Learning

被引:3
|
作者
Ye, Qiming [1 ]
Feng, Yuxiang [1 ]
Macias, Jose Javier Escribano [1 ]
Stettler, Marc [1 ]
Angeloudis, Panagiotis [1 ]
机构
[1] Imperial Coll London, Ctr Transport Studies, Dept Civil & Environm Engn, London SW72AZ, England
关键词
Autonomous vehicles; pedestrians; smart city; intelligent transport system; reinforcement learning; infrastruc-ture management;
D O I
10.1109/TITS.2022.3220110
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an operational framework that can dynamically generate ROW plans for AVs and pedestrians in response to real-time demand. Based on microscopic traffic simulation, this study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised learning paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians. Furthermore, the distributive learning algorithm outperforms its centralised counterpart regarding computational cost (49.55%), benchmark rewards (25.35%), best cumulative rewards (24.58%), optimal actions (13.49%) and rate of convergence. This novel road management technique could potentially contribute to the flow-adaptive and active mobility-friendly streets in the AVs era.
引用
收藏
页码:2024 / 2034
页数:11
相关论文
共 50 条
  • [31] Reinforcement Learning for Autonomous Vehicle using MPC in Highway Situation
    Kim, Yujin
    Pae, Dong-Sung
    Jang, Sun-Ho
    Kang, Seong-Woo
    Lim, Myo-Taeg
    2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2022,
  • [32] Deep reinforcement learning for adaptive path planning and control of an autonomous underwater vehicle
    Hadi, Behnaz
    Khosravi, Alireza
    Sarhadi, Pouria
    APPLIED OCEAN RESEARCH, 2022, 129
  • [33] Holistic Spatio-Temporal Graph Attention for Trajectory Prediction in Vehicle-Pedestrian Interactions
    Alghodhaifi, Hesham
    Lakshmanan, Sridhar
    SENSORS, 2023, 23 (17)
  • [34] A novel model for real-time risk evaluation of vehicle-pedestrian interactions at intersections
    Wang, Tao
    Ge, Ying-En
    Wang, Yongjie
    Chen, Wenqiang
    Fu, Qian
    Niu, Yuchen
    ACCIDENT ANALYSIS AND PREVENTION, 2024, 206
  • [35] Enhanced microsimulation framework for right-turning vehicle-pedestrian interactions at signalized intersection
    Chen, Xu
    Li, Siyu
    Yang, Wenzhang
    Chen, Yujia
    Wang, Hao
    SIMULATION MODELLING PRACTICE AND THEORY, 2024, 134
  • [36] An improved vehicle-pedestrian near-crash identification method with a roadside LiDAR sensor
    Wu, Jianqing
    Xu, Hao
    Zhang, Yongsheng
    Sun, Renjuan
    JOURNAL OF SAFETY RESEARCH, 2020, 73 : 211 - 224
  • [37] Deep learning for autonomous vehicle and pedestrian interaction safety
    Zhu, Zijiang
    Hu, Zhenlong
    Dai, Weihuang
    Chen, Hang
    Lv, Zhihan
    SAFETY SCIENCE, 2022, 145
  • [38] Autonomous Surface Vehicle Control Method Using Deep Reinforcement Learning
    Zhang, Shang
    Yang, Rui
    Chen, Zhen
    Li, Ming
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1664 - 1668
  • [39] Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction Using a Graph Vehicle-Pedestrian Attention Network
    Eiffert, Stuart
    Li, Kunming
    Shan, Mao
    Worrall, Stewart
    Sukkarieh, Salah
    Nebot, Eduardo
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04): : 5026 - 5033
  • [40] Controlling an Autonomous Vehicle with Deep Reinforcement Learning
    Folkers, Andreas
    Rick, Matthias
    Bueskens, Christof
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 2025 - 2031