A Decentralized Multi-Agent Path Planning Approach Based on Imitation Learning and Selective Communication

被引:1
|
作者
Feng, Bohan [1 ]
Bi, Youyi [1 ]
Li, Mian [2 ]
Lin, Liyong [3 ]
机构
[1] Shanghai Jiao Tong Univ, Univ Michigan Shanghai Jiao Tong Univ Joint Inst, 800 Dongchuan Rd, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Global Inst Future Technol, 800 Dongchuan Rd, Shanghai 200240, Peoples R China
[3] Contemporary Amperex Technol Co Ltd, 2 Xingang Rd, Ningde 352100, Fujian, Peoples R China
基金
国家重点研发计划;
关键词
decentralized control; multi-agent path planning; mobile robot; selective communication; machine learning for engineering applications;
D O I
10.1115/1.4065167
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multi-agent path planning (MAPP) is crucial for large-scale mobile robot systems to work safely and properly in complex environments. Existing learning-based decentralized MAPP approaches allow each agent to gather information from nearby agents, leading to more efficient coordination among agents. However, these approaches often struggle with reasonably handling local information inputs for each agent, and their communication mechanisms between agents need to be further refined to treat those congested traffic scenarios effectively. To address these issues, we propose a decentralized MAPP approach based on imitation learning and selective communication. Our approach adopts an imitation learning architecture that enables agents to rapidly learn complex behaviors from expert planning experience. The information extraction layer is integrated with convolutional neural network (CNN) and gated recurrent unit (GRU) for capturing features from local field-of-view observations. A two-stage selective communication process based on graph attention neural network (GAT) is developed to reduce the required neighbor agents in inter-agent communication. In addition, an adaptive strategy switching mechanism utilizing local expert-planned paths is designed to support robots to escape from local traps. The effectiveness of our proposed approach is evaluated in simulated grid environments with varying map sizes, obstacle densities, and numbers of agents. Experimental results show that our approach outperforms other decentralized path planning methods in success rate while maintaining the lowest flowtime variation and communication frequency. Furthermore, our approach is computationally efficient and scalable, making it suitable for real-world applications.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] A Multi-Agent Planning Approach Integrated with Learning Mechanism
    Zhang, Tao
    Zheng, Liang
    Ueno, Haruki
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, VOLS 1-4, 2009, : 1550 - +
  • [32] Observation-Based Multi-Agent Planning with Communication
    Gasparini, Luca
    Norman, Timothy J.
    Kollingbaum, Martin J.
    ECAI 2016: 22ND EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, 285 : 444 - 452
  • [33] Multi-Agent Imitation Learning for Driving Simulation
    Bhattacharyya, Raunak P.
    Phillips, Derek J.
    Wulfe, Blake
    Morton, Jeremy
    Kuefler, Alex
    Kochenderfer, Mykel J.
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 1534 - 1539
  • [34] Multi-Agent Generative Adversarial Imitation Learning
    Song, Jiaming
    Ren, Hongyu
    Sadigh, Dorsa
    Ermon, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [35] Conditional Imitation Learning for Multi-Agent Games
    Shih, Andy
    Ermon, Stefano
    Sadigh, Dorsa
    PROCEEDINGS OF THE 2022 17TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI '22), 2022, : 166 - 175
  • [36] Multi-agent policy learning-based path planning for autonomous mobile robots
    Zhang, Lixiang
    Cai, Ze
    Yan, Yan
    Yang, Chen
    Hu, Yaoguang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [37] Intent-based Deep Reinforcement Learning for Multi-agent Informative Path Planning
    Yang, Tianze
    Cao, Yuhong
    Sartoretti, Guillaume
    2023 INTERNATIONAL SYMPOSIUM ON MULTI-ROBOT AND MULTI-AGENT SYSTEMS, MRS, 2023, : 71 - 77
  • [38] Deep Reinforcement Learning for Image-Based Multi-Agent Coverage Path Planning
    Xu, Meng
    She, Yechao
    Jin, Yang
    Wang, Jianping
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [39] Improved Multi-Agent Reinforcement Learning for Path Planning-Based Crowd Simulation
    Wang, Qingqing
    Liu, Hong
    Gao, Kaizhou
    Zhang, Le
    IEEE ACCESS, 2019, 7 : 73841 - 73855
  • [40] Learn to Follow: Decentralized Lifelong Multi-Agent Pathfinding via Planning and Learning
    Skrynnik, Alexey
    Andreychuk, Anton
    Nesterova, Maria
    Yakovlev, Konstantin
    Panov, Aleksandr
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 17541 - 17549