A Decentralized Multi-Agent Path Planning Approach Based on Imitation Learning and Selective Communication

被引:1
|
作者
Feng, Bohan [1 ]
Bi, Youyi [1 ]
Li, Mian [2 ]
Lin, Liyong [3 ]
机构
[1] Shanghai Jiao Tong Univ, Univ Michigan Shanghai Jiao Tong Univ Joint Inst, 800 Dongchuan Rd, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Global Inst Future Technol, 800 Dongchuan Rd, Shanghai 200240, Peoples R China
[3] Contemporary Amperex Technol Co Ltd, 2 Xingang Rd, Ningde 352100, Fujian, Peoples R China
基金
国家重点研发计划;
关键词
decentralized control; multi-agent path planning; mobile robot; selective communication; machine learning for engineering applications;
D O I
10.1115/1.4065167
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multi-agent path planning (MAPP) is crucial for large-scale mobile robot systems to work safely and properly in complex environments. Existing learning-based decentralized MAPP approaches allow each agent to gather information from nearby agents, leading to more efficient coordination among agents. However, these approaches often struggle with reasonably handling local information inputs for each agent, and their communication mechanisms between agents need to be further refined to treat those congested traffic scenarios effectively. To address these issues, we propose a decentralized MAPP approach based on imitation learning and selective communication. Our approach adopts an imitation learning architecture that enables agents to rapidly learn complex behaviors from expert planning experience. The information extraction layer is integrated with convolutional neural network (CNN) and gated recurrent unit (GRU) for capturing features from local field-of-view observations. A two-stage selective communication process based on graph attention neural network (GAT) is developed to reduce the required neighbor agents in inter-agent communication. In addition, an adaptive strategy switching mechanism utilizing local expert-planned paths is designed to support robots to escape from local traps. The effectiveness of our proposed approach is evaluated in simulated grid environments with varying map sizes, obstacle densities, and numbers of agents. Experimental results show that our approach outperforms other decentralized path planning methods in success rate while maintaining the lowest flowtime variation and communication frequency. Furthermore, our approach is computationally efficient and scalable, making it suitable for real-world applications.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Crowd Perception Communication-Based Multi- Agent Path Finding With Imitation Learning
    Xie, Jing
    Zhang, Yongjun
    Yang, Huanhuan
    Ouyang, Qianying
    Dong, Fang
    Guo, Xinyu
    Jin, Songchang
    Shi, Dianxi
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (10): : 8929 - 8936
  • [22] Decentralized Localization for Multi-agent Systems Based on Asynchronous Communication
    Lu, Lei
    Hu, Jinwen
    Pan, Quan
    Zhao, Chunhui
    Xu, Zhao
    Jia, Caijuan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 5489 - 5494
  • [23] Dynamic UAV Deployment for Differentiated Services: A Multi-Agent Imitation Learning Based Approach
    Wang, Xiaojie
    Ning, Zhaolong
    Guo, Song
    Wen, Miaowen
    Guo, Lei
    Poor, H. Vincent
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (04) : 2131 - 2146
  • [24] Provably Efficient Multi-Agent Reinforcement Learning with Fully Decentralized Communication
    Lidard, Justin
    Madhushani, Udari
    Leonard, Naomi Ehrich
    2022 AMERICAN CONTROL CONFERENCE, ACC, 2022, : 3311 - 3316
  • [25] Neighborhood-Oriented Decentralized Learning Communication in Multi-Agent System
    Dai, Hao
    Wu, Jiashu
    Brinkmann, Andre
    Wang, Yang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 490 - 502
  • [26] SCRIMP: Scalable Communication for Reinforcement- and Imitation-Learning-Based Multi-Agent Pathfinding
    Wang, Yutong
    Xiang, Bairan
    Huang, Shinan
    Sartoretti, Guillaume
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 9301 - 9308
  • [27] A multi-agent optimal path planning approach to robotics environment
    Kumar T., Gireesh
    Vijayan, Vinodh. P.
    ICCIMA 2007: INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND MULTIMEDIA APPLICATIONS, VOL I, PROCEEDINGS, 2007, : 400 - 404
  • [28] Multi-Agent UAV Path Planning
    Marsh, L.
    Calbert, G.
    Tu, J.
    Gossink, D.
    Kwok, H.
    MODSIM 2005: INTERNATIONAL CONGRESS ON MODELLING AND SIMULATION: ADVANCES AND APPLICATIONS FOR MANAGEMENT AND DECISION MAKING: ADVANCES AND APPLICATIONS FOR MANAGEMENT AND DECISION MAKING, 2005, : 2188 - 2194
  • [29] Periodic Multi-Agent Path Planning
    Kasaura, Kazumi
    Yonetani, Ryo
    Nishimura, Mai
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 5, 2023, : 6183 - 6191
  • [30] Efficient multi-agent path planning
    Arikan, O
    Chenney, S
    Forsyth, DA
    COMPUTER ANIMATION AND SIMULATION 2001, 2001, : 151 - 162