A Decentralized Multi-Agent Path Planning Approach Based on Imitation Learning and Selective Communication

被引:1
|
作者
Feng, Bohan [1 ]
Bi, Youyi [1 ]
Li, Mian [2 ]
Lin, Liyong [3 ]
机构
[1] Shanghai Jiao Tong Univ, Univ Michigan Shanghai Jiao Tong Univ Joint Inst, 800 Dongchuan Rd, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Global Inst Future Technol, 800 Dongchuan Rd, Shanghai 200240, Peoples R China
[3] Contemporary Amperex Technol Co Ltd, 2 Xingang Rd, Ningde 352100, Fujian, Peoples R China
基金
国家重点研发计划;
关键词
decentralized control; multi-agent path planning; mobile robot; selective communication; machine learning for engineering applications;
D O I
10.1115/1.4065167
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multi-agent path planning (MAPP) is crucial for large-scale mobile robot systems to work safely and properly in complex environments. Existing learning-based decentralized MAPP approaches allow each agent to gather information from nearby agents, leading to more efficient coordination among agents. However, these approaches often struggle with reasonably handling local information inputs for each agent, and their communication mechanisms between agents need to be further refined to treat those congested traffic scenarios effectively. To address these issues, we propose a decentralized MAPP approach based on imitation learning and selective communication. Our approach adopts an imitation learning architecture that enables agents to rapidly learn complex behaviors from expert planning experience. The information extraction layer is integrated with convolutional neural network (CNN) and gated recurrent unit (GRU) for capturing features from local field-of-view observations. A two-stage selective communication process based on graph attention neural network (GAT) is developed to reduce the required neighbor agents in inter-agent communication. In addition, an adaptive strategy switching mechanism utilizing local expert-planned paths is designed to support robots to escape from local traps. The effectiveness of our proposed approach is evaluated in simulated grid environments with varying map sizes, obstacle densities, and numbers of agents. Experimental results show that our approach outperforms other decentralized path planning methods in success rate while maintaining the lowest flowtime variation and communication frequency. Furthermore, our approach is computationally efficient and scalable, making it suitable for real-world applications.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Attention-Cooperated Reinforcement Learning for Multi-agent Path Planning
    Ma, Jinchao
    Lian, Defu
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS. DASFAA 2022 INTERNATIONAL WORKSHOPS, 2022, 13248 : 272 - 290
  • [42] Exploration of Multi-Agent Reinforcement Learning for ISR Flight Path Planning
    Xie, Lynphone Mark
    Conway, Emily
    Cheng, Huaining
    Amsaad, Fathi
    IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE, NAECON 2024, 2024, : 328 - 333
  • [43] Energy Constrained Multi-Agent Reinforcement Learning for Coverage Path Planning
    Zhao, Chenyang
    Liu, Juan
    Yoon, Suk-Un
    Li, Xinde
    Li, Heqing
    Zhang, Zhentong
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5590 - 5597
  • [44] Communication-Efficient Training Workload Balancing for Decentralized Multi-Agent Learning
    Mohammadabadi, Seyed Mahmoud Sajjadi
    Yang, Lei
    Yan, Feng
    Zhang, Junshan
    2024 IEEE 44TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS 2024, 2024, : 680 - 691
  • [45] A coordinated scheduling approach for task assignment and multi-agent path planning
    Fang, Chengyuan
    Mao, Jianlin
    Li, Dayan
    Wang, Ning
    Wang, Niya
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (01)
  • [46] Perception field based imitation learning for unlabeled multi-agent pathfinding
    Wenjie CHU
    Ailun YU
    Wei ZHANG
    Haiyan ZHAO
    Zhi JIN
    Science China(Information Sciences), 2024, 67 (05) : 115 - 135
  • [47] An innovative multi-agent search-and-rescue path planning approach
    Berger, Jean
    Lo, Nassirou
    COMPUTERS & OPERATIONS RESEARCH, 2015, 53 : 24 - 31
  • [48] Perception field based imitation learning for unlabeled multi-agent pathfinding
    Chu, Wenjie
    Yu, Ailun
    Zhang, Wei
    Zhao, Haiyan
    Jin, Zhi
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (05)
  • [49] Decentralized Deterministic Multi-Agent Reinforcement Learning
    Grosnit, Antoine
    Cai, Desmond
    Wynter, Laura
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 1548 - 1553
  • [50] Sensor Allocation and Online-Learning-Based Path Planning for Maritime Situational Awareness Enhancement: A Multi-Agent Approach
    Nguyen, Bach Long
    Doan, Anh-Dzung
    Chin, Tat-Jun
    Guettier, Christophe
    Gupta, Surabhi
    Parra, Estelle
    Reid, Ian
    Wagner, Markus
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 11635 - 11647