Truck-Drone Delivery Optimization Based on Multi-Agent Reinforcement Learning

被引:7
|
作者
Bi, Zhiliang [1 ]
Guo, Xiwang [1 ]
Wang, Jiacun [2 ]
Qin, Shujin [3 ]
Liu, Guanjun [4 ]
机构
[1] Liaoning Petrochem Univ, Sch Informat & Control, Fushun 113001, Peoples R China
[2] Monmouth Univ, Sch Comp Sci & Software Engn, West Long Branch, NJ 07764 USA
[3] Shangqiu Normal Univ, Sch Econ & Management, Shangqiu 476000, Peoples R China
[4] Tongji Univ, Sch Elect & Informat Engn, Shangqhai 201804, Peoples R China
关键词
reinforcement learning; drone; multi-agent problem; path planning; TRAVELING SALESMAN PROBLEM;
D O I
10.3390/drones8010027
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
In recent years, the adoption of truck-drone collaborative delivery has emerged as an innovative approach to enhance transportation efficiency and minimize the depletion of human resources. Such a model simultaneously addresses the endurance limitations of drones and the time wastage incurred during the "last-mile" deliveries by trucks. Trucks serve not only as a carrier platform for drones but also as storage hubs and energy sources for these unmanned aerial vehicles. Drawing from the distinctive attributes of truck-drone collaborative delivery, this research has created a multi-drone delivery environment utilizing the MPE library. Furthermore, a spectrum of optimization techniques has been employed to enhance the algorithm's efficacy within the truck-drone distribution system. Finally, a comparative analysis is conducted with other multi-agent reinforcement learning algorithms within the same environment, thus affirming the rationality of the problem formulation and highlighting the algorithm's superior performance.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Optimization of a Truck-drone in Tandem Delivery Network Using K-means and Genetic Algorithm
    Ferrandez, Sergio Mourelo
    Harbison, Timothy
    Weber, Troy
    Sturges, Robert
    Rich, Robert
    JOURNAL OF INDUSTRIAL ENGINEERING AND MANAGEMENT-JIEM, 2016, 9 (02): : 374 - 388
  • [32] Learning without Gradients: Multi-Agent Reinforcement Learning approach to optimization
    Morcos, Amir
    Man, Hong
    West, Aaron
    Maguire, Brian
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING IN DEFENSE APPLICATIONS IV, 2022, 12276
  • [33] Multi-agent cooperative learning research based on reinforcement learning
    Liu, Fei
    Zeng, Guangzhou
    2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 1408 - 1413
  • [34] Multi-Objective Optimization Algorithm With Adaptive Resource Allocation for Truck-Drone Collaborative Delivery and Pick-Up Services
    Luo, Qizhang
    Wu, Guohua
    Trivedi, Anupam
    Hong, Fangyu
    Wang, Ling
    Srinivasan, Dipti
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (09) : 9642 - 9657
  • [35] The sustainable hybrid truck-drone delivery model with stochastic customer existence
    Teimoury, Ebrahim
    Rashid, Reza
    RESEARCH IN TRANSPORTATION ECONOMICS, 2023, 100
  • [36] Collaborative Truck-Drone Routing for Contactless Parcel Delivery During the Epidemic
    Wu, Guohua
    Mao, Ni
    Luo, Qizhang
    Xu, Binjie
    Shi, Jianmai
    Suganthan, Ponnuthurai Nagaratnam
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) : 25077 - 25091
  • [37] Collaborative Optimization of Multi-microgrid System Based on Multi-agent Game and Reinforcement Learning
    Liu, Junfeng
    Wang, Xiaosheng
    Lu, Junbo
    Zeng, Jun
    Dianwang Jishu/Power System Technology, 2022, 46 (07): : 2722 - 2732
  • [38] Multi-agent reinforcement learning based on local communication
    Zhang, Wenxu
    Ma, Lei
    Li, Xiaonan
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 6): : 15357 - 15366
  • [39] Multi-objective optimization of turbine blade profiles based on multi-agent reinforcement learning
    Li, Lele
    Zhang, Weihao
    Li, Ya
    Jiang, Chiju
    Wang, Yufan
    ENERGY CONVERSION AND MANAGEMENT, 2023, 297
  • [40] Multi-agent Cooperative Search based on Reinforcement Learning
    Sun, Yinjiang
    Zhang, Rui
    Liang, Wenbao
    Xu, Cheng
    PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 891 - 896