Multi-Agent Deep Reinforcement Learning-Based Multi-UAV Path Planning for Wireless Data Collection and Energy Transfer

被引:0
|
作者
Lee, Chungnyeong [1 ]
Lee, Sangcheol [1 ]
Kim, Taehoon [2 ]
Bang, Inkyu [3 ]
Lee, Jung Hoon [4 ]
Chae, Seong Ho [5 ]
机构
[1] Tech Univ Korea, Dept IT Semicond Convergence Engn, Shihung, South Korea
[2] Hanbat Natl Univ, Dept Comp Engn, Daejeon, South Korea
[3] Hanbat Natl Univ, Dept Intelligence Media Engn, Daejeon, South Korea
[4] Hankuk Univ Foreign Studies, Dept Elect Engn & Appl Commun Res Ctr, Seoul, South Korea
[5] Tech Univ Korea, Dept Elect Engn, Shihung, South Korea
关键词
Age of information; data collection; multi-agent deep reinforcement learning; trajectory planning; unmanned aerial vehicle;
D O I
10.1109/ICUFN61752.2024.10625275
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose the wireless energy transfer and data collection system for multi-unmanned aerial vehicles (UAVs). This system enables multiple UAVs to transfer energy to and collect data from internet of things (IoT) devices, and to recharge their batteries at a central charging station when their batteries are low. In this paper, we propose a multi-UAV path algorithm based on distributed multi-agent deep Q-network (MADQN) to minimize the overall age-of-information (AoI) of IoT devices. The numerical results demonstrate that our proposed algorithm outperforms the benchmark scheme in terms of AoI enables to prolong data collection by continuously charging the battery of both IoT devices and UAVs.
引用
收藏
页码:500 / 504
页数:5
相关论文
共 50 条
  • [1] Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning
    Zhao, Xiaoru
    Yang, Rennong
    Zhong, Liangsheng
    Hou, Zhiwei
    DRONES, 2024, 8 (01)
  • [2] Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning
    Bayerlein, Harald
    Theile, Mirco
    Caccamo, Marco
    Gesbert, David
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2021, 2 : 1171 - 1187
  • [3] Multi-Agent Deep Reinforcement Learning-Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing
    Wang, Liang
    Wang, Kezhi
    Pan, Cunhua
    Xu, Wei
    Aslam, Nauman
    Hanzo, Lajos
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) : 73 - 84
  • [4] Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning
    Qie, Han
    Shi, Dianxi
    Shen, Tianlong
    Xu, Xinhai
    Li, Yuan
    Wang, Liujing
    IEEE ACCESS, 2019, 7 : 146264 - 146272
  • [5] Energy-Efficient Multi-UAV Network using Multi-Agent Deep Reinforcement Learning
    Ju, Hyungyu
    Shim, Byonghyo
    2022 IEEE VTS ASIA PACIFIC WIRELESS COMMUNICATIONS SYMPOSIUM, APWCS, 2022, : 70 - 74
  • [6] Deep Reinforcement Learning Based Energy Efficient Multi-UAV Data Collection for IoT Networks
    Khodaparast, Seyed Saeed
    Lu, Xiao
    Wang, Ping
    Uyen Trang Nguyen
    IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2021, 2 : 249 - 260
  • [7] Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning
    Westheider, Jonas
    Rueckin, Julius
    Popovic, Marija
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 649 - 656
  • [8] Multi-Agent Deep Reinforcement Learning for Full-Duplex Multi-UAV Networks
    Dai, Chen
    Zhu, Kun
    Hossain, Ekram
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 2232 - 2237
  • [9] Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks
    Zhao, Nan
    Liu, Zehua
    Cheng, Yiqiang
    IEEE ACCESS, 2020, 8 : 139670 - 139679
  • [10] Multi-UAV Redeployment Optimization Based on Multi-Agent Deep Reinforcement Learning Oriented to Swarm Performance Restoration
    Wu, Qilong
    Geng, Zitao
    Ren, Yi
    Feng, Qiang
    Zhong, Jilong
    SENSORS, 2023, 23 (23)