Double Deep RL-Based Strategy for UAV-Assisted Energy Harvesting Optimization in Disaster-Resilient IoT Networks

被引:0
|
作者
Elmadina, Nahla Nur [1 ]
Saeed, Rashid A. [2 ]
Saeid, Elsadig [1 ]
Ali, Elmustafa Sayed [2 ]
Nafea, Ibtehal [3 ]
Ahmed, Mayada A. [4 ]
Mokhtar, Rania A. [2 ]
Khalifa, Othman O. [5 ,6 ]
机构
[1] Alzaiem Alazhari Univ, Dept Elect Engn, POB 1432, Khartoum 13311, Sudan
[2] Sudan Univ Sci & Technol, Elect Dept, Khartoum, Sudan
[3] Taibah Univ, Coll Comp Sci & Engn, Medina, Saudi Arabia
[4] Sudan Uni Sci & Tech, Sch ElecsEng, Fac Eng, Khartoum, Sudan
[5] Inter Islamic Uni Malaysia, Dept Elec & Comp Eng, Kuala Lumpur, Malaysia
[6] Libyan Ctr Engn Res & Informat Technol, Bani Walid, Libya
关键词
DDRL; EH; IoT; Energy Consumption; WPT; UAV; Resilient;
D O I
10.1109/ICOM61675.2024.10652500
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Unmanned Aerial Vehicles (UAVs) are increasingly crucial for emergency-response scenarios, including tasks like wireless power transfer (WPT) and data collection in disaster zones. This paper proposes a Double Deep Reinforcement Learning (DDRL) framework for energy harvesting (EH) in such scenarios. Our framework involves a UAV swarm navigating an area to provide WPT. The primary goal is to enhance service quality in critical areas while enabling dynamic swarm management for tasks like recharging. We formulate this as a nonlinear programming (NLP) optimization problem, maximizing EH from IoT devices and optimizing UAV trajectories under constraints like mission duration and energy limits. Due to the problem's complexity, we propose a lightweight DDRL solution capable of efficiently learning system dynamics. Extensive simulations and comparisons with Deep RL and DDPG algorithms demonstrate the superior performance of DDRL in enhancing EH, covering strategic locations effectively, and achieving high satisfaction and accuracy rates.
引用
收藏
页码:411 / 416
页数:6
相关论文
共 50 条
  • [21] Outage Energy Efficiency Maximization for UAV-Assisted Energy Harvesting Cognitive Radio Networks
    Xiao, He
    Jiang, Hong
    Deng, Li-Ping
    Luo, Ying
    Zhang, Qiu-Yun
    IEEE SENSORS JOURNAL, 2022, 22 (07) : 7094 - 7105
  • [22] Dynamic Charging Strategy Optimization for UAV-Assisted Wireless Rechargeable Sensor Networks Based on Deep Q-Network
    Liu, Ning
    Zhang, Jian
    Luo, Chuanwen
    Cao, Jia
    Hong, Yi
    Chen, Zhibo
    Chen, Ting
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12): : 21125 - 21134
  • [23] UAV-assisted Wireless Energy Harvesting Fog Computing Network Optimization Method
    Zhang, Li-Tong
    Xiong, Ke
    Zhang, Yu
    Ruan Jian Xue Bao/Journal of Software, 2019, 30 : 9 - 17
  • [24] Minimization of the Worst Case Average Energy Consumption in UAV-Assisted IoT Networks
    Rosabal, Osmel Martinez
    Lopez, Onel Luis Alcaraz
    Perez, Dian Echevarria
    Shehab, Mohammad
    Hilleshein, Henrique
    Alves, Hirley
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17) : 15827 - 15838
  • [25] Coverage Analysis for Energy-Harvesting UAV-Assisted mmWave Cellular Networks
    Wang, Xueyuan
    Gursoy, M. Cenk
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (12) : 2832 - 2850
  • [26] Deep Q-Learning based Resource Management in UAV-assisted Wireless Powered IoT Networks
    Li, Kai
    Ni, Wei
    Tovar, Eduardo
    Jamalipour, Abbas
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [27] Deep Reinforcement Learning for Energy-Efficient Fresh Data Collection in Rechargeable UAV-assisted IoT Networks
    Yi, Mengjie
    Wang, Xijun
    Liu, Juan
    Zhang, Yan
    Hou, Ronghui
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [28] UAV-assisted energy-efficient data gathering method of mine IoT after disaster
    Zhao Q.
    Yang W.
    Zhang L.
    Hu Q.
    Meitan Kexue Jishu/Coal Science and Technology (Peking), 2023, 51 (08): : 228 - 238
  • [29] ENERGENT: An Energy-Efficient UAV-Assisted Fog-IoT Framework for Disaster Management
    Abkenar, Forough Shirin
    Iranmanesh, Saeid
    Bouguettaya, Athman
    Raad, Raad
    Jamalipour, Abbas
    JOURNAL OF COMMUNICATIONS AND NETWORKS, 2022, 24 (06) : 698 - 709
  • [30] AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method
    Sun, Mengying
    Xu, Xiaodong
    Qin, Xiaoqi
    Zhang, Ping
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24) : 17275 - 17289