Double Deep RL-Based Strategy for UAV-Assisted Energy Harvesting Optimization in Disaster-Resilient IoT Networks

被引:0
|
作者
Elmadina, Nahla Nur [1 ]
Saeed, Rashid A. [2 ]
Saeid, Elsadig [1 ]
Ali, Elmustafa Sayed [2 ]
Nafea, Ibtehal [3 ]
Ahmed, Mayada A. [4 ]
Mokhtar, Rania A. [2 ]
Khalifa, Othman O. [5 ,6 ]
机构
[1] Alzaiem Alazhari Univ, Dept Elect Engn, POB 1432, Khartoum 13311, Sudan
[2] Sudan Univ Sci & Technol, Elect Dept, Khartoum, Sudan
[3] Taibah Univ, Coll Comp Sci & Engn, Medina, Saudi Arabia
[4] Sudan Uni Sci & Tech, Sch ElecsEng, Fac Eng, Khartoum, Sudan
[5] Inter Islamic Uni Malaysia, Dept Elec & Comp Eng, Kuala Lumpur, Malaysia
[6] Libyan Ctr Engn Res & Informat Technol, Bani Walid, Libya
关键词
DDRL; EH; IoT; Energy Consumption; WPT; UAV; Resilient;
D O I
10.1109/ICOM61675.2024.10652500
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Unmanned Aerial Vehicles (UAVs) are increasingly crucial for emergency-response scenarios, including tasks like wireless power transfer (WPT) and data collection in disaster zones. This paper proposes a Double Deep Reinforcement Learning (DDRL) framework for energy harvesting (EH) in such scenarios. Our framework involves a UAV swarm navigating an area to provide WPT. The primary goal is to enhance service quality in critical areas while enabling dynamic swarm management for tasks like recharging. We formulate this as a nonlinear programming (NLP) optimization problem, maximizing EH from IoT devices and optimizing UAV trajectories under constraints like mission duration and energy limits. Due to the problem's complexity, we propose a lightweight DDRL solution capable of efficiently learning system dynamics. Extensive simulations and comparisons with Deep RL and DDPG algorithms demonstrate the superior performance of DDRL in enhancing EH, covering strategic locations effectively, and achieving high satisfaction and accuracy rates.
引用
收藏
页码:411 / 416
页数:6
相关论文
共 50 条
  • [31] Time Allocation Optimization and Trajectory Design in UAV-Assisted Energy and Spectrum Harvesting Network
    Shi, Shuo
    Li, Yuchen
    Gu, Shushi
    Huang, Tao
    Gu, Xuemai
    IEEE ACCESS, 2020, 8 (08): : 160537 - 160548
  • [32] Proximal Policy Optimization Algorithm for Enhancing Energy Harvesting in UAV-Assisted Communications with RIS
    Xiao, Ke
    Yu, Zhenwei
    Wang, Jiaxin
    Gao, Feifei
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [33] Joint Speed Control and Energy Replenishment Optimization for UAV-Assisted IoT Data Collection With Deep Reinforcement Transfer Learning
    Chu, Nam H.
    Hoang, Dinh Thai
    Nguyen, Diep N.
    Huynh, Nguyen Van
    Dutkiewicz, Eryk
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (07) : 5778 - 5793
  • [34] Optimizing Energy Efficiency in UAV-Assisted Networks Using Deep Reinforcement Learning
    Omoniwa, Babatunji
    Galkin, Boris
    Dusparic, Ivana
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (08) : 1590 - 1594
  • [35] Multi-Objective Optimization for UAV-Assisted Wireless Powered IoT Networks Based on Extended DDPG Algorithm
    Yu, Yu
    Tang, Jie
    Huang, Jiayi
    Zhang, Xiuyin
    So, Daniel Ka Chun
    Wong, Kai-Kit
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) : 6361 - 6374
  • [36] Energy Efficient UAV-Assisted IoT Data Collection: A Graph-Based Deep Reinforcement Learning Approach
    Wu, Qianqian
    Liu, Qiang
    Zhu, Wenliang
    Wu, Zefan
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (06): : 6082 - 6094
  • [37] Energy Efficiency Optimization of IRS and UAV-Assisted Wireless Powered Edge Networks
    Wang, Xiaojie
    Li, Jiameng
    Wu, Jun
    Guo, Lei
    Ning, Zhaolong
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2024, 18 (07) : 1297 - 1310
  • [38] RL-Based Energy-Efficient Data Transmission Over Hybrid BLE/LTE/Wi-Fi/LoRa UAV-Assisted Wireless Network
    Nelson, Wilson Ayyanthole
    Yeduri, Sreenivasa Reddy
    Jha, Ajit
    Kumar, Abhinav
    Cenkeramaddi, Linga Reddy
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (03) : 1951 - 1966
  • [39] Caching Placement Optimization in UAV-Assisted Cellular Networks: A Deep Reinforcement Learning-Based Framework
    Wang, Yun
    Fu, Shu
    Yao, Changhua
    Zhang, Haijun
    Yu, Fei Richard
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2023, 12 (08) : 1359 - 1363
  • [40] Resource Allocation Strategy for UAV-assisted Non-linear Energy Harvesting MEC System
    He, Ximei
    Zhao, Yisheng
    Xu, Zhihong
    Chen, Yong
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,