Double Deep RL-Based Strategy for UAV-Assisted Energy Harvesting Optimization in Disaster-Resilient IoT Networks

被引:0
|
作者
Elmadina, Nahla Nur [1 ]
Saeed, Rashid A. [2 ]
Saeid, Elsadig [1 ]
Ali, Elmustafa Sayed [2 ]
Nafea, Ibtehal [3 ]
Ahmed, Mayada A. [4 ]
Mokhtar, Rania A. [2 ]
Khalifa, Othman O. [5 ,6 ]
机构
[1] Alzaiem Alazhari Univ, Dept Elect Engn, POB 1432, Khartoum 13311, Sudan
[2] Sudan Univ Sci & Technol, Elect Dept, Khartoum, Sudan
[3] Taibah Univ, Coll Comp Sci & Engn, Medina, Saudi Arabia
[4] Sudan Uni Sci & Tech, Sch ElecsEng, Fac Eng, Khartoum, Sudan
[5] Inter Islamic Uni Malaysia, Dept Elec & Comp Eng, Kuala Lumpur, Malaysia
[6] Libyan Ctr Engn Res & Informat Technol, Bani Walid, Libya
关键词
DDRL; EH; IoT; Energy Consumption; WPT; UAV; Resilient;
D O I
10.1109/ICOM61675.2024.10652500
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Unmanned Aerial Vehicles (UAVs) are increasingly crucial for emergency-response scenarios, including tasks like wireless power transfer (WPT) and data collection in disaster zones. This paper proposes a Double Deep Reinforcement Learning (DDRL) framework for energy harvesting (EH) in such scenarios. Our framework involves a UAV swarm navigating an area to provide WPT. The primary goal is to enhance service quality in critical areas while enabling dynamic swarm management for tasks like recharging. We formulate this as a nonlinear programming (NLP) optimization problem, maximizing EH from IoT devices and optimizing UAV trajectories under constraints like mission duration and energy limits. Due to the problem's complexity, we propose a lightweight DDRL solution capable of efficiently learning system dynamics. Extensive simulations and comparisons with Deep RL and DDPG algorithms demonstrate the superior performance of DDRL in enhancing EH, covering strategic locations effectively, and achieving high satisfaction and accuracy rates.
引用
收藏
页码:411 / 416
页数:6
相关论文
共 50 条
  • [1] Deep RL-based Trajectory Planning for AoI Minimization in UAV-assisted IoT
    Zhou, Conghao
    He, Hongli
    Yang, Peng
    Lyu, Feng
    Wu, Wen
    Cheng, Nan
    Shen, Xuemin
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [2] Resource Allocation for UAV-Assisted IoT Networks with Energy Harvesting and Computation Offloading
    Xu, Hao
    Pan, Cunhua
    Wang, Kezhi
    Chen, Ming
    Nallanathan, Arumugam
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [3] Energy-Efficient Trajectory Optimization for UAV-Assisted IoT Networks
    Zhang, Liang
    Celik, Abdulkadir
    Dang, Shuping
    Shihada, Basem
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (12) : 4323 - 4337
  • [4] Computational Efficiency Maximization for UAV-Assisted MEC Networks With Energy Harvesting in Disaster Scenarios
    Khalid, Reda
    Shah, Zaiba
    Naeem, Muhammad
    Ali, Amjad
    Al-Fuqaha, Ala
    Ejaz, Waleed
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (05): : 9004 - 9018
  • [5] Max-Min Secrecy Rate for UAV-Assisted Energy Harvesting IoT Networks
    Zheng, Mingrui
    Feng, Tianrui
    He, Tengjiao
    INFORMATION, 2025, 16 (02)
  • [6] Meta Reinforcement Learning for UAV-Assisted Energy Harvesting IoT Devices in Disaster-Affected Areas
    Dhuheir, Marwan
    Erbad, Aiman
    Al-Fuqaha, Ala
    Seid, Abegaz Mohammed
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 2145 - 2163
  • [7] IoT-Inspired Cooperative Spectrum Sharing With Energy Harvesting in UAV-Assisted NOMA Networks: Deep Learning Assessment
    Kumar, Ratnesh
    Singh, Chandan Kumar
    Upadhyay, Prabhat Kumar
    Salhab, Anas M.
    Nasir, Ali Arshad
    Masood, Mudassir
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (24) : 22182 - 22196
  • [8] Deep Reinforcement Learning Based Resource Management in UAV-Assisted IoT Networks
    Munaye, Yirga Yayeh
    Juang, Rong-Terng
    Lin, Hsin-Piao
    Tarekegn, Getaneh Berie
    Lin, Ding-Bing
    APPLIED SCIENCES-BASEL, 2021, 11 (05): : 1 - 20
  • [9] Flying path optimization in UAV-assisted IoT sensor networks
    Yoo, Sang-Jo
    Park, Jae-hyun
    Kim, Su-hee
    Shrestha, Anish
    ICT EXPRESS, 2016, 2 (03): : 140 - 144
  • [10] Location and Complex Status Update Strategy Optimization in UAV-Assisted IoT
    Diao, Xianbang
    Cai, Yueming
    Yu, Baoquan
    Wu, Qihui
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (13) : 11588 - 11604