Delanalty Minimization With Reinforcement Learning in UAV-Aided Mobile Network

被引:0
|
作者
Tseng, Fan-Hsun [1 ]
Hsieh, Yu-Jung [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
关键词
Actor-critic (AC); data offloading; deep reinforcement learning (DRL); trajectory planning; unmanned aerial vehicle (UAV); COMMUNICATION; OPTIMIZATION; DESIGN; ENERGY; ALLOCATION;
D O I
10.1109/TCSS.2023.3283016
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicle (UAV)-assisted mobile communication has been studied in recent years. UAVs can be used as aerial base stations (BSs) to improve the performance of terrestrial mobile network. In this article, mobile data offloading with UAV trajectory optimization is investigated. To tackle with the delay of requesting data and the immediacy of requested data at the same time, a new metric named delanalty is newly proposed. The delanalty metric jointly considers the delay of user requesting data, the immediacy of requested data file, and the quantity of residual requesting data. A find max delanalty user mechanism is proposed to eliminate the user who has the largest delay time. Furthermore, an actor-critic (AC)-based deep reinforcement learning (DRL) algorithm called AC-based delanalty trajectory optimization (ACDTO) algorithm is proposed to solve UAV's trajectory optimization problem. Simulation results show that the proposed ACDTO algorithm can find an optimal flight trajectory with minimal delanalty for all users.
引用
收藏
页码:1991 / 2001
页数:11
相关论文
共 50 条
  • [31] Dinkelbach-Guided Deep Reinforcement Learning for Secure Communication in UAV-Aided MEC Networks
    Lu, Weidang
    Ding, Yu
    Feng, Yunqi
    Huang, Guoxing
    Zhao, Nan
    Nallanathan, Arumugam
    Yang, Xiaoniu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1740 - 1745
  • [32] Resource Allocation and Trajectory Design in UAV-Aided Cellular Networks Based on Multiagent Reinforcement Learning
    Yin, Sixing
    Yu, F. Richard
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (04) : 2933 - 2943
  • [33] Deep Reinforcement Learning Based Trajectory Design for Customized UAV-Aided NOMA Data Collection
    Zhang, Lei
    Zhang, Yuandi
    Lu, Jiawangnan
    Xiao, Yunfa
    Zhang, Guanglin
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2024, 13 (12) : 3365 - 3369
  • [34] A Network Slicing Framework for UAV-Aided Vehicular Networks
    Skondras, Emmanouil
    Michailidis, Emmanouel T.
    Michalas, Angelos
    Vergados, Dimitrios J.
    Miridakis, Nikolaos, I
    Vergados, Dimitrios D.
    DRONES, 2021, 5 (03)
  • [35] QoS-aware Reinforcement Learning based Green Trajectory Design for UAV-aided Backscattering
    Zhao, Ruotong
    Mondal, Abhishek
    Mishra, Deepak
    Seneviratne, Aruna
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 7303 - 7308
  • [36] A Reinforcement Learning Algorithm for Data Collection in UAV-aided IoT Networks with Uncertain Time Windows
    Cicek, Cihan Tugrul
    2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
  • [37] Secure UAV-Aided Mobile Edge Computing for IoT: A Review
    Michailidis, Emmanouel T.
    Maliatsos, Konstantinos
    Skoutas, Dimitrios N.
    Vouyioukas, Demosthenes
    Skianis, Charalabos
    IEEE ACCESS, 2022, 10 : 86353 - 86383
  • [38] UAV-Aided Decentralized Learning over Mesh Networks
    Zecchin, Matteo
    Gesbert, David
    Kountouris, Marios
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 702 - 706
  • [39] UAV-Aided Two-Way Mobile Relaying Systems
    Eom, Subin
    Lee, Hoon
    Park, Junhee
    Lee, Inkyu
    IEEE COMMUNICATIONS LETTERS, 2020, 24 (02) : 438 - 442
  • [40] Optimizing the Operation Cost for UAV-Aided Mobile Edge Computing
    Zhang, Liang
    Ansari, Nirwan
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (06) : 6085 - 6093