Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach

被引:0
|
作者
Nie, Yiwen [1 ]
Zhao, Junhui [1 ,2 ]
Liu, Jun [3 ,4 ]
Jiang, Jing [5 ]
Ding, Ruijin [6 ,7 ,8 ]
机构
[1] Beijing Jioatong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[3] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing 100084, Peoples R China
[4] Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
[5] Xian Univ Posts & Telecommun, Shaanxi Key Lab Informat Commun Network & Secur, Xian 710121, Peoples R China
[6] Tsinghua Univ THUAI, Inst Artificial Intelligence, Beijing 100084, Peoples R China
[7] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[8] Tsinghua Univ, Beijing Natl Res Ctr Infonnat Sci & Technol BNRis, Dept Automat, Beijing 100084, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
unmanned aerial vehicle (UAV); trajectory design; backscatter communication; deep reinforcement learning; energy-efficient; RESOURCE-ALLOCATION; OPTIMIZATION; PARADIGM; INTERNET; IOT; 5G;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, backscatter communication (BC) has been introduced as a green paradigm for Internet of Things (IoT). Meanwhile, unmanned aerial vehicles (UAVs) can serve as aerial base stations (BSs) to enhance the performance of BC system thanks to their high mobility and flexibility. In this paper, we investigate the problem of energy efficiency (EE) for an energy-limited backscatter communication (BC) network, where backscatter devices (BDs) on the ground harvest energy from the wireless signal of a flying rotary-wing quadrotor. Specifically, we first reformulate the EE optimization problem as a Markov decision process (MDP) and then propose a deep reinforcement learning (DRL) algorithm to design the UAV trajectory with the constraints of the BD scheduling, the power reflection coefficients, the transmission power, and the fairness among BDs. Simulation results show the proposed DRL algorithm achieves close-to-optimal performance and significant EE gains compared to the benchmark schemes.
引用
收藏
页码:129 / 141
页数:13
相关论文
共 50 条
  • [31] Energy-Efficient UAV Communication with Multiple GTs Based on Trajectory Optimization
    Xu, Yu
    Xiao, Lin
    Yang, Dingcheng
    Cuthbert, Laurie
    Wang, Yapeng
    MOBILE INFORMATION SYSTEMS, 2018, 2018
  • [32] Energy-Efficient Trajectory Planning for UAV-Aided Secure Communication
    Wang, Qian
    Chen, Zhi
    Li, Hang
    CHINA COMMUNICATIONS, 2018, 15 (05) : 51 - 60
  • [33] Energy-Efficient Trajectory Planning for UAV-Aided Secure Communication
    Qian Wang
    Zhi Chen
    Hang Li
    中国通信, 2018, 15 (05) : 51 - 60
  • [34] Fast Reinforcement Learning for Energy-Efficient Wireless Communication
    Mastronarde, Nicholas
    van der Schaar, Mihaela
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (12) : 6262 - 6266
  • [35] A Deep Reinforcement Learning Approach for Federated Learning Optimization with UAV Trajectory Planning
    Zhang, Chunyu
    Liu, Yiming
    Zhang, Zhi
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [36] Deep Reinforcement Learning Approach for Joint Trajectory Design in Multi-UAV IoT Networks
    Xu, Shu
    Zhan, Xiangyu
    Li, Chunguo
    Wang, Dongming
    Yang, Luxi
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) : 3389 - 3394
  • [37] Cellular-Connected UAV Trajectory Design With Connectivity Constraint: A Deep Reinforcement Learning Approach
    Gao, Yunfei
    Xiao, Lin
    Wu, Fahui
    Yang, Dingcheng
    Sun, Zhongxiang
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2021, 5 (03): : 1369 - 1380
  • [38] Deep Reinforcement Learning for Trajectory Design and Power Allocation in UAV Networks
    Zhao, Nan
    Cheng, Yiqiang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [39] Energy-efficient trajectory planning for a class of industrial robots using parallel deep reinforcement learning
    Wang, Xiaolong
    Cao, Jianfu
    Cao, Ye
    Zou, Feng
    NONLINEAR DYNAMICS, 2025, 113 (08) : 8491 - 8511
  • [40] Deep Reinforcement Learning Aided Trajectory and Power Control for Secure UAV Communication
    Wang, Zhijian
    Su, Gongchao
    Chen, Bin
    Dai, Mingjun
    Lin, Xiaohui
    PROCEEDINGS OF THE 2024 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATION AND SENSOR NETWORKS, ICWCSN 2024, 2024, : 74 - 79