Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach

被引:0
|
作者
Nie, Yiwen [1 ]
Zhao, Junhui [1 ,2 ]
Liu, Jun [3 ,4 ]
Jiang, Jing [5 ]
Ding, Ruijin [6 ,7 ,8 ]
机构
[1] Beijing Jioatong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[3] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing 100084, Peoples R China
[4] Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
[5] Xian Univ Posts & Telecommun, Shaanxi Key Lab Informat Commun Network & Secur, Xian 710121, Peoples R China
[6] Tsinghua Univ THUAI, Inst Artificial Intelligence, Beijing 100084, Peoples R China
[7] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[8] Tsinghua Univ, Beijing Natl Res Ctr Infonnat Sci & Technol BNRis, Dept Automat, Beijing 100084, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
unmanned aerial vehicle (UAV); trajectory design; backscatter communication; deep reinforcement learning; energy-efficient; RESOURCE-ALLOCATION; OPTIMIZATION; PARADIGM; INTERNET; IOT; 5G;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, backscatter communication (BC) has been introduced as a green paradigm for Internet of Things (IoT). Meanwhile, unmanned aerial vehicles (UAVs) can serve as aerial base stations (BSs) to enhance the performance of BC system thanks to their high mobility and flexibility. In this paper, we investigate the problem of energy efficiency (EE) for an energy-limited backscatter communication (BC) network, where backscatter devices (BDs) on the ground harvest energy from the wireless signal of a flying rotary-wing quadrotor. Specifically, we first reformulate the EE optimization problem as a Markov decision process (MDP) and then propose a deep reinforcement learning (DRL) algorithm to design the UAV trajectory with the constraints of the BD scheduling, the power reflection coefficients, the transmission power, and the fairness among BDs. Simulation results show the proposed DRL algorithm achieves close-to-optimal performance and significant EE gains compared to the benchmark schemes.
引用
收藏
页码:129 / 141
页数:13
相关论文
共 50 条
  • [21] Trajectory Design and Generalization for UAV Enabled Networks:A Deep Reinforcement Learning Approach
    Li, Xuan
    Wang, Qiang
    Liu, Jie
    Zhang, Wenqi
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [22] Energy-Efficient Trajectory Design for UAV-Enabled Communication Under Malicious Jamming
    Wu, Yang
    Yang, Weiwei
    Guan, Xinrong
    Wu, Qingqing
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (02) : 206 - 210
  • [23] Joint Trajectory and Resource Allocation Design for Energy-Efficient Secure UAV Communication Systems
    Cai, Yuanxin
    Wei, Zhiqiang
    Li, Ruide
    Ng, Derrick Wing Kwan
    Yuan, Jinhong
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (07) : 4536 - 4553
  • [24] Energy-efficient UAV-enabled computation offloading for industrial internet of things: a deep reinforcement learning approach
    Shi, Shuo
    Wang, Meng
    Gu, Shushi
    Zheng, Zhong
    WIRELESS NETWORKS, 2024, 30 (05) : 3921 - 3934
  • [25] Trajectory Design for UAV-Based Inspection System: A Deep Reinforcement Learning Approach
    Zhang, Wei
    Yang, Dingcheng
    Wu, Fahui
    Xiao, Lin
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 1654 - 1659
  • [26] Trajectory Design in UAV-Aided Mobile Crowdsensing: A Deep Reinforcement Learning Approach
    Tao, Xi
    Hafid, Abdelhakim Senhaji
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [27] Distributed Energy-Efficient Multi-UAV Navigation for Long-Term Communication Coverage by Deep Reinforcement Learning
    Liu, Chi Harold
    Ma, Xiaoxin
    Gao, Xudong
    Tang, Jian
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (06) : 1274 - 1285
  • [28] Energy- and Cost-Efficient Transmission Strategy for UAV Trajectory Tracking Control: A Deep Reinforcement Learning Approach
    Zhang, Minkai
    Wu, Shaohua
    Jiao, Jian
    Zhang, Ning
    Zhang, Qinyu
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (10) : 8958 - 8970
  • [29] 3D Trajectory Optimization for Energy-Efficient UAV Communication: A Control Design Perspective
    Li, Bin
    Li, Qingliang
    Zeng, Yong
    Rong, Yue
    Zhang, Rui
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 4579 - 4593
  • [30] Deep Reinforcement Learning for Energy-Efficient Federated Learning in UAV-Enabled Wireless Powered Networks
    Quang Vinh Do
    Quoc-Viet Pham
    Hwang, Won-Joo
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (01) : 99 - 103