Cost-Efficient Computation Offloading in SAGIN: A Deep Reinforcement Learning and Perception-Aided Approach

被引:0
|
作者
Gao, Yulan [1 ]
Ye, Ziqiang [2 ]
Yu, Han [1 ]
机构
[1] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
[2] Univ Elect Sci & Technol China, Natl Key Lab Wireless Commun, Chengdu 611731, Peoples R China
基金
新加坡国家研究基金会;
关键词
Radar; Sensors; Resource management; Spaceborne radar; Visualization; Autonomous aerial vehicles; Space-air-ground integrated networks; Space-air-ground integrated network (SAGIN); deep reinforcement learning; perception; computation offloading; vision sensor; NETWORK LOCALIZATION; RADAR; DESIGN; COMMUNICATION; ALLOCATION; ALGORITHM; 5G;
D O I
10.1109/JSAC.2024.3459073
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The Space-Air-Ground Integrated Network (SAGIN), crucial to the advancement of sixth-generation (6G) technology, plays a key role in ensuring universal connectivity, particularly by addressing the communication needs of remote areas lacking cellular network infrastructure. This paper delves into the role of unmanned aerial vehicles (UAVs) within SAGIN, where they act as a control layer owing to their adaptable deployment capabilities and their intermediary role. Equipped with millimeter-wave (mmWave) radar and vision sensors, these UAVs are capable of acquiring multi-source data, which helps to diminish uncertainty and enhance the accuracy of decision-making. Concurrently, UAVs collect tasks requiring computing resources from their coverage areas, originating from a variety of mobile devices moving at different speeds. These tasks are then allocated to ground base stations (BSs), low-earth-orbit (LEO) satellite, and local processing units to improve processing efficiency. Amidst this framework, our study concentrates on devising dynamic strategies for facilitating task hosting between mobile devices and UAVs, offloading computations, managing associations between UAVs and BSs, and allocating computing resources. The objective is to minimize the time-averaged network cost, considering the uncertainty of device locations, speeds, and even types. To tackle these complexities, we propose a deep reinforcement learning and perception-aided online approach (DRL-and-Perception-aided Approach) for this joint optimization in SAGIN, tailored for an environment filled with uncertainties. The effectiveness of our proposed approach is validated through extensive numerical simulations, which quantify its performance relative to various network parameters.
引用
收藏
页码:3462 / 3476
页数:15
相关论文
共 50 条
  • [1] Cost-Efficient Computation Offloading in VEC Using Deep Reinforcement Learning Techniques
    Wang, Bingxin
    Tu, Dan
    Wang, Jie
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 296 - 300
  • [2] Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT
    Gong, Yongkang
    Wang, Jingjing
    Nie, Tianzheng
    2020 IEEE COMPUTING, COMMUNICATIONS AND IOT APPLICATIONS (COMCOMAP), 2021,
  • [3] Resilient Massive Access for SAGIN: A Deep Reinforcement Learning Approach
    Wang, Chaowei
    Pang, Mingliang
    Wu, Tong
    Gao, Feifei
    Zhao, Lingli
    Chen, Jiabin
    Wang, Wenyuan
    Wang, Dongming
    Zhang, Zhi
    Zhang, Ping
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2025, 43 (01) : 297 - 313
  • [4] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [5] A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing
    Wang, Qing
    Tan, Wenan
    Qin, Xiaofan
    HUMAN CENTERED COMPUTING, 2019, 11956 : 419 - 430
  • [6] Cost-efficient computation offloading in UAV-enabled edge computing
    Chen, Ying
    Chen, Shuang
    Wu, Bilian
    Chen, Xin
    IET COMMUNICATIONS, 2020, 14 (15) : 2462 - 2471
  • [7] Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zhou, Huan
    Zhang, Zhenyu
    Wu, Yuan
    Dong, Mianxiong
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (02): : 950 - 961
  • [8] Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach
    Shang, Ce
    Sun, Yan
    Luo, Hong
    Guizani, Mohsen
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15464 - 15476
  • [9] Deep reinforcement learning approach for computation offloading in blockchain-enabled communications systems
    Alam, Tanweer
    Ullah, Arif
    Benaida, Mohamed
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 14 (8) : 9959 - 9972
  • [10] Scalable Blockchain-empowered Distributed Computation Offloading: A Deep Reinforcement Learning Approach
    Xu, Feng
    Zhao, Zitong
    Liu, Lei
    Yuan, Xiaoming
    Pei, Qingqi
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,