Deep Reinforcement Learning-Based Computation Offloading and Optimal Resource Allocation in Industrial Internet of Things with NOMA

被引:2
|
作者
Gao, Haofeng [1 ]
Guo, Xing [1 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
关键词
industrial Internet of Things(IIoT); Deep Reinforcement Learning(DRL); NOMA; Mobile edge computing(MEC); POWERED COMMUNICATION-NETWORKS; RATE MAXIMIZATION; WIRELESS;
D O I
10.1109/ICCCAS55266.2022.9825343
中图分类号
学科分类号
摘要
Multi-access mobile edge computing is considered as an important way to enable computationally intensive but latency-sensitive services in the future industrial IoT. In this paper, we consider a multi-access MEC network. Powered by WPT, each IID (IIoT devices) collects energy and then follows a binary offload policy, i.e., either executes the task locally or offloads to the MEC server for execution via a non-orthogonal multiple access (NOMA) approach. Where the channel gain from each IID (IoT device) to the edge computing server is time-varying. To address the goal of maximizing the total computation rate of all IIDs by jointly optimizing the selection of computation modes and the allocation of transmission time in dynamic channel scenarios, we propose a Deep Reinforcement Learning (DRL)-based computation offloading and resource allocation optimization method (DCOORA). The method is able to obtain near-optimal solutions under timevarying channels and, moreover, can solve the problem with very low computational complexity. Simulation results show that the hybrid framework based on online offloading of DRL obtains near-optimal computational performance for different network settings. In addition, it has very low computation time, which is particularly suitable for time-varying channel environments.
引用
收藏
页码:198 / 203
页数:6
相关论文
共 50 条
  • [1] Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things
    Lin, Lixia
    Zhou, Wen'an
    Yang, Zhicheng
    Liu, Jianlong
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2023, 16 (01) : 170 - 188
  • [2] Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things
    Lixia Lin
    Wen’an Zhou
    Zhicheng Yang
    Jianlong Liu
    Peer-to-Peer Networking and Applications, 2023, 16 : 170 - 188
  • [3] Multitask Multiobjective Deep Reinforcement Learning-Based Computation Offloading Method for Industrial Internet of Things
    Cai, Jun
    Fu, Hongtian
    Liu, Yan
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (02): : 1848 - 1859
  • [4] Joint Computation Offloading and Resource Allocation for NOMA-Enabled Industrial Internet of Things
    Zhou, Peng
    Yang, Bo
    Chen, Cailian
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 5241 - 5246
  • [5] Deep Reinforcement Learning Based Computation Offloading in Fog Enabled Industrial Internet of Things
    Ren, Yijing
    Sun, Yaohua
    Peng, Mugen
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4978 - 4987
  • [6] Deep reinforcement learning-based collaborative computation offloading and caching decision for internet of things
    Li, Jianxin
    Yuan, Ke
    Wang, Qian
    Chen, Siguang
    INTERNATIONAL JOURNAL OF EMBEDDED SYSTEMS, 2024, 17 (3-4)
  • [7] Dual-Q network deep reinforcement learning-based computation offloading method for industrial internet of things
    Du, Ruizhong
    Wu, Jinru
    Gao, Yan
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (17): : 25590 - 25615
  • [8] Deep Reinforcement Learning-Based Video Offloading and Resource Allocation in NOMA-Enabled Networks
    Gao, Siyu
    Wang, Yuchen
    Feng, Nan
    Wei, Zhongcheng
    Zhao, Jijun
    FUTURE INTERNET, 2023, 15 (05):
  • [9] Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach
    Shang, Ce
    Sun, Yan
    Luo, Hong
    Guizani, Mohsen
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15464 - 15476
  • [10] Deep learning for online computation offloading and resource allocation in NOMA
    Niu, Juncui
    Zhang, Shubin
    Chi, Kaikai
    Shen, Guanqun
    Gao, Wei
    COMPUTER NETWORKS, 2022, 216