Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

被引:21
|
作者
Khan, Israr [1 ]
Tao, Xiaofeng [1 ]
Rahman, G. M. Shafiqur [2 ]
Rehman, Waheed Ur [1 ,3 ]
Salam, Tabinda [1 ,4 ]
机构
[1] Beijing Univ Posts & Telecommun, Natl Engn Lab Mobile Network Technol, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Key Lab Universal Wireless Commun, Minist Educ, Beijing 100876, Peoples R China
[3] Univ Peshawar, Dept Comp Sci, Peshawar 25120, Pakistan
[4] Shaheed Benazir Bhutto Women Univ, Dept Comp Sci, Peshawar 25000, Pakistan
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Machine type communication; mobile edge computing; computation offloading; deep reinforcement learning; energy efficiency; RESOURCE-ALLOCATION; 5G; INTERNET; ARCHITECTURE; CHALLENGES; VEHICLES;
D O I
10.1109/ACCESS.2020.2991057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) supports the internet of things (IoT) by leveraging computation offloading. It minimizes the delay and consequently reduces the energy consumption of the IoT devices. However, the consideration of static communication mode in most of the recent work, despite varying network dynamics and resource diversity, is the main limitation. An energy-efficient computation offloading method using deep reinforcement learning (DRL) is proposed. Both delay-tolerant and non-delay tolerant scenarios are considered using capillary machine type communication (MTC). Depending upon the type of service, an intelligent MTC edge server using DRL decides either process the incoming request at the MTC edge server or sends it to the cloud server. To control communication, we draft a markov decision problem (MDP). This minimizes the long-term power consumption of the system. The formulation of the optimization problem is considered under the constraint of computing power resources and delays. Simulation results delineate the significant performance gain of 12 & x0025; in computation offloading through the proposed DRL approach. The effectiveness and superiority of the proposed model are compared with other baselines and are demonstrated numerically.
引用
收藏
页码:82867 / 82875
页数:9
相关论文
共 50 条
  • [21] Deep Reinforcement Learning for Energy-Efficient Task Offloading in Cooperative Vehicular Edge Networks
    Agbaje, Paul
    Nwafor, Ebelechukwu
    Olufowobi, Habeeb
    2023 IEEE 21ST INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS, INDIN, 2023,
  • [22] A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing
    Jiang, Kai
    Zhou, Huan
    Li, Dawei
    Liu, Xuxun
    Xu, Shouzhi
    2020 29TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN 2020), 2020,
  • [23] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [24] Deep reinforcement learning for the computation offloading in MIMO-based Edge Computing
    Sadiki, Abdeladim
    Bentahar, Jamal
    Dssouli, Rachida
    En-Nouaary, Abdeslam
    Otrok, Hadi
    AD HOC NETWORKS, 2023, 141
  • [25] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [26] A Distributed Computation Offloading Strategy for Edge Computing Based on Deep Reinforcement Learning
    Lai, Hongyang
    Yang, Zhuocheng
    Li, Jinhao
    Wu, Celimuge
    Bao, Wugedele
    MOBILE NETWORKS AND MANAGEMENT, MONAMI 2021, 2022, 418 : 73 - 86
  • [27] A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing
    Wang, Qing
    Tan, Wenan
    Qin, Xiaofan
    HUMAN CENTERED COMPUTING, 2019, 11956 : 419 - 430
  • [28] Hierarchical Multi-Agent Deep Reinforcement Learning for Energy-Efficient Hybrid Computation Offloading
    Zhou, Hang
    Long, Yusi
    Gong, Shimin
    Zhu, Kun
    Hoang, Dinh Thai
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (01) : 986 - 1001
  • [29] Energy-Efficient Heuristic Computation Offloading With Delay Constraints in Mobile Edge Computing
    Mei, Jing
    Tong, Zhao
    Li, Kenli
    Zhang, Lianming
    Li, Keqin
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (06) : 4404 - 4417
  • [30] Deep Reinforcement Learning Based Energy-efficient Task Offloading for Secondary Mobile Edge Systems
    Zhang, Xiaojie
    Pal, Amitangshu
    Debroy, Saptarshi
    2020 IEEE 45TH LOCAL COMPUTER NETWORKS SYMPOSIUM ON EMERGING TOPICS IN NETWORKING (LCN SYMPOSIUM 2020), 2020, : 48 - 59