Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

被引:21
|
作者
Khan, Israr [1 ]
Tao, Xiaofeng [1 ]
Rahman, G. M. Shafiqur [2 ]
Rehman, Waheed Ur [1 ,3 ]
Salam, Tabinda [1 ,4 ]
机构
[1] Beijing Univ Posts & Telecommun, Natl Engn Lab Mobile Network Technol, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Key Lab Universal Wireless Commun, Minist Educ, Beijing 100876, Peoples R China
[3] Univ Peshawar, Dept Comp Sci, Peshawar 25120, Pakistan
[4] Shaheed Benazir Bhutto Women Univ, Dept Comp Sci, Peshawar 25000, Pakistan
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Machine type communication; mobile edge computing; computation offloading; deep reinforcement learning; energy efficiency; RESOURCE-ALLOCATION; 5G; INTERNET; ARCHITECTURE; CHALLENGES; VEHICLES;
D O I
10.1109/ACCESS.2020.2991057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) supports the internet of things (IoT) by leveraging computation offloading. It minimizes the delay and consequently reduces the energy consumption of the IoT devices. However, the consideration of static communication mode in most of the recent work, despite varying network dynamics and resource diversity, is the main limitation. An energy-efficient computation offloading method using deep reinforcement learning (DRL) is proposed. Both delay-tolerant and non-delay tolerant scenarios are considered using capillary machine type communication (MTC). Depending upon the type of service, an intelligent MTC edge server using DRL decides either process the incoming request at the MTC edge server or sends it to the cloud server. To control communication, we draft a markov decision problem (MDP). This minimizes the long-term power consumption of the system. The formulation of the optimization problem is considered under the constraint of computing power resources and delays. Simulation results delineate the significant performance gain of 12 & x0025; in computation offloading through the proposed DRL approach. The effectiveness and superiority of the proposed model are compared with other baselines and are demonstrated numerically.
引用
收藏
页码:82867 / 82875
页数:9
相关论文
共 50 条
  • [11] Discontinuous Computation Offloading for Energy-Efficient Mobile Edge Computing
    Merluzzi, Mattia
    di Pietro, Nicola
    Di Lorenzo, Paolo
    Strinati, Emilio Calvanese
    Barbarossa, Sergio
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2022, 6 (02): : 1242 - 1257
  • [12] Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zhou, Huan
    Zhang, Zhenyu
    Wu, Yuan
    Dong, Mianxiong
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (02): : 950 - 961
  • [13] Computation offloading Optimization in Edge Computing based on Deep Reinforcement Learning
    Zhu Qinghua
    Chang Ying
    Zhao Jingya
    Liu Yong
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1552 - 1558
  • [14] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    COMPUTER COMMUNICATIONS, 2021, 175 (175) : 1 - 12
  • [15] Energy-efficient collaborative task offloading in multi-access edge computing based on deep reinforcement learning
    Wang, Shudong
    Zhao, Shengzhe
    Gui, Haiyuan
    He, Xiao
    Lu, Zhi
    Chen, Baoyun
    Fan, Zixuan
    Pang, Shanchen
    AD HOC NETWORKS, 2025, 169
  • [16] Multi-Agent Deep Reinforcement Learning for Efficient Computation Offloading in Mobile Edge Computing
    Jiao, Tianzhe
    Feng, Xiaoyue
    Guo, Chaopeng
    Wang, Dongqi
    Song, Jie
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (03): : 3585 - 3603
  • [17] Energy-efficient computation offloading strategy with tasks scheduling in edge computing
    Zhang, Yue
    Fu, Jingqi
    WIRELESS NETWORKS, 2021, 27 (01) : 609 - 620
  • [18] Energy-efficient computation offloading strategy with tasks scheduling in edge computing
    Yue Zhang
    Jingqi Fu
    Wireless Networks, 2021, 27 : 609 - 620
  • [19] Energy-Efficient Computation Peer Offloading in Satellite Edge Computing Networks
    Zhang, Xinyuan
    Liu, Jiang
    Zhang, Ran
    Huang, Yudong
    Tong, Jincheng
    Xin, Ning
    Liu, Liang
    Xiong, Zehui
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) : 3077 - 3091
  • [20] Energy-Efficient Computation Offloading in Mobile Edge Computing Systems With Uncertainties
    Ji, Tianxi
    Luo, Changqing
    Yu, Lixing
    Wang, Qianlong
    Chen, Siheng
    Thapa, Arun
    Li, Pan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) : 5717 - 5729