Deep Reinforcement Learning-based Edge Caching for Industrial Control Applications

被引:0
|
作者
Zhang, Lei [1 ]
Xu, Hao [1 ]
Wang Guilin [2 ]
Yan, Wang [3 ]
Wang, Xiaojun [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Internet Things, Nanjing, Peoples R China
[2] PipeChina West East Gas Pipeline Co, Shanghai, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
industrial applications; edge cache; Deep Q-Network;
D O I
10.1109/CCDC58219.2023.10327657
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To enhance the quality of service for field users in industrial control applications, a suitable caching strategy at edge servers is essential. This paper proposes a cache replacement strategy based on deep reinforcement learning. Status space, action space and reward function are defined considering the varying real-time requirements of the application files. The performance of the proposed algorithm is compared with baseline algorithms using user requests with dynamic popularities. The experimental results demonstrate that the proposed algorithm can effectively enhance the hit rate of control files while maintaining the overall cache hit rate, without sacrificing performance.
引用
收藏
页码:5024 / 5029
页数:6
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-Based Edge Caching in Wireless Networks
    Zhong, Chen
    Gursoy, M. Cenk
    Velipasalar, Senem
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (01) : 48 - 61
  • [2] Deep Reinforcement Learning-Based Edge Caching in Heterogeneous Networks
    Choi, Yoonjeong
    Lim, Yujin
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2022, 18 (06): : 803 - 812
  • [3] Deep Reinforcement Learning-Based Edge Caching in Single-Cell Wireless Networks
    Wu, Rong
    Li, Qiang
    Ge, Xiaohu
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 298 - 303
  • [4] A Deep Reinforcement Learning-Based Framework for Content Caching
    Zhong, Chen
    Gursoy, M. Cenk
    Velipasalar, Senem
    2018 52ND ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2018,
  • [5] Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing
    Xie, Mande
    Ye, Jiefeng
    Zhang, Guoping
    Ni, Xueping
    COMPUTER NETWORKS, 2024, 250
  • [6] Deep Learning-based Predictive Caching in the Edge of a Network
    Rahman, Saidur
    Alam, Md. Golam Rabiul
    Rahman, Md. Mahbubur
    2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 797 - 801
  • [7] A Deep Reinforcement Learning-Based Caching Strategy for Internet of Things
    Nasehzadeh, Ali
    Wang, Ping
    2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 969 - 974
  • [8] Deep Reinforcement Learning-based Joint Caching and Computing Edge Service Placement for Sensing-Data-Driven IIoT Applications
    Chen, Yan
    Sun, Yanjing
    Yang, Bin
    Taleb, Tarik
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 4287 - 4292
  • [9] Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network
    Qian, Yichen
    Wang, Rui
    Wu, Jun
    Tan, Bin
    Ren, Haoqi
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (10) : 2343 - 2355
  • [10] Recursive deep reinforcement learning-based collaborative caching relay algorithm in mobile vehicular edge network
    Wu, Honghai
    Wang, Baibing
    Ma, Huahong
    Xing, Ling
    Tongxin Xuebao/Journal on Communications, 2024, 45 (11): : 277 - 286