Safe-NORA: Safe Reinforcement Learning-based Mobile Network Resource Allocation for Diverse User Demands

被引:33
|
作者
Huang, Wenzhen [1 ]
Li, Tong [1 ]
Cao, Yuting [2 ]
Lyu, Zhe [2 ]
Liang, Yanping [2 ]
Yu, Li [2 ]
Jin, Depeng [1 ]
Zhang, Junge [3 ]
Li, Yong [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] China Mobile Res Inst, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Safe reinforcement learning; Multi-agent; Mobile networks; Resources allocation;
D O I
10.1145/3583780.3615043
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As mobile communication technologies advance, mobile networks become increasingly complex, and user requirements become increasingly diverse. To satisfy the diverse demands of users while improving the overall performance of the network system, the limited wireless network resources should be efficiently and dynamically allocated to them based on the magnitude of their demands and their relative location to the base stations. We separated the problem into four constrained subproblems, which we then solved using a safe reinforcement learning method. In addition, we design a reward mechanism to encourage agent cooperation in distributed training environments. We test our methodology in a simulated scenario with thousands of users and hundreds of base stations. According to experimental findings, our method guarantees that over 95% of user demands are satisfied while also maximizing the overall system throughput.
引用
收藏
页码:885 / 894
页数:10
相关论文
共 50 条
  • [1] Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation
    Massaro, Antonio
    Wellington, Dan
    Aghasaryan, Armen
    Seidl, Robert
    Naseer-Ul-Islam, Muhammad
    Bulakci, Oemer
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,
  • [2] Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning
    Brunke, Lukas
    Greeff, Melissa
    Hall, Adam W.
    Yuan, Zhaocong
    Zhou, Siqi
    Panerati, Jacopo
    Schoellig, Angela P.
    ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 5 : 411 - 444
  • [3] Reinforcement learning-based online resource allocation for edge computing network
    Li Y.-J.
    Jiang H.-T.
    Gao M.-H.
    Kongzhi yu Juece/Control and Decision, 2022, 37 (11): : 2880 - 2886
  • [4] Online Continual Safe Reinforcement Learning-based Optimal Control of Mobile Robot Formations
    Ganie, Irfan
    Jagannathan, S.
    2024 IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS, CCTA 2024, 2024, : 519 - 524
  • [5] Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network
    Chen, Xing
    Liu, Guizhong
    SENSORS, 2022, 22 (13)
  • [6] Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots
    Cao, Huanhui
    Xiong, Hao
    Zeng, Weifeng
    Jiang, Hantao
    Cai, Zhiyuan
    Hu, Liang
    Zhang, Lin
    Lu, Wenjie
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (05) : 4346 - 4363
  • [7] Improving User Experience via Reinforcement Learning-Based Resource Management on Mobile Devices
    Lu, Yufan
    Hu, Chuang
    Gong, Yili
    Cheng, Dazhao
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14863 : 383 - 395
  • [8] Deep Reinforcement Learning-Based Resource Allocation for Satellite Internet of Things with Diverse QoS Guarantee
    Tang, Siqi
    Pan, Zhisong
    Hu, Guyu
    Wu, Yang
    Li, Yunbo
    SENSORS, 2022, 22 (08)
  • [9] Deep Reinforcement Learning Based Resource Allocation for URLLC User-Centric Network
    Hu, Fajin
    Zhao, Junhui
    Liao, Jieyu
    Zhang, Huan
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 522 - 526
  • [10] Reinforcement Learning-Based User Scheduling and Resource Allocation for Massive MU-MIMO System
    Bu, Gaojing
    Jiang, Jing
    2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,