Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

被引:5
|
作者
Habib, Md Arafat [1 ]
Zhou, Hao [1 ]
Iturria-Rivera, Pedro Enrique [1 ]
Elsayed, Medhat [2 ]
Bavand, Majid [2 ]
Gaigalas, Raimundas [2 ]
Furr, Steve [2 ]
Erol-Kantarci, Melike [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
[2] Ericsson Inc, Ottawa, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Multi-RAT; traffic steering; reinforcement learning;
D O I
10.1109/CCNC51644.2023.10060026
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In 5G non-standalone mode, traffic steering is a critical technique to take full advantage of 5G new radio while optimizing dual connectivity of 5G and LTE networks in multiple radio access technology (RAT). An intelligent traffic steering mechanism can play an important role to maintain seamless user experience by choosing appropriate RAT (5G or LTE) dynamically for a specific user traffic flow with certain QoS requirements. In this paper, we propose a novel traffic steering mechanism based on Deep Q-learning that can automate traffic steering decisions in a dynamic environment having multiple RATs, and maintain diverse QoS requirements for different traffic classes. The proposed method is compared with two baseline algorithms: a heuristic-based algorithm and Q-learning-based traffic steering. Compared to the Q-learning and heuristic baselines, our results show that the proposed algorithm achieves better performance in terms of 6% and 10% higher average system throughput, and 23% and 33% lower network delay, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Multi-objective Resource Allocation for 5G Using Hierarchical Reinforcement Learning
    Akyildiz, Hasan Anil
    Gemici, Omer Faruk
    Hokelek, Ibrahim
    Cirpan, Hakan Ali
    2022 IEEE INTERNATIONAL BLACK SEA CONFERENCE ON COMMUNICATIONS AND NETWORKING (BLACKSEACOM), 2022, : 202 - 207
  • [42] Energy Efficient Traffic Offloading in Multi-Tier Heterogeneous 5G Networks Using Intuitive Online Reinforcement Learning
    AlQerm, Ismail
    Shihada, Basem
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2019, 3 (03): : 691 - 702
  • [43] Open5G: A Software-Defined Networking Protocol for 5G Multi-RAT Wireless Networks
    Taksande, Pradnya Kiri
    Jha, Pranav
    Karandikar, Abhay
    Chaporkar, Prasanna
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2020,
  • [44] Satellite Integration into 5G: Deep Reinforcement Learning for Network Selection
    De Santis, Emanuele
    Giuseppi, Alessandro
    Pietrabissa, Antonio
    Capponi, Michael
    Priscoli, Francesco Delli
    MACHINE INTELLIGENCE RESEARCH, 2022, 19 (02) : 127 - 137
  • [45] Satellite Integration into 5G: Deep Reinforcement Learning for Network Selection
    Emanuele De Santis
    Alessandro Giuseppi
    Antonio Pietrabissa
    Michael Capponi
    Francesco Delli Priscoli
    Machine Intelligence Research, 2022, 19 : 127 - 137
  • [46] Satellite Integration into 5G:Deep Reinforcement Learning for Network Selection
    Emanuele De Santis
    Alessandro Giuseppi
    Antonio Pietrabissa
    Michael Capponi
    Francesco Delli Priscoli
    Machine Intelligence Research, 2022, (02) : 127 - 137
  • [47] Blockchain and Deep Reinforcement Learning Empowered Intelligent 5G Beyond
    Dai, Yueyue
    Xu, Du
    Maharjan, Sabita
    Chen, Zhuang
    He, Qian
    Zhang, Yan
    IEEE NETWORK, 2019, 33 (03): : 10 - 17
  • [48] On using Deep Reinforcement Learning to dynamically derive 5G New Radio TDD pattern
    Bagaa, Miloud
    Boutiba, Karim
    Ksentini, Adlen
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [49] Distributed Beam Scheduling for Multi-RAT Coexistence in mm-Wave 5G Networks
    Nekovee, Maziar
    Qi, Yinan
    Wang, Yue
    2016 IEEE 27TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2016, : 363 - 368
  • [50] Joint resource allocation for emotional 5G IoT systems using deep reinforcement learning
    Ziyan Yang
    Haibo Mei
    Wenyong Wang
    Dongdai Zhou
    Kun Yang
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 3517 - 3528