Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

被引:5
|
作者
Habib, Md Arafat [1 ]
Zhou, Hao [1 ]
Iturria-Rivera, Pedro Enrique [1 ]
Elsayed, Medhat [2 ]
Bavand, Majid [2 ]
Gaigalas, Raimundas [2 ]
Furr, Steve [2 ]
Erol-Kantarci, Melike [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
[2] Ericsson Inc, Ottawa, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Multi-RAT; traffic steering; reinforcement learning;
D O I
10.1109/CCNC51644.2023.10060026
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In 5G non-standalone mode, traffic steering is a critical technique to take full advantage of 5G new radio while optimizing dual connectivity of 5G and LTE networks in multiple radio access technology (RAT). An intelligent traffic steering mechanism can play an important role to maintain seamless user experience by choosing appropriate RAT (5G or LTE) dynamically for a specific user traffic flow with certain QoS requirements. In this paper, we propose a novel traffic steering mechanism based on Deep Q-learning that can automate traffic steering decisions in a dynamic environment having multiple RATs, and maintain diverse QoS requirements for different traffic classes. The proposed method is compared with two baseline algorithms: a heuristic-based algorithm and Q-learning-based traffic steering. Compared to the Q-learning and heuristic baselines, our results show that the proposed algorithm achieves better performance in terms of 6% and 10% higher average system throughput, and 23% and 33% lower network delay, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments
    Habib, Md Arafat
    Zhou, Hao
    Iturria-Rivera, Pedro Enrique
    Elsayed, Medhat
    Bavand, Majid
    Gaigalas, Raimundas
    Ozcan, Yigit
    Erol-Kantarci, Melike
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 100 - 105
  • [2] 5G Multi-RAT URLLC and eMBB Dynamic Task Offloading With MEC Resource Allocation Using Distributed Deep Reinforcement Learning
    Yun, Jusik
    Goh, Yunyeong
    Yoo, Wonsuk
    Chung, Jong-Moon
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20) : 20733 - 20749
  • [3] Enhanced Multi-RAT Support for 5G
    Nanjundappa, Arjun
    Singh, Sukhdeep
    Jain, Gaurav
    2018 15TH IEEE ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2018,
  • [4] Traffic Steering and Network Selection in 5G Networks based on Reinforcement Learning
    Priscoli, Francesco Delli
    Giuseppi, Alessandro
    Liberati, Francesco
    Pietrabissa, Antonio
    2020 EUROPEAN CONTROL CONFERENCE (ECC 2020), 2020, : 595 - 601
  • [5] 5G Multi-RAT Multi-Connectivity Architecture
    Chandrashekar, Subramanya
    Maeder, Andreas
    Sartori, Cinzia
    Hohne, Thomas
    Vejlgaard, Benny
    Chandramouli, Devaki
    2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC), 2016, : 180 - 186
  • [6] 5G Multi-RAT Integration Evaluations Using a Common PDCP Layer
    Kilinc, Caner
    Ericson, Marten
    Rugeland, Patrik
    Da Silva, Icaro
    Zaidi, Ali
    Aydin, Osman
    Venkatasubramanian, Venkatkumar
    Filippou, Miltiades C.
    Mezzavilla, Marco
    Kuruvatti, Nandish
    Monserrat, Jose F.
    2017 IEEE 85TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2017,
  • [7] Fast-RAT Scheduling in a 5G Multi-RAT Scenario
    Monteiro, Victor Farias
    Ericson, Marten
    Cavalcanti, Francisco Rodrigo P.
    IEEE COMMUNICATIONS MAGAZINE, 2017, 55 (06) : 79 - 85
  • [8] The Energy Footprint of 5G Multi-RAT Cellular Architectures
    Klapez, Martin
    Grazia, Carlo Augusto
    Casoni, Maurizio
    IEEE ACCESS, 2021, 9 : 144493 - 144504
  • [9] Distributed RRM for 5G Multi-RAT Multiconnectivity Networks
    Monteiro, Victor Farias
    Sousa, Diego Aguiar
    Maciel, Tarcisio Ferreira
    Porto Cavalcanti, Francisco Rodrigo
    e Silva, Carlos F. M.
    Rodrigues, Emanuel Bezerra
    IEEE SYSTEMS JOURNAL, 2019, 13 (01): : 192 - 203
  • [10] Machine learning approach of multi-RAT selection for travelling users in 5G NSA networks
    Salau, Nurudeen O.
    Manzoor, Sanaullah
    Shakir, Muhammad Z.
    IET NETWORKS, 2024,