Dynamic traffic steering based on fuzzy Q-Learning approach in a multi-RAT multi-layer wireless network

被引:12
|
作者
Munoz, P. [1 ]
Laselva, D. [2 ]
Barco, R. [1 ]
Mogensen, P. [2 ,3 ]
机构
[1] Univ Malaga, Dept Commun Engn, E-29071 Malaga, Spain
[2] Nokia Siemens Networks, Aalborg, Denmark
[3] Aalborg Univ, Aalborg, Denmark
关键词
Traffic steering; Q-Learning; Fuzzy logic controller; Handover; Heterogeneous networks; MULTISERVICE; OPTIMIZATION;
D O I
10.1016/j.comnet.2014.06.003
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The infrastructure of current cellular networks must evolve to cope with the increasing demand for mobile-broadband services. Heterogeneous networks are an attractive solution for operators to expand network capacity, based on deploying different Radio Access Technologies, cell sizes and carrier frequencies in the same environment. As a result, operators gain flexibility to distribute traffic across the different networks (or layers) in order to make a more efficient use of resources and enhance network performance. In this work, a dynamic traffic steering technique in multi-RAT multi-layer wireless networks is proposed. In particular, a fuzzy rule-based reinforcement learning algorithm modifies handover parameters according to a specific policy set by the operator, which typically searches for a trade-off between key performance indicators. Results show that the proposed optimization algorithm provides good flexibility to support different policies by simply adjusting some weighting factors. In addition, the Q-Learning algorithm is shown as an effective solution to adapt the network to context variations, such as those produced in the user spatial distribution. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:100 / 116
页数:17
相关论文
共 50 条
  • [1] Adjustment of mobility parameters for traffic steering in multi-RAT multi-layer wireless networks
    Munoz, Pablo
    Laselva, Daniela
    Barco, Raquel
    Mogensen, Preben
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2013,
  • [2] Adjustment of mobility parameters for traffic steering in multi-RAT multi-layer wireless networks
    Pablo Muñoz
    Daniela Laselva
    Raquel Barco
    Preben Mogensen
    EURASIP Journal on Wireless Communications and Networking, 2013
  • [3] Q-Learning Based Intelligent Traffic Steering in Heterogeneous Network
    Adachi, Koichi
    Li, Maodong
    Tan, Peng Hui
    Zhou, Yuan
    Sun, Sumei
    2016 IEEE 83RD VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2016,
  • [4] Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments
    Habib, Md Arafat
    Zhou, Hao
    Iturria-Rivera, Pedro Enrique
    Elsayed, Medhat
    Bavand, Majid
    Gaigalas, Raimundas
    Ozcan, Yigit
    Erol-Kantarci, Melike
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 100 - 105
  • [5] Research on Multi-layer Classification Method of Network Traffic Based on Machine Learning
    Wang, Bin
    2018 INTERNATIONAL SEMINAR ON COMPUTER SCIENCE AND ENGINEERING TECHNOLOGY (SCSET 2018), 2019, 1176
  • [6] Distributed Q-learning Controller for a Multi-Intersection Traffic Network
    Araghi, Sahar
    Khosravi, Abbas
    Creighton, Douglas
    NEURAL INFORMATION PROCESSING, PT I, 2015, 9489 : 337 - 344
  • [7] Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning
    Habib, Md Arafat
    Zhou, Hao
    Iturria-Rivera, Pedro Enrique
    Elsayed, Medhat
    Bavand, Majid
    Gaigalas, Raimundas
    Furr, Steve
    Erol-Kantarci, Melike
    2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [8] A multi-layer approach for advanced persistent threat detection using machine learning based on network traffic
    Cho Do Xuan
    Duc Duong
    Hoang Xuan Dau
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (06) : 11311 - 11329
  • [9] MULTI-LAYER WIRELESS NETWORK ARCHITECTURE
    Chan, Vincent W. S.
    IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (11) : 4 - 4
  • [10] Hierarchical correlated Q-learning for multi-layer optimal generation command dispatch
    Yu, T.
    Zhang, X. S.
    Zhou, B.
    Chan, K. W.
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2016, 78 : 1 - 12