Reinforcement learning for call admission control and routing under quality of service constraints in multimedia networks

被引:15
|
作者
Tong, H [1 ]
Brown, TX [1 ]
机构
[1] Univ Colorado, Boulder, CO 80309 USA
基金
美国国家科学基金会;
关键词
reinforcement learning; call admission control; routing; quality of service; multimedia networks;
D O I
10.1023/A:1017924227920
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we solve the call admission control and routing problem in multimedia networks via reinforcement learning (RL). The problem requires that network revenue be maximized while simultaneously meeting quality of service constraints that forbid entry into certain states and use of certain actions. The problem can be formulated as a constrained semi-Markov decision process. We show that RL provides a solution to this problem and is able to earn significantly higher revenues than alternative heuristics.
引用
收藏
页码:111 / 139
页数:29
相关论文
共 50 条
  • [1] Reinforcement Learning for Call Admission Control and Routing under Quality of Service Constraints in Multimedia Networks
    Hui Tong
    Timothy X Brown
    Machine Learning, 2002, 49 : 111 - 139
  • [2] Adaptive call admission control under quality of service constraints: A reinforcement learning solution
    Tong, H
    Brown, TX
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2000, 18 (02) : 209 - 221
  • [3] Reinforcement learning for call admission control and routing in integrated service networks
    Marbach, P
    Mihatsch, O
    Schulte, M
    Tsitsiklis, JN
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 10, 1998, 10 : 922 - 928
  • [4] Optimizing admission control while ensuring quality of service in multimedia networks via reinforcement learning
    Brown, TX
    Tong, H
    Singh, S
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 11, 1999, 11 : 982 - 988
  • [5] Call admission control and routing in integrated services networks using reinforcement learning
    Marbach, P
    Mihatsch, O
    Tsitsiklis, JN
    PROCEEDINGS OF THE 37TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 1998, : 563 - 568
  • [6] An Improved Call Admission Control Scheme Based on Reinforcement Learning for Multimedia Wireless Networks
    Chen, Yueyun
    Jia, Cuixia
    PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE ON WIRELESS NETWORKS AND INFORMATION SYSTEMS, 2009, : 322 - 325
  • [7] Quality of service and call admission control for adaptive multimedia services in wireless/mobile networks
    Xiao, Y
    Chen, CLP
    Wang, Y
    PROCEEDINGS OF THE IEEE 2000 NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE: ENGINEERING TOMORROW, 2000, : 214 - 220
  • [8] Admission control for wireless multimedia networks with hard call level quality of service bounds
    Misic, J
    Chanson, ST
    Lai, FS
    COMPUTER NETWORKS-THE INTERNATIONAL JOURNAL OF COMPUTER AND TELECOMMUNICATIONS NETWORKING, 1999, 31 (1-2): : 125 - 140
  • [9] Reinforcement-learning-based call admission control and bandwidth adaptation in mobile multimedia networks
    Yu, F
    Wong, VWS
    Leung, VCM
    ICICS-PCM 2003, VOLS 1-3, PROCEEDINGS, 2003, : 139 - 143
  • [10] A learning approach for call admission control under QoS constraints in cellular networks
    Yang, Xu
    Bigham, John
    2006 10TH IEEE SINGAPORE INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS, VOLS 1 AND 2, 2006, : 187 - +