Reinforcement learning for call admission control and routing under quality of service constraints in multimedia networks

被引:15
|
作者
Tong, H [1 ]
Brown, TX [1 ]
机构
[1] Univ Colorado, Boulder, CO 80309 USA
基金
美国国家科学基金会;
关键词
reinforcement learning; call admission control; routing; quality of service; multimedia networks;
D O I
10.1023/A:1017924227920
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we solve the call admission control and routing problem in multimedia networks via reinforcement learning (RL). The problem requires that network revenue be maximized while simultaneously meeting quality of service constraints that forbid entry into certain states and use of certain actions. The problem can be formulated as a constrained semi-Markov decision process. We show that RL provides a solution to this problem and is able to earn significantly higher revenues than alternative heuristics.
引用
收藏
页码:111 / 139
页数:29
相关论文
共 50 条
  • [11] New Localized Call Admission Control Algorithms in Communication Networks with Quality of Service Constraints
    Mohammad, Abdulbaset H.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2010, 10 (11): : 125 - 131
  • [12] Using the Reinforcement Learning Scheme to the Priority-Based Routing and Call Admission Control in WDM Networks
    Chang, Ching-Lung
    Kang, Siao-Ji
    JOURNAL OF INTERNET TECHNOLOGY, 2012, 13 (05): : 793 - 801
  • [13] Call admission control for multimedia CDMA networks under imperfect power control
    Bo, XM
    Chen, ZJ
    ADVANCED PARALLEL PROCESSING TECHNOLOGIES, PROCEEDINGS, 2003, 2834 : 467 - 477
  • [14] Call admission control in wireless multimedia networks
    Rao, RM
    Comaniciu, C
    Lakshman, TV
    Poor, HV
    IEEE SIGNAL PROCESSING MAGAZINE, 2004, 21 (05) : 51 - 58
  • [15] Call admission control in wireless multimedia networks
    Bartolini, N
    Chlamtac, I
    13TH IEEE INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, VOL 1-5, PROCEEDINGS: SAILING THE WAVES OF THE WIRELESS OCEANS, 2002, : 285 - 289
  • [16] A learning approach for call admission control with prioritized handoff in mobile multimedia networks
    El-Alfy, ES
    Yao, YD
    Heffes, H
    IEEE VTC 53RD VEHICULAR TECHNOLOGY CONFERENCE, SPRING 2001, VOLS 1-4, PROCEEDINGS, 2001, : 972 - 976
  • [17] Call admission and control for quality-of-service provisioning in cellular networks
    Das, SK
    Sen, SK
    Jayaram, R
    1997 IEEE 6TH INTERNATIONAL CONFERENCE ON UNIVERSAL PERSONAL COMMUNICATIONS RECORD, CONFERENCE RECORD, VOLS 1 AND 2, 1997, : 109 - 113
  • [18] A reinforcement learning approach for admission control in mobile multimedia networks with predictive information
    Gimenez-Guzman, Jose Manuel
    Martinez-Bauset, Jorge
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2007, E90B (07) : 1663 - 1673
  • [19] Call admission control in OFDM wireless multimedia networks
    Zhang, Yan
    2008 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, PROCEEDINGS, VOLS 1-13, 2008, : 4154 - 4159
  • [20] Admission control for multicast routing with quality of service in ad hoc networks
    Bür, K
    Ersoy, C
    COMPUTER AND INFORMATION SCIENCES - ISCIS 2005, PROCEEDINGS, 2005, 3733 : 44 - 53