Server Frequency Control Using Markov Decision Processes

被引:4
|
作者
Chen, Lydia Y. [1 ]
Gautam, Natarajan [2 ]
机构
[1] IBM Zurich Res Lab, Zurich, Switzerland
[2] Texas A&M Univ, College Stn, TX 77843 USA
关键词
D O I
10.1109/INFCOM.2009.5062265
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
For a wide range of devices and servers, Dynamic Frequency Scaling (DFS) can reduce energy consumption to various degrees by appropriately trading-off system performance. Efficient DFS policies are able to adjust server frequencies by extrapolating the transition or the highly varying workload without incurring much of implementation overhead. This paper models DFS policies of a single server using Markov Decision Processes (MDP). To accommodate the highly varying nature of workload in the proposed MDP, we adopt fluid approximation based on continuous time Markov chain and discrete time Markov chain modeling for the fluid workload generator respectively. Accordingly, we design two frequency controllers (FC), namely C-FC and D-FC, corresponding to the continuous and discrete modeling of the workload generator. We evaluate the proposed policies on synthetic and web traces. The proposed C-FC and D-FC schemes ensure performance satisfaction with moderate energy saving as well as ease of implementation, in comparison with existing DFS policies.
引用
收藏
页码:2951 / +
页数:2
相关论文
共 50 条
  • [41] Learning Representation and Control in Markov Decision Processes: New Frontiers
    Mahadevan, Sridhar
    FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 1 (04): : 403 - 565
  • [42] On the adaptive control of a class of partially observed Markov decision processes
    Hsu, Shun-Pin
    Arapostathis, Ari
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2011, 380 (01) : 1 - 9
  • [43] An Argument for the Bayesian Control of Partially Observable Markov Decision Processes
    Vargo, Erik
    Cogill, Randy
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (10) : 2796 - 2800
  • [44] Optimal control of distributed Markov decision processes with network delays
    Adlakha, Sachin
    Madan, Ritesh
    Lall, Sanjay
    Goldsmith, Andrea
    PROCEEDINGS OF THE 46TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2007, : 4804 - +
  • [45] Impulsive control for continuous-time Markov decision processes
    Université Bordeaux, IMB, INRIA Bordeaux Sud-Ouest, 200 Avenue de la Vieille Tour, Talence Cedex
    33405, France
    不详
    L69 7ZL, United Kingdom
    Adv Appl Probab, 1 (106-127):
  • [46] Switching control in multi-mode Markov decision processes
    Ren, ZY
    Krogh, BH
    PROCEEDINGS OF THE 40TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 2001, : 2095 - 2101
  • [47] EXISTENCE OF OPTIMAL CONTROL IN CONTINUOUS TIME MARKOV DECISION PROCESSES
    YASUDA, M
    BULLETIN OF MATHEMATICAL STATISTICS, 1972, 15 (1-2): : 7 - 17
  • [48] Non-randomized control of constrained Markov decision processes
    Chen, Richard C.
    Feinberg, Eugene A.
    2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 1593 - +
  • [49] On the Adaptive Control of a Class of Partially Observed Markov Decision Processes
    Hsu, Shun-Pin
    Chuang, Dong-Ming
    Arapostathis, Ari
    2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, : 5635 - +
  • [50] Markov decision processes approximation with coupled dynamics via Markov deterministic control systems
    Portillo-Ramirez, Gustavo
    Cruz-Suarez, Hugo
    Lopez-Rios, Ruy
    Blancas-Rivera, Ruben
    OPEN MATHEMATICS, 2023, 21 (01):