WATuning: A Workload-Aware Tuning System with Attention-Based Deep Reinforcement Learning

被引:10
|
作者
Ge, Jia-Ke [1 ,2 ]
Chai, Yan-Feng [2 ,3 ]
Chai, Yun-Peng [1 ,2 ]
机构
[1] Renmin Univ China, Key Lab Data Engn & Knowledge Engn Minist Educ, Beijing 100872, Peoples R China
[2] Renmin Univ China, Sch Informat, Beijing 100872, Peoples R China
[3] Taiyuan Univ Sci & Technol, Coll Comp Sci & Technol, Taiyuan 030027, Peoples R China
基金
中国国家自然科学基金;
关键词
attention mechanism; auto-tuning system; reinforcement learning (RL); workload-aware; TIME;
D O I
10.1007/s11390-021-1350-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Configuration tuning is essential to optimize the performance of systems (e.g., databases, key-value stores). High performance usually indicates high throughput and low latency. At present, most of the tuning tasks of systems are performed artificially (e.g., by database administrators), but it is hard for them to achieve high performance through tuning in various types of systems and in various environments. In recent years, there have been some studies on tuning traditional database systems, but all these methods have some limitations. In this article, we put forward a tuning system based on attention-based deep reinforcement learning named WATuning, which can adapt to the changes of workload characteristics and optimize the system performance efficiently and effectively. Firstly, we design the core algorithm named ATT-Tune for WATuning to achieve the tuning task of systems. The algorithm uses workload characteristics to generate a weight matrix and acts on the internal metrics of systems, and then ATT-Tune uses the internal metrics with weight values assigned to select the appropriate configuration. Secondly, WATuning can generate multiple instance models according to the change of the workload so that it can complete targeted recommendation services for different types of workloads. Finally, WATuning can also dynamically fine-tune itself according to the constantly changing workload in practical applications so that it can better fit to the actual environment to make recommendations. The experimental results show that the throughput and the latency of WATuning are improved by 52.6% and decreased by 31%, respectively, compared with the throughput and the latency of CDBTune which is an existing optimal tuning method.
引用
收藏
页码:741 / 761
页数:21
相关论文
共 50 条
  • [41] Dynamic workload-aware DVFS for multicore systems using machine learning
    Manjari Gupta
    Lava Bhargava
    S. Indu
    Computing, 2021, 103 : 1747 - 1769
  • [42] Workload-Aware Lifetime Trojan based on Statistical Aging Manipulation
    Tseng, Tien-Hung
    Wang, Shu-Sheng
    Chen, Jian-You
    Wu, Kai-Chiang
    2017 IEEE CONFERENCE ON DEPENDABLE AND SECURE COMPUTING, 2017, : 159 - 165
  • [43] Workload-Aware VM Consolidation in Cloud Based on Max-Min Ant System
    Zhang, Hongjie
    Shu, Guansheng
    Liao, Shasha
    Fu, Xi
    Li, Jing
    CLOUD COMPUTING AND SECURITY, PT I, 2017, 10602
  • [44] Deep Learning-Based Image Retrieval System with Clustering on Attention-Based Representations
    Rao S.S.
    Ikram S.
    Ramesh P.
    SN Computer Science, 2021, 2 (3)
  • [45] Dynamic workload-aware DVFS for multicore systems using machine learning
    Gupta, Manjari
    Bhargava, Lava
    Indu, S.
    COMPUTING, 2021, 103 (08) : 1747 - 1769
  • [46] Attention-Based Multiagent Graph Reinforcement Learning for Service Restoration
    Fan B.
    Liu X.
    Xiao G.
    Kang Y.
    Wang D.
    Wang P.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (05): : 2163 - 2178
  • [47] Cognitive Workload Estimation Using Variational Autoencoder and Attention-Based Deep Model
    Chakladar, Debashis Das
    Datta, Sumalyo
    Roy, Partha Pratim
    Prasad, Vinod A.
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (02) : 581 - 590
  • [48] Deep Reinforcement Learning Recommendation System based on GRU and Attention Mechanism
    Hou, Yan-e
    Gu, Wenbo
    Yang, Kang
    Dang, Lanxue
    ENGINEERING LETTERS, 2023, 31 (02) : 695 - 701
  • [49] MorphDAG: A Workload-Aware Elastic DAG-Based Blockchain
    Zhang, Shijie
    Xiao, Jiang
    Wu, Enping
    Cheng, Feng
    Li, Bo
    Wang, Wei
    Jin, Hai
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (10) : 5249 - 5264
  • [50] MADC: Multi-scale Attention-based Deep Clustering for Workload Prediction
    Huang, Jiaming
    Xiao, Chuming
    Wu, Weigang
    Yin, Ye
    Chang, Hongli
    19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 316 - 323