WATuning: A Workload-Aware Tuning System with Attention-Based Deep Reinforcement Learning

被引:10
|
作者
Ge, Jia-Ke [1 ,2 ]
Chai, Yan-Feng [2 ,3 ]
Chai, Yun-Peng [1 ,2 ]
机构
[1] Renmin Univ China, Key Lab Data Engn & Knowledge Engn Minist Educ, Beijing 100872, Peoples R China
[2] Renmin Univ China, Sch Informat, Beijing 100872, Peoples R China
[3] Taiyuan Univ Sci & Technol, Coll Comp Sci & Technol, Taiyuan 030027, Peoples R China
基金
中国国家自然科学基金;
关键词
attention mechanism; auto-tuning system; reinforcement learning (RL); workload-aware; TIME;
D O I
10.1007/s11390-021-1350-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Configuration tuning is essential to optimize the performance of systems (e.g., databases, key-value stores). High performance usually indicates high throughput and low latency. At present, most of the tuning tasks of systems are performed artificially (e.g., by database administrators), but it is hard for them to achieve high performance through tuning in various types of systems and in various environments. In recent years, there have been some studies on tuning traditional database systems, but all these methods have some limitations. In this article, we put forward a tuning system based on attention-based deep reinforcement learning named WATuning, which can adapt to the changes of workload characteristics and optimize the system performance efficiently and effectively. Firstly, we design the core algorithm named ATT-Tune for WATuning to achieve the tuning task of systems. The algorithm uses workload characteristics to generate a weight matrix and acts on the internal metrics of systems, and then ATT-Tune uses the internal metrics with weight values assigned to select the appropriate configuration. Secondly, WATuning can generate multiple instance models according to the change of the workload so that it can complete targeted recommendation services for different types of workloads. Finally, WATuning can also dynamically fine-tune itself according to the constantly changing workload in practical applications so that it can better fit to the actual environment to make recommendations. The experimental results show that the throughput and the latency of WATuning are improved by 52.6% and decreased by 31%, respectively, compared with the throughput and the latency of CDBTune which is an existing optimal tuning method.
引用
收藏
页码:741 / 761
页数:21
相关论文
共 50 条
  • [1] WATuning: A Workload-Aware Tuning System with Attention-Based Deep Reinforcement Learning
    Jia-Ke Ge
    Yan-Feng Chai
    Yun-Peng Chai
    Journal of Computer Science and Technology, 2021, 36 : 741 - 761
  • [2] Workload-Aware Performance Tuning for Multimodel Databases Based on Deep Reinforcement Learning
    Sun, Jun
    Ye, Feng
    Nedjah, Nadia
    Zhang, Ming
    Xu, Dong
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [3] Indexer plus plus : Workload-Aware Online Index Tuning with Transformers and Reinforcement Learning
    Sharma, Vishal
    Dyreson, Curtis
    37TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, 2022, : 372 - 380
  • [4] Workload-Aware Performance Tuning for Autonomous DBMSs
    Yan, Zhengtong
    Lu, Jiaheng
    Chainani, Naresh
    Lin, Chunbin
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2365 - 2368
  • [5] Attention-Based Deep Reinforcement Learning for Edge User Allocation
    Chang, Jiaxin
    Wang, Jian
    Li, Bing
    Zhao, Yuqi
    Li, Duantengchuan
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (01): : 590 - 604
  • [6] ADWTune: an adaptive dynamic workload tuning system with deep reinforcement learning
    Li, Cuixia
    Wang, Junhai
    Shi, Jiahao
    Liu, Liqiang
    Zhang, Shuyan
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (04)
  • [7] Learning to Drive at Unsignalized Intersections using Attention-based Deep Reinforcement Learning
    Seong, Hyunki
    Jung, Chanyoung
    Lee, Seungwook
    Shim, David Hyunchul
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 559 - 566
  • [8] A Compressed and Accurate Sparse Deep Learning-based Workload-Aware Timing Error Model
    Tompazi, Styliani
    Karakonstantis, Georgios
    2023 IEEE 41ST INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, ICCD, 2023, : 9 - 12
  • [9] Attention-Based Deep Reinforcement Learning for Virtual Cinematography of 360° Videos
    Wang, Jianyi
    Xu, Mai
    Jiang, Lai
    Song, Yuhang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3227 - 3238
  • [10] Workload-Aware Self-tuning Histograms for the Semantic Web
    Zamani, Katerina
    Charalambidis, Angelos
    Konstantopoulos, Stasinos
    Zoulis, Nickolas
    Mavroudi, Effrosyni
    TRANSACTIONS ON LARGE-SCALE DATA- AND KNOWLEDGE-CENTERED SYSTEMS XXVIII: SPECIAL ISSUE ON DATABASE- AND EXPERT-SYSTEMS APPLICATIONS, 2016, 9940 : 133 - 156