Learning-Based Optimization for Online Approximate Query Processing

被引:0
|
作者
Bi, Wenyuan [1 ,2 ]
Zhang, Hanbing [1 ,2 ]
Jing, Yinan [1 ,2 ]
He, Zhenying [1 ,2 ]
Zhang, Kai [1 ,2 ]
Wang, X. Sean [1 ,2 ,3 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Shanghai Key Lab Data Sci, Shanghai, Peoples R China
[3] Shanghai Inst Intelligent Elect & Syst, Shanghai, Peoples R China
来源
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I | 2022年
基金
国家重点研发计划;
关键词
Approximate query processing; OLAP; Error prediction;
D O I
10.1007/978-3-031-00123-9_7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Approximate query processing (AQP) technique speeds up query execution by reducing the amount of data that needs to be processed, while sacrificing the accuracy of the query result to some extent. AQP is essentially a trade-off between the accuracy of the query result and the query latency. However, the heuristic AQP optimization and error control mechanism used by the existing AQP system fails to meet the accuracy requirements of users. This paper proposes a deep learning-based error prediction model to guide AQP query optimization. By using this model, we can estimate the errors of candidate query plans and select the appropriate plans that can meet the accuracy requirement with high probability. Extensive experiments show that the AQP system proposed in this paper can outperform the state-of-the-art online sampling-based AQP approach.
引用
收藏
页码:96 / 103
页数:8
相关论文
共 50 条
  • [1] LAQP: Learning-based approximate query processing
    Zhang, Meifan
    Wang, Hongzhi
    INFORMATION SCIENCES, 2021, 546 : 1113 - 1134
  • [2] Learning-Based Sample Tuning for Approximate Query Processing in Interactive Data Exploration
    Zhang, Hanbing
    Jing, Yinan
    He, Zhenying
    Zhang, Kai
    Wang, X. Sean
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6532 - 6546
  • [3] Learning-based Declarative Query Optimization
    Tripathi, Shivani
    CODS-COMAD 2021: PROCEEDINGS OF THE 3RD ACM INDIA JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE & MANAGEMENT OF DATA (8TH ACM IKDD CODS & 26TH COMAD), 2021, : 416 - 416
  • [4] Learning-based query optimization for multi-probe approximate nearest neighbor search
    Zhang, Pengcheng
    Yao, Bin
    Gao, Chao
    Wu, Bin
    He, Xiao
    Li, Feifei
    Lu, Yuanfei
    Zhan, Chaoqun
    Tang, Feilong
    VLDB JOURNAL, 2023, 32 (03): : 623 - 645
  • [5] Learning-based query optimization for multi-probe approximate nearest neighbor search
    Pengcheng Zhang
    Bin Yao
    Chao Gao
    Bin Wu
    Xiao He
    Feifei Li
    Yuanfei Lu
    Chaoqun Zhan
    Feilong Tang
    The VLDB Journal, 2023, 32 : 623 - 645
  • [6] An Online Approximate Aggregation Query Processing Method Based on Hadoop
    Zhang, Zhiqiang
    Hu, Jianghua
    Xie, Xiaoqin
    Pan, Haiwei
    Feng, Xiaoning
    2016 IEEE 20TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2016, : 117 - 122
  • [7] A Learning-based Semantic Approximate Query over RDF Knowledge Graph
    Ge, Zhangpeng
    Wang, Yuxiang
    Yan, Haijiang
    Xu, Xiaoliang
    2018 SIXTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2018, : 135 - 141
  • [8] Quantum approximate optimization via learning-based adaptive optimization
    Lixue Cheng
    Yu-Qin Chen
    Shi-Xin Zhang
    Shengyu Zhang
    Communications Physics, 7
  • [9] Quantum approximate optimization via learning-based adaptive optimization
    Cheng, Lixue
    Chen, Yu-Qin
    Zhang, Shi-Xin
    Zhang, Shengyu
    COMMUNICATIONS PHYSICS, 2024, 7 (01)
  • [10] Database Native Approximate Query Processing Based on Machine-Learning
    Duan, Yang
    Zhang, Yong
    Wu, Jiacheng
    WEB INFORMATION SYSTEMS AND APPLICATIONS (WISA 2021), 2021, 12999 : 74 - 86