SketchPolymer: Estimate Per-item Tail Quantile Using One Sketch

被引:2
|
作者
Guo, Jiarui [1 ,2 ,3 ]
Hong, Yisen [1 ,2 ,3 ,4 ]
Wu, Yuhan [1 ,2 ,3 ]
Liu, Yunfei [1 ,5 ]
Yang, Tong [1 ,2 ,3 ]
Cui, Bin [1 ,2 ]
机构
[1] Peking Univ, Beijing, Peoples R China
[2] Peking Univ, Sch Comp Sci, Natl Key Lab Multimedia Informat Proc, Beijing, Peoples R China
[3] Peng Cheng Lab, Shenzhen, Peoples R China
[4] Peking Univ, Sch Software & Microelect, Beijing, Peoples R China
[5] Peking Univ, Sch Integrated Circuits, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Tail quantile estimation; Data stream; Sketch; Quantile estimation; ACCURATE; COMPUTATION; FRAMEWORK; LATENCY;
D O I
10.1145/3580305.3599505
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Estimating the quantile of distribution, especially tail distribution, is an interesting topic in data stream models, and has obtained extensive interest from many researchers. In this paper, we propose a novel sketch, namely SketchPolymer to accurately estimate per-item tail quantile. SketchPolymer uses a technique called Early Filtration to filter infrequent items, and another technique called VSS to reduce error. Our experimental results show that the accuracy of SketchPolymer is on average 32.67 times better than state-of-the-art techniques. We also implement our SketchPolymer on P4 and FPGA platforms to verify its deployment flexibility. All our codes are available at GitHub [1].
引用
收藏
页码:590 / 601
页数:12
相关论文
共 2 条
  • [1] SQUAD: Combining Sketching and Sampling Is Better than Either for Per-item Quantile Estimation
    Shahout, Rana
    Friedman, Roy
    Ben Basat, Ran
    PROCEEDINGS OF THE 15TH ACM INTERNATIONAL CONFERENCE ON SYSTEMS AND STORAGE, SYSTOR 2022, 2022, : 152 - 152
  • [2] Assuming one dose per day yields a similar estimate of medication adherence in patients with stroke: An exploratory analysis using linked registry data
    Ung, David
    Dalli, Lachlan L.
    Lopez, Derrick
    Sanfilippo, Frank M.
    Kim, Joosup
    Andrew, Nadine E.
    Thrift, Amanda G.
    Cadilhac, Dominique A.
    Anderson, Craig S.
    Kilkenny, Monique F.
    BRITISH JOURNAL OF CLINICAL PHARMACOLOGY, 2021, 87 (03) : 1089 - 1097