TailoredSketch: A Fast and Adaptive Sketch for Efficient Per-Flow Size Measurement

被引:1
|
作者
Gao, Guoju [1 ]
Qian, Zhaorong [1 ]
Huang, He [1 ]
Sun, Yu-E [2 ]
Du, Yang [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Soochow Univ, Sch Rail Transportat, Suzhou 215006, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Telecommunication traffic; Size measurement; Memory management; Flow production systems; Estimation; IP networks; Entropy; Standards; Hash functions; Time measurement; Count-min; counter-splicing; per-flow size measurement; sampling; sketch; FREQUENCY ESTIMATION; FRAMEWORK; ACCURATE;
D O I
10.1109/TNSE.2024.3503904
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Accurate and fast per-flow size traffic measurement is fundamental to some network applications, especially in face of the processing and memory constraints of switches. Sketch, a compact data structure, can output high-fidelity approximate per-flow statistics. However, most existing sketches, such as Count-Min, are trapped in the dilemma between a large counting range and memory waste, due to the highly skewed characteristics of network traffic size distribution. In this paper, we propose an adaptive counter-splicing-based sketch for per-flow size measurement, called TailoredSketch. Specifically, we divide each counter of TailoredSketch into two parts, named basic and carry-in counters. When the basic counters overflow, the carry-in counters work, and meanwhile several carry-in counters in different positions can be spliced to expand the counting range. We also incorporate sampling into TailoredSketch, where we set different sampling probabilities at each layer to distinguish between elephant and mouse flows better. In order to further increase the memory utilization of TailoredSketch, we optimize it by removing the flag bits of each counter. Extensive experiments based on the real-world dataset CAIDA show that our sketch can achieve better overall performance compared to several existing algorithms.
引用
收藏
页码:505 / 517
页数:13
相关论文
共 50 条
  • [1] An Efficient Adaptive Denoising Sketch for Per-flow Traffic Measurement
    Lou, Chen
    Sun, Yu-E
    Huang, He
    Du, Yang
    Chen, Shigang
    Gao, Guoju
    Xu, Hongli
    2022 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE, IPCCC, 2022,
  • [2] Per-Flow Network Measurement With Distributed Sketch
    Gu, Liyuan
    Tian, Ye
    Chen, Wei
    Wei, Zhongxiang
    Wang, Cenman
    Zhang, Xinming
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (01) : 411 - 426
  • [3] Accurate Per-Flow Measurement with Bloom Sketch
    Zhou, Yang
    Jin, Hao
    Liu, Peng
    Zhang, Haowei
    Yang, Tong
    Li, Xiaoming
    IEEE INFOCOM 2018 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2018,
  • [4] AGC Sketch: An effective and accurate per-flow measurement to adapt flow size distribution
    Li, Zhuo
    Liu, Ziyu
    Liu, Jindian
    Zhang, Yu
    Liang, Teng
    Liu, Kaihua
    COMPUTER COMMUNICATIONS, 2024, 221 : 120 - 130
  • [5] Per-Flow Size Measurement by Combining Sketch and Flow Table in Software-Defined Networks
    Qian, Zhaorong
    Gao, Guoju
    Du, Yang
    2022 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING, ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM, 2022, : 644 - 651
  • [6] One Memory Access Sketch: a More Accurate and Faster Sketch for Per-flow Measurement
    Zhou, Yang
    Liu, Peng
    Jin, Hao
    Yang, Tong
    Dang, Shoujiang
    Li, Xiaoming
    GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [7] Priority-Aware Per-flow Measurement using Cuckoo Sketch
    Yan, Yibo
    Chen, Cheng
    Lin, Huiping
    Ruas, Olivier
    Wang, Tengjiao
    Yang, Tong
    2020 IFIP NETWORKING CONFERENCE AND WORKSHOPS (NETWORKING), 2020, : 622 - 624
  • [8] Diamond Sketch: Accurate Per-flow Measurement for Real IP Streams
    Yang, Tong
    Gao, Siang
    Sun, Zhouyi
    Wang, Yufei
    Shen, Yulong
    Li, Xiaoming
    IEEE INFOCOM 2018 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2018,
  • [9] Diamond Sketch: Accurate Per-flow Measurement for Big Streaming Data
    Yang, Tong
    Gao, Siang
    Sun, Zhouyi
    Wang, Yufei
    Shen, Yulong
    Li, Xiaoming
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (12) : 2650 - 2662
  • [10] Self-Adaptive Sampling Based Per-Flow Traffic Measurement
    Du, Yang
    Huang, He
    Sun, Yu-E
    Chen, Shigang
    Gao, Guoju
    Wu, Xiaocan
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (03) : 1010 - 1025