Survey of window types for aggregation in stream processing systems

被引:9
|
作者
Verwiebe, Juliane [1 ]
Grulich, Philipp M. [1 ]
Traub, Jonas [1 ]
Markl, Volker [1 ]
机构
[1] Tech Univ Berlin, Sekr EN-7,Einsteinufer 17, D-10587 Berlin, Germany
来源
VLDB JOURNAL | 2023年 / 32卷 / 05期
关键词
Survey; Window types; Window aggregation; Stream processing systems; Out-of-order processing; EFFICIENT; MODEL; ARCHITECTURE; MANAGEMENT; SEMANTICS;
D O I
10.1007/s00778-022-00778-6
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present the first comprehensive survey of window types for stream processing systems which have been presented in research and commercial systems. We cover publications from the most relevant conferences, journals, and system whitepapers on stream processing, windowing, and window aggregation which have been published over the last 20 years. For each window type, we provide detailed specifications, formal notations, synonyms, and use-case examples. We classify each window type according to categories that have been proposed in literature and describe the out-of-order processing. In addition, we examine academic, commercial, and open-source systems with respect to the window types that they support. Our survey offers a comprehensive overview that may serve as a guideline for the development of stream processing systems, window aggregation techniques, and frameworks that support a variety of window types.
引用
收藏
页码:985 / 1011
页数:27
相关论文
共 50 条
  • [21] Reliable stream data processing for elastic distributed stream processing systems
    Wei, Xiaohui
    Zhuang, Yuan
    Li, Hongliang
    Liu, Zhiliang
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2020, 23 (02): : 555 - 574
  • [22] Performance analysis of sliding window filtering of two dimensional signals based on stream data processing systems
    Nikolay, Kazanskiy
    Vladimir, Protsenko
    Pavel, Serafimovich
    OPTICAL TECHNOLOGIES FOR TELECOMMUNICATIONS 2015, 2016, 9807
  • [23] Query processing of multi-way stream window joins
    Hammad, Moustafa A.
    Aref, Walid G.
    Elmagarmid, Ahmed K.
    VLDB JOURNAL, 2008, 17 (03): : 469 - 488
  • [24] Query processing of multi-way stream window joins
    Moustafa A. Hammad
    Walid G. Aref
    Ahmed K. Elmagarmid
    The VLDB Journal, 2008, 17 : 469 - 488
  • [25] A Survey of Distributed Data Stream Processing Frameworks
    Isah, Haruna
    Abughofa, Tariq
    Mahfuz, Sazia
    Ajerla, Dharmitha
    Zulkernine, Farhana
    Khan, Shahzad
    IEEE ACCESS, 2019, 7 : 154300 - 154316
  • [26] Hardware-Conscious Stream Processing: A Survey
    Zhang, Shuhao
    Zhang, Feng
    Wu, Yingjun
    He, Bingsheng
    Johns, Paul
    SIGMOD RECORD, 2019, 48 (04) : 18 - 29
  • [27] A Comprehensive Survey on Parallelization and Elasticity in Stream Processing
    Roeger, Henriette
    Mayer, Ruben
    ACM COMPUTING SURVEYS, 2019, 52 (02)
  • [28] Signal processing challenges in distributed stream processing systems
    Frossard, Pascal
    Verscheure, Olivier
    Venkatramani, Chitra
    2006 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-13, 2006, : 5903 - 5906
  • [29] A query processing approach based on window semantics in data stream system
    Song, BY
    Wu, SS
    Yuan, F
    Yu, G
    ADVANCES IN COMPUTER SCIENCE - ASIAN 2005, PROCEEDINGS: DATA MANAGEMENT ON THE WEB, 2005, 3818 : 282 - 283
  • [30] Harnessing sliding-window execution semantics for parallel stream processing
    Mencagli, Gabriele
    Torquati, Massimo
    Lucattini, Fabio
    Cuomo, Salvatore
    Aldinucci, Marco
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2018, 116 : 74 - 88