Survey of window types for aggregation in stream processing systems

被引：9
|
作者：
Verwiebe, Juliane [1 ]
Grulich, Philipp M. [1 ]
Traub, Jonas [1 ]
Markl, Volker [1 ]
机构：
[1] Tech Univ Berlin, Sekr EN-7,Einsteinufer 17, D-10587 Berlin, Germany
来源：
VLDB JOURNAL | 2023年 / 32卷 / 05期
关键词：
Survey; Window types; Window aggregation; Stream processing systems; Out-of-order processing; EFFICIENT; MODEL; ARCHITECTURE; MANAGEMENT; SEMANTICS;
D O I：
10.1007/s00778-022-00778-6
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, we present the first comprehensive survey of window types for stream processing systems which have been presented in research and commercial systems. We cover publications from the most relevant conferences, journals, and system whitepapers on stream processing, windowing, and window aggregation which have been published over the last 20 years. For each window type, we provide detailed specifications, formal notations, synonyms, and use-case examples. We classify each window type according to categories that have been proposed in literature and describe the out-of-order processing. In addition, we examine academic, commercial, and open-source systems with respect to the window types that they support. Our survey offers a comprehensive overview that may serve as a guideline for the development of stream processing systems, window aggregation techniques, and frameworks that support a variety of window types.
引用
收藏
页码：985 / 1011
页数：27
相关论文
共 50 条
  • [1] Survey of window types for aggregation in stream processing systems
    Juliane Verwiebe
    Philipp M. Grulich
    Jonas Traub
    Volker Markl
    The VLDB Journal, 2023, 32 : 985 - 1011
  • [2] Correction to: Survey of window types for aggregation in stream processing systems
    Juliane Verwiebe
    Philipp M. Grulich
    Jonas Traub
    Volker Markl
    The VLDB Journal, 2024, 33 : 251 - 251
  • [3] Survey of window types for aggregation in stream processing systems (Feb, 10.1007/s00778-022-00778-6, 2023)
    Verwiebe, Juliane
    Grulich, Philipp M. M.
    Traub, Jonas
    Mark, Volker
    VLDB JOURNAL, 2024, 33 (01): : 251 - 251
  • [4] Scotty: General and Efficient Open-source Window Aggregation for Stream Processing Systems
    Traub, Jonas
    Grulich, Philipp Marian
    Rodriguez Cuellar, Alejandro
    Bress, Sebastian
    Katsifodimos, Asterios
    Rabl, Tilmann
    Markl, Volker
    ACM TRANSACTIONS ON DATABASE SYSTEMS, 2021, 46 (01):
  • [5] A survey on the evolution of stream processing systems
    Fragkoulis, Marios
    Carbone, Paris
    Kalavri, Vasiliki
    Katsifodimos, Asterios
    VLDB JOURNAL, 2024, 33 (02): : 507 - 541
  • [6] Scotty: Efficient Window Aggregation for out-of-order Stream Processing
    Traub, Jonas
    Grulich, Philipp M.
    Cuellar, Alejandro Rodriguez
    Bress, Sebastian
    Katsifodimos, Asterios
    Rabl, Tilmann
    Markl, Volker
    2018 IEEE 34TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2018, : 1300 - 1303
  • [7] Conceptual Survey on Data Stream Processing Systems
    Hesse, Guenter
    Lorenz, Martin
    2015 IEEE 21ST INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2015, : 797 - 802
  • [8] Addressing resource usage in stream processing systems: sizing window effect
    Surdu, Sabina
    Scuturici, Vasile-Marian
    PROCEEDINGS OF THE 15TH INTERNATIONAL DATABASE ENGINEERING & APPLICATIONS SYMPOSIUM (IDEAS '11), 2011, : 247 - 248
  • [9] Data-Trace Types for Distributed Stream Processing Systems
    Mamouras, Konstantinos
    Stanford, Caleb
    Alur, Rajeev
    Ives, Zachary G.
    Tannen, Val
    PROCEEDINGS OF THE 40TH ACM SIGPLAN CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '19), 2019, : 670 - 685
  • [10] A survey of stream processing
    Stephens, R
    ACTA INFORMATICA, 1997, 34 (07) : 491 - 541
12345