OpenIVM: a SQL-to-SQL Compiler for Incremental Computations

被引:0
|
作者
Battiston, Ilaria [1 ]
Kathuria, Kriti [2 ]
Boncz, Peter [1 ]
机构
[1] Ctr Wiskunde & Informat, Amsterdam, Netherlands
[2] Univ Waterloo, Waterloo, ON, Canada
来源
COMPANION OF THE 2024 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, SIGMOD-COMPANION 2024 | 2024年
关键词
Incremental view maintenance; HTAP; compiler;
D O I
10.1145/3626246.3654743
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This demonstration presents a new Open Source SQL-to-SQL compiler for Incremental View Maintenance (IVM). While previous systems, such as DBToaster, implemented computational functionality for IVM in a separate system, the core principle of OpenIVM is to make use of existing SQL query processing engines and perform all IVM computations via SQL. This approach enables the integration of IVM in these systems without code duplication. Also, it eases its use in cross-system IVM, i.e. to orchestrate an HTAP system in which one (OLTP) DBMS provides insertions/updates/deletes (deltas), which are propagated using SQL into another (OLAP) DBMS, hosting materialized views. Our system compiles view definitions into SQL to eventually propagate deltas into the table that materializes the view, following the principles of DBSP. Under the hood, OpenIVM uses the DuckDB library to compile (parse, transform, optimize) the materialized view maintenance logic. We demonstrate OpenIVM in action (i) as the core of a DuckDB extension module that adds IVM functionality to it and (ii) powering cross-system IVM for HTAP, with PostgreSQL handling updates on base tables and DuckDB hosting materialized views on these.
引用
收藏
页码:516 / 519
页数:4
相关论文
共 50 条
  • [41] OCELOT - THE SQL
    SIMOVICI, D
    COMPUTER, 1992, 25 (06) : 67 - 68
  • [42] SQL in the Clouds
    Johnson, James L.
    COMPUTING IN SCIENCE & ENGINEERING, 2009, 11 (04) : 12 - 28
  • [43] THE FUTURE OF SQL
    BEECH, D
    DATAMATION, 1989, 35 (04): : 45 - 48
  • [44] Scalable SQL
    Rys, Michael
    COMMUNICATIONS OF THE ACM, 2011, 54 (06) : 48 - 53
  • [45] 关于SQL
    CSDN
    程序员, 2003, (02) : 66 - 67
  • [46] SQL展望
    David Beech
    常春喜
    计算机工程与科学, 1990, (02) : 74 - 80
  • [47] SEQUEL TO SQL
    CHARDON, C
    BYTE, 1988, 13 (05): : 28 - &
  • [48] WHY NOT SQL
    EGENHOFER, MJ
    INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SYSTEMS, 1992, 6 (02): : 71 - 85
  • [49] SQL DEFINED
    WILLIAMS, RF
    DATAMATION, 1984, 30 (18): : 15 - 15
  • [50] Measures in SQL
    Hyde, Julian
    Fremlin, John
    COMPANION OF THE 2024 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, SIGMOD-COMPANION 2024, 2024, : 31 - 40