Transaction reordering and grouping for continuous data loading

被引:0
|
作者
Luo, Gang [1 ]
Naughton, Jeffrey F. [2 ]
Ellmann, Curt J. [2 ]
Watzke, Michael W. [3 ]
机构
[1] IBM TJ Watson Res Ctr, Cambridge, MA 02139 USA
[2] Univ Wisconsin Madison, Madison, WI 53706 USA
[3] NCR, Dayton, OH USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity of operational data warehousing, the ability to load data quickly and continuously into an RDBMS is becoming more OF and more important. However, in the presence of materialized join views, loading data concurrently into multiple base relations of the same materialized join view can cause a severe deadlock problem. To solve this problem, we propose reordering the data to be loaded so that at any time, for any materialized join view, data is only loaded into one of its base relations. Also, for load transactions on the relations that contain "aggregate" attributes, we propose using pre-aggregation to reduce the number of SQL statements in the load transactions. The advantages of our methods are demonstrated through experiments with a commercial parallel RDBMS.
引用
收藏
页码:34 / +
页数:3
相关论文
共 50 条
  • [1] Transaction reordering
    Luo, Gang
    Naughton, Jeffrey F.
    Ellmann, Curt J.
    Watzke, Michael W.
    DATA & KNOWLEDGE ENGINEERING, 2010, 69 (01) : 29 - 49
  • [2] Transaction reordering in replicated databases
    Pedone, F
    Guerraoui, R
    Schiper, A
    SIXTEENTH SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS, PROCEEDINGS, 1997, : 175 - 182
  • [3] A data grouping model based on cache transaction for unstructured data storage systems
    Dongjie, Zhu
    Haiwen, Du
    Yundong, Sun
    Zhaoshuo, Tian
    Ning, Cao
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (08) : 4488 - 4514
  • [4] Continuous Embedding Spaces for Bank Transaction Data
    Dayioglugil, Ali Batuhan
    Akgul, Yusuf Sinan
    FOUNDATIONS OF INTELLIGENT SYSTEMS, ISMIS 2017, 2017, 10352 : 129 - 135
  • [5] Transaction reordering for epidemic quorum in replicated databases
    Lin, HZ
    Zheng, ZW
    Chen, C
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2005, VOL 4, PROCEEDINGS, 2005, 3483 : 826 - 835
  • [6] SoK: Preventing Transaction Reordering Manipulations in Decentralized Finance
    Heimbach, Lioba
    Wattenhofer, Roger
    PROCEEDINGS OF THE 2022 4TH ACM CONFERENCE ON ADVANCES IN FINANCIAL TECHNOLOGIES, AFT 2022, 2022, : 47 - 60
  • [7] Reordering Transaction Execution to Boost High Frequency Trading Applications
    Zhou, Ningnan
    Zhou, Xuan
    Zhang, Xiao
    Du, Xiaoyong
    Wang, Shan
    WEB AND BIG DATA, APWEB-WAIM 2017, PT II, 2017, 10367 : 169 - 184
  • [8] Using reordering technique for mobile transaction management in broadcast environments
    Kim, S
    Lee, S
    Hwang, CS
    DATA & KNOWLEDGE ENGINEERING, 2003, 45 (01) : 79 - 100
  • [9] Solving Virtual Machine Packing with a Reordering Grouping Genetic Algorithm
    Wilcox, David
    McNabb, Andrew
    Seppi, Kevin
    2011 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2011, : 362 - 369
  • [10] GROUPING CONTINUOUS DATA IN DISCRETE INTERVALS - INFORMATION LOSS AND RECOVERY
    SHAW, DG
    HUFFMAN, MD
    HAVILAND, MG
    JOURNAL OF EDUCATIONAL MEASUREMENT, 1987, 24 (02) : 167 - 173