Transaction reordering and grouping for continuous data loading

被引:0
|
作者
Luo, Gang [1 ]
Naughton, Jeffrey F. [2 ]
Ellmann, Curt J. [2 ]
Watzke, Michael W. [3 ]
机构
[1] IBM TJ Watson Res Ctr, Cambridge, MA 02139 USA
[2] Univ Wisconsin Madison, Madison, WI 53706 USA
[3] NCR, Dayton, OH USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity of operational data warehousing, the ability to load data quickly and continuously into an RDBMS is becoming more OF and more important. However, in the presence of materialized join views, loading data concurrently into multiple base relations of the same materialized join view can cause a severe deadlock problem. To solve this problem, we propose reordering the data to be loaded so that at any time, for any materialized join view, data is only loaded into one of its base relations. Also, for load transactions on the relations that contain "aggregate" attributes, we propose using pre-aggregation to reduce the number of SQL statements in the load transactions. The advantages of our methods are demonstrated through experiments with a commercial parallel RDBMS.
引用
收藏
页码:34 / +
页数:3
相关论文
共 50 条
  • [41] Histogram-by: A grouping operator for continuous domains
    Hong, Seokjin
    Bae, Jinuk
    Lee, Taewon
    Lee, Sukho
    DATA & KNOWLEDGE ENGINEERING, 2007, 60 (03) : 451 - 467
  • [42] GROUPING ESTIMATORS ON HETEROSCEDASTIC DATA
    LANCASTER, T
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1968, 63 (321) : 182 - +
  • [43] Combining a continuous Bayesian approach with grouping information
    Curran, JM
    Triggs, CM
    Buckleton, J
    Coulson, S
    FORENSIC SCIENCE INTERNATIONAL, 1998, 91 (03) : 181 - 196
  • [44] A CRITERION AND AN ALGORITHM FOR GROUPING DATA
    FUKUNAGA, K
    KOONTZ, WLG
    IEEE TRANSACTIONS ON COMPUTERS, 1970, C 19 (10) : 917 - &
  • [45] Continuous Variables Segmentation and Reordering for Optimal Performance on Binary Classification Tasks
    Adeodato, Paulo J. L.
    Salazar, Domingos S. P.
    Gallindo, Lucas S.
    Sa, Abner G.
    Souza, Starch M.
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 3720 - 3725
  • [46] Efficient and effective branch reordering using profile data
    Yang, MH
    Uh, GR
    Whalley, DB
    ACM TRANSACTIONS ON PROGRAMMING LANGUAGES AND SYSTEMS, 2002, 24 (06): : 667 - 697
  • [47] A fast algorithm for lossless compression of data tables by reordering
    Vucetic, Slobodan
    DCC 2006: Data Compression Conference, Proceedings, 2006, : 469 - 469
  • [48] A Framework for Enhancing Data Reuse via Associative Reordering
    Stock, Kevin
    Kong, Martin
    Grosser, Tobias
    Pouchet, Louis-Noel
    Rastello, Fabrice
    Ramanujam, J.
    Sadayappan, P.
    ACM SIGPLAN NOTICES, 2014, 49 (06) : 65 - 76
  • [49] A Novel Memristive-Based Data Reordering Scheme
    Mahdavi, Mojtaba
    2023 26TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN, DSD 2023, 2023, : 626 - 633
  • [50] A contribution to the use of decision diagrams for loading and mining transaction databases
    Salleb-Aouissi, Ansaf
    Vrain, Christel
    FUNDAMENTA INFORMATICAE, 2007, 78 (04) : 575 - 594