Transaction reordering and grouping for continuous data loading

被引:0
|
作者
Luo, Gang [1 ]
Naughton, Jeffrey F. [2 ]
Ellmann, Curt J. [2 ]
Watzke, Michael W. [3 ]
机构
[1] IBM TJ Watson Res Ctr, Cambridge, MA 02139 USA
[2] Univ Wisconsin Madison, Madison, WI 53706 USA
[3] NCR, Dayton, OH USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity of operational data warehousing, the ability to load data quickly and continuously into an RDBMS is becoming more OF and more important. However, in the presence of materialized join views, loading data concurrently into multiple base relations of the same materialized join view can cause a severe deadlock problem. To solve this problem, we propose reordering the data to be loaded so that at any time, for any materialized join view, data is only loaded into one of its base relations. Also, for load transactions on the relations that contain "aggregate" attributes, we propose using pre-aggregation to reduce the number of SQL statements in the load transactions. The advantages of our methods are demonstrated through experiments with a commercial parallel RDBMS.
引用
收藏
页码:34 / +
页数:3
相关论文
共 50 条
  • [21] NISAR: An AXI compliant on-chip NI architecture offering transaction reordering processing
    Xu Yang
    Zhang Qing-Li
    Fu Fang-Fa
    Yu Ming-Yan
    Liu Cheng
    ASICON 2007: 2007 7TH INTERNATIONAL CONFERENCE ON ASIC, VOLS 1 AND 2, PROCEEDINGS, 2007, : 890 - 893
  • [22] Steal-on-Abort: Improving Transactional Memory Performance through Dynamic Transaction Reordering
    Ansari, Mohammad
    Lujan, Mikel
    Kotselidis, Christos
    Jarvis, Kim
    Kirkham, Chris
    Watson, Ian
    HIGH PERFORMANCE EMBEDDED ARCHITECTURES AND COMPILERS, PROCEEDINGS, 2009, 5409 : 4 - 18
  • [23] Key-Based Transaction Reordering: An Optimized Approach for Concurrency Control in Hyperledger Fabric
    Ma, Haoliang
    Shi, Peichang
    Fu, Xiang
    Yi, Guodong
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2023, PT VII, 2024, 14493 : 272 - 291
  • [24] A Novel Approach for FFT Data Reordering
    Jaber, Marwan A.
    Massicotte, Daniel
    2010 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, 2010, : 1615 - 1618
  • [25] Reducing Discontinuous to Continuous Parsing with Pointer Network Reordering
    Fernandez-Gonzalez, Daniel
    Gomez-Rodriguez, Carlos
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 10570 - 10578
  • [26] Grouping based on Comparison of data and Grouping Consecutive Data for Logging Visualization
    Sen, Sheaddha Pradip
    Xiao, Yang
    Li, Tieshan
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSSE 2019), 2019,
  • [27] Optimization opportunities created by global data reordering
    Haber, G
    Klausner, M
    Eisenberg, V
    Mendelson, B
    Gurevich, M
    CGO 2003: INTERNATIONAL SYMPOSIUM ON CODE GENERATION AND OPTIMIZATION, 2003, : 228 - 237
  • [28] Improved CAN Compression Algorithm by Data Reordering
    Kim, Yeon-Jin
    Zou, Yang
    Chung, Jin-Gyun
    PROCEEDINGS INTERNATIONAL SOC DESIGN CONFERENCE 2017 (ISOCC 2017), 2017, : 264 - 265
  • [29] A reordering algorithm for data compression for FPGA configurations
    Kumar, N
    Usha, P
    Sohoni, M
    Rao, SSS
    IETE TECHNICAL REVIEW, 2001, 18 (05): : 375 - 380
  • [30] Online dynamic reordering for interactive data processing
    Raman, V
    Raman, B
    Hellerstein, JM
    PROCEEDINGS OF THE TWENTY-FIFTH INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES, 1999, : 709 - 720