Cube algorithms for very large compressed data warehouses

被引:0
|
作者
Gao, H. [1 ]
Li, J. [1 ]
机构
[1] Dept. of Computer Science and Eng., Harbin Institute of Technology, Harbin 150001, China
来源
Ruan Jian Xue Bao/Journal of Software | 2001年 / 12卷 / 06期
关键词
Computer aided analysis - Data compression - Data storage equipment - Data warehouses - Database systems - Input output programs - Online systems;
D O I
暂无
中图分类号
学科分类号
摘要
Data compression is an effective approach to improve the data warehouses. On line analysis processing (OLAP) is the most important application on the data warehouses, and Cube is one of the most operators in OLAP. Thus, it is a big challenge to develop efficient algorithms for compressed data warehouses. Although many algorithms to compute Cube have been developed recently, there is little to date in the literatures about Cube algorithms for compressed data warehouse. To the author's knowledge, there is only one paper that presented a Cube algorithm for compressed data warehouses with a special compression method called chunk-offset. A set of Cube algorithms for very large and compressed data warehouses are proposed in this paper. These algorithms operate directly on compressed datasets without the need of decompressing them first. They are applicable to a variety of data compression methods. The detail analysis of I/O and CPU cost are also given, and compared with the existed algorithms by experiment. The analytical and experimental results show that the algorithms proposed in this paper are more efficient than other existed ones.
引用
收藏
页码:830 / 839
相关论文
共 50 条
  • [21] Large relations in node-partitioned data warehouses
    Furtado, P
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PROCEEDINGS, 2005, 3453 : 555 - 560
  • [22] Online Expansion of Large-scale Data Warehouses
    Cohen, Jeffrey
    Eshleman, John
    Hagenbuch, Brian
    Kent, Joy
    Pedrotti, Christopher
    Sherry, Gavin
    Waas, Florian
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2011, 4 (12): : 1249 - 1259
  • [23] Partial prefix sum method for large data warehouses
    Chun, SJ
    FOUNDATIONS OF INTELLIGENT SYSTEMS, 2003, 2871 : 473 - 477
  • [24] ALGORITHMS FOR VERY LARGE INTEGER ARITHMETIC
    BRASSARD, G
    MONET, S
    ZUFFELLATO, D
    TSI-TECHNIQUE ET SCIENCE INFORMATIQUES, 1986, 5 (02): : 89 - 102
  • [25] Data Routing Algorithms In Extended Lucas Cube Networks
    Ernastuti
    Salim, Ravi A.
    Juarna, A.
    SITIS 2008: 4TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY AND INTERNET BASED SYSTEMS, PROCEEDINGS, 2008, : 97 - 104
  • [26] Multiobjective genetic algorithms for materialized view selection in OLAP data warehouses
    Lawrence, Michael
    GECCO 2006: GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, VOL 1 AND 2, 2006, : 699 - 706
  • [27] The Argument for a "Data Cube" for Large-Scale Psychometric Data
    von Davier, Alina A.
    Wong, Pak Chung
    Polyak, Steve
    Yudelson, Michael
    FRONTIERS IN EDUCATION, 2019, 4
  • [28] s-OLAP: Approximate OLAP Query Evaluation on Very Large Data Warehouses via Dimensionality Reduction and Probabilistic Synopses
    Cuzzocrea, Alfredo
    ENTERPRISE INFORMATION SYSTEMS-BK, 2009, 24 : 248 - 262
  • [29] A novel three-level architecture for large data warehouses
    Palopoli, L
    Pontieri, L
    Terracina, G
    Ursino, D
    JOURNAL OF SYSTEMS ARCHITECTURE, 2002, 47 (11) : 937 - 958
  • [30] TRANSITIVE CLOSURE ALGORITHMS FOR VERY LARGE DATABASES
    BISKUP, J
    STIEFELING, H
    LECTURE NOTES IN COMPUTER SCIENCE, 1989, 344 : 122 - 147