A survey of large-scale analytical query processing in MapReduce

被引:0
|
作者
Christos Doulkeridis
Kjetil Nørvåg
机构
[1] University of Piraeus,Department of Digital Systems
[2] Norwegian University of Science and Technology,Department of Computer and Information Science
来源
The VLDB Journal | 2014年 / 23卷
关键词
MapReduce; Survey; Data analysis; Query processing; Large-scale; Big Data;
D O I
暂无
中图分类号
学科分类号
摘要
Enterprises today acquire vast volumes of data from different sources and leverage this information by means of data analysis to support effective decision-making and provide new functionality and services. The key requirement of data analytics is scalability, simply due to the immense volume of data that need to be extracted, processed, and analyzed in a timely fashion. Arguably the most popular framework for contemporary large-scale data analytics is MapReduce, mainly due to its salient features that include scalability, fault-tolerance, ease of programming, and flexibility. However, despite its merits, MapReduce has evident performance limitations in miscellaneous analytical tasks, and this has given rise to a significant body of research that aim at improving its efficiency, while maintaining its desirable properties. This survey aims to review the state of the art in improving the performance of parallel query processing using MapReduce. A set of the most significant weaknesses and limitations of MapReduce is discussed at a high level, along with solving techniques. A taxonomy is presented for categorizing existing research on MapReduce improvements according to the specific problem they target. Based on the proposed taxonomy, a classification of existing research is provided focusing on the optimization objective. Concluding, we outline interesting directions for future parallel data processing systems.
引用
收藏
页码:355 / 380
页数:25
相关论文
共 50 条
  • [11] QuPARA: Query-Driven Large-Scale Portfolio Aggregate Risk Analysis on MapReduce
    Rau-Chaplin, A.
    Varghese, B.
    Wilson, D.
    Yao, Z.
    Zeh, N.
    2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [12] Recent Developments on Security and Reliability in Large-Scale Data Processing with MapReduce
    Esposito, Christian
    Ficco, Massimo
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2016, 12 (01) : 49 - 68
  • [13] A Fault-Tolerant Environment for Large-Scale Query Processing
    Kurt, Mehmet Can
    Agrawal, Gagan
    2012 19TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), 2012,
  • [14] Large-scale graph processing systems: a survey
    Liu, Ning
    Li, Dong-sheng
    Zhang, Yi-ming
    Li, Xiong-lve
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2020, 21 (03) : 384 - 404
  • [15] Large-scale graph processing systems: a survey
    Ning Liu
    Dong-sheng Li
    Yi-ming Zhang
    Xiong-lve Li
    Frontiers of Information Technology & Electronic Engineering, 2020, 21 : 384 - 404
  • [16] Loosely-specified query processing in large-scale information systems
    Nica, A
    Rundensteiner, EA
    INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 1998, 7 (01) : 77 - 103
  • [17] Loosely-specified query processing in large-scale information systems
    Nica, A
    Rundensteiner, EA
    INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 1997, 6 (3-4) : 241 - 268
  • [18] MapReduce for Large-scale Monitor Data Analyses
    Ding, Jianwei
    Liu, Yingbo
    Zhang, Li
    Wang, Jianmin
    2014 IEEE 13TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM), 2014, : 747 - 754
  • [19] Large-Scale Deep Belief Nets With MapReduce
    Zhang, Kunlei
    Chen, Xue-Wen
    IEEE ACCESS, 2014, 2 : 395 - 403
  • [20] MapReduce in MPI for Large-scale graph algorithms
    Plimpton, Steven J.
    Devine, Karen D.
    PARALLEL COMPUTING, 2011, 37 (09) : 610 - 632