A survey of large-scale analytical query processing in MapReduce

被引:0
|
作者
Christos Doulkeridis
Kjetil Nørvåg
机构
[1] University of Piraeus,Department of Digital Systems
[2] Norwegian University of Science and Technology,Department of Computer and Information Science
来源
The VLDB Journal | 2014年 / 23卷
关键词
MapReduce; Survey; Data analysis; Query processing; Large-scale; Big Data;
D O I
暂无
中图分类号
学科分类号
摘要
Enterprises today acquire vast volumes of data from different sources and leverage this information by means of data analysis to support effective decision-making and provide new functionality and services. The key requirement of data analytics is scalability, simply due to the immense volume of data that need to be extracted, processed, and analyzed in a timely fashion. Arguably the most popular framework for contemporary large-scale data analytics is MapReduce, mainly due to its salient features that include scalability, fault-tolerance, ease of programming, and flexibility. However, despite its merits, MapReduce has evident performance limitations in miscellaneous analytical tasks, and this has given rise to a significant body of research that aim at improving its efficiency, while maintaining its desirable properties. This survey aims to review the state of the art in improving the performance of parallel query processing using MapReduce. A set of the most significant weaknesses and limitations of MapReduce is discussed at a high level, along with solving techniques. A taxonomy is presented for categorizing existing research on MapReduce improvements according to the specific problem they target. Based on the proposed taxonomy, a classification of existing research is provided focusing on the optimization objective. Concluding, we outline interesting directions for future parallel data processing systems.
引用
收藏
页码:355 / 380
页数:25
相关论文
共 50 条
  • [31] Efficient large-scale data analysis using mapreduce
    Kubo, R., 1600, Nippon Telegraph and Telephone Corp. (10):
  • [32] Exploiting and Evaluating MapReduce for Large-Scale Graph Mining
    Lai, Hung-Che
    Li, Cheng-Te
    Lo, Yi-Chen
    Lin, Shou-De
    2012 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM), 2012, : 434 - 441
  • [33] Hadoop-EDF: Large-scale Distributed Processing of Electrophysiological Signal Data in Hadoop MapReduce
    Wu, Yuanyuan
    Li, Xiaojin
    Liu, Jinze
    Cui, Licong
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 2265 - 2271
  • [34] A New Efficient Resource Management Framework for Iterative MapReduce Processing in Large-Scale Data Analysis
    Hong, Seungtae
    Park, Kyongseok
    Lim, Chae-Deok
    Chang, Jae-Woo
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2017, E100D (04): : 704 - 717
  • [35] Large-scale L-BFGS using MapReduce
    Chen, Weizhu
    Wang, Zhenghao
    Zhou, Jingren
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [36] Generalization of Large-Scale Data Processing in One MapReduce Job for Coarse-Grained Parallelism
    Wu, Hsiang-Huang
    Wang, Chien-Min
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2017, 45 (04) : 797 - 826
  • [37] Interactive Rendering for Large-Scale Mesh Based on MapReduce
    Zhang, Hongxin
    Zhu, Biao
    Chen, Wei
    2013 INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN AND COMPUTER GRAPHICS (CAD/GRAPHICS), 2013, : 345 - 352
  • [38] Scalable Implementation of a MapReduce-based Graph Processing Algorithm for Large-scale Heterogeneous Supercomputers
    Shirahata, Koichi
    Sato, Hitoshi
    Suzumura, Toyotaro
    Matsuoka, Satoshi
    PROCEEDINGS OF THE 2013 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID 2013), 2013, : 277 - 284
  • [39] Improving the performance of precise query processing on large-scale nested data with UniHash index
    School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, China
    不详
    Int. J. Database Theory Appl., 1 (111-128):
  • [40] A Large-Scale Query Spelling Correction Corpus
    Hagen, Matthias
    Potthast, Martin
    Gohsen, Marcel
    Rathgeber, Anja
    Stein, Benno
    SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 1261 - 1264