A survey of large-scale analytical query processing in MapReduce

被引:0
|
作者
Christos Doulkeridis
Kjetil Nørvåg
机构
[1] University of Piraeus,Department of Digital Systems
[2] Norwegian University of Science and Technology,Department of Computer and Information Science
来源
The VLDB Journal | 2014年 / 23卷
关键词
MapReduce; Survey; Data analysis; Query processing; Large-scale; Big Data;
D O I
暂无
中图分类号
学科分类号
摘要
Enterprises today acquire vast volumes of data from different sources and leverage this information by means of data analysis to support effective decision-making and provide new functionality and services. The key requirement of data analytics is scalability, simply due to the immense volume of data that need to be extracted, processed, and analyzed in a timely fashion. Arguably the most popular framework for contemporary large-scale data analytics is MapReduce, mainly due to its salient features that include scalability, fault-tolerance, ease of programming, and flexibility. However, despite its merits, MapReduce has evident performance limitations in miscellaneous analytical tasks, and this has given rise to a significant body of research that aim at improving its efficiency, while maintaining its desirable properties. This survey aims to review the state of the art in improving the performance of parallel query processing using MapReduce. A set of the most significant weaknesses and limitations of MapReduce is discussed at a high level, along with solving techniques. A taxonomy is presented for categorizing existing research on MapReduce improvements according to the specific problem they target. Based on the proposed taxonomy, a classification of existing research is provided focusing on the optimization objective. Concluding, we outline interesting directions for future parallel data processing systems.
引用
收藏
页码:355 / 380
页数:25
相关论文
共 50 条
  • [21] Large-Scale Frequent Subgraph Mining in MapReduce
    Lin, Wenqing
    Xiao, Xiaokui
    Ghinita, Gabriel
    2014 IEEE 30TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2014, : 844 - 855
  • [22] Large-scale Neural Modeling in MapReduce and Giraph
    Yang, Shuo
    Spielman, Nicholas D.
    Jackson, Jadin C.
    Rubin, Brad S.
    2014 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY (EIT), 2014, : 556 - 561
  • [23] GCMR: A GPU Cluster-based MapReduce Framework for Large-scale Data Processing
    Guo, Yiru
    Liu, Weiguo
    Gong, Bin
    Voss, Gerrit
    Mueller-Wittig, Wolfgang
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 580 - 586
  • [24] A Survey of Traditional and MapReduce-Based Spatial Query Processing Approaches
    Singh, Hari
    Bawa, Seema
    SIGMOD RECORD, 2017, 46 (02) : 18 - 29
  • [25] Lightweight Distributed Execution Engine for Large-Scale Spatial Join Query Processing
    Zhang, Jianting
    You, Simin
    Gruenwald, Le
    2015 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2015, 2015, : 150 - 157
  • [26] A research agenda for query processing in large-scale Peer Data Management Systems
    Hose, Katja
    Roth, Armin
    Zeitz, Andre
    Sattler, Kai-Uwe
    Naumann, Felix
    INFORMATION SYSTEMS, 2008, 33 (7-8) : 597 - 610
  • [27] Large Scale, Complex Processing of Health Data with MapReduce
    Nguyen, Khanh Luan P.
    Ashish, Naveen
    JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT, 2014, 13 (01)
  • [28] Mining large-scale repetitive sequences in a MapReduce setting
    Cao, Hongfei
    Phinney, Michael
    Petersohn, Devin
    Merideth, Benjamin
    Shyu, Chi-Ren
    INTERNATIONAL JOURNAL OF DATA MINING AND BIOINFORMATICS, 2016, 14 (03) : 210 - 228
  • [29] Generalization of Large-Scale Data Processing in One MapReduce Job for Coarse-Grained Parallelism
    Hsiang-Huang Wu
    Chien-Min Wang
    International Journal of Parallel Programming, 2017, 45 : 797 - 826
  • [30] Efficient Large-scale Trace Checking Using MapReduce
    Bersani, Marcello M.
    Bianculli, Domenico
    Ghezzi, Carlo
    Krstic, Srdan
    San Pietro, Pierluigi
    2016 IEEE/ACM 38TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2016, : 888 - 898