A survey of large-scale analytical query processing in MapReduce

被引:0
|
作者
Christos Doulkeridis
Kjetil Nørvåg
机构
[1] University of Piraeus,Department of Digital Systems
[2] Norwegian University of Science and Technology,Department of Computer and Information Science
来源
The VLDB Journal | 2014年 / 23卷
关键词
MapReduce; Survey; Data analysis; Query processing; Large-scale; Big Data;
D O I
暂无
中图分类号
学科分类号
摘要
Enterprises today acquire vast volumes of data from different sources and leverage this information by means of data analysis to support effective decision-making and provide new functionality and services. The key requirement of data analytics is scalability, simply due to the immense volume of data that need to be extracted, processed, and analyzed in a timely fashion. Arguably the most popular framework for contemporary large-scale data analytics is MapReduce, mainly due to its salient features that include scalability, fault-tolerance, ease of programming, and flexibility. However, despite its merits, MapReduce has evident performance limitations in miscellaneous analytical tasks, and this has given rise to a significant body of research that aim at improving its efficiency, while maintaining its desirable properties. This survey aims to review the state of the art in improving the performance of parallel query processing using MapReduce. A set of the most significant weaknesses and limitations of MapReduce is discussed at a high level, along with solving techniques. A taxonomy is presented for categorizing existing research on MapReduce improvements according to the specific problem they target. Based on the proposed taxonomy, a classification of existing research is provided focusing on the optimization objective. Concluding, we outline interesting directions for future parallel data processing systems.
引用
收藏
页码:355 / 380
页数:25
相关论文
共 50 条
  • [1] A survey of large-scale analytical query processing in MapReduce
    Doulkeridis, Christos
    Norvag, Kjetil
    VLDB JOURNAL, 2014, 23 (03): : 355 - 380
  • [2] Large-scale incremental processing with MapReduce
    Lee, Daewoo
    Kim, Jin-Soo
    Maeng, Seungryoul
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2014, 36 : 66 - 79
  • [3] Large-scale data modeling in Hive and distributed query processing using Mapreduce and Tez
    Adamov, Abzetdin
    DIVAI 2018: 12TH INTERNATIONAL SCIENTIFIC CONFERENCE ON DISTANCE LEARNING IN APPLIED INFORMATICS, 2018, : 389 - 404
  • [4] The Survey of Large-scale Query Classification
    Zhou, Sanduo
    Cheng, Kefei
    Men, Lijun
    2017 5TH INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN, MANUFACTURING, MODELING AND SIMULATION (CDMMS 2017), 2017, 1834
  • [5] Review of large-scale RDF data processing in mapreduce
    Hou, Ke
    Zhang, Ming
    Fang, Xing
    Journal of Software Engineering, 2015, 9 (01): : 195 - 202
  • [6] The Family of MapReduce and Large-Scale Data Processing Systems
    Sakr, Sherif
    Liu, Anna
    Fayoumi, Ayman G.
    ACM COMPUTING SURVEYS, 2013, 46 (01)
  • [7] RESEARCH BASED ON LARGE-SCALE DATA QUERY WITH MAPREDUCE TECHNOLOGY IN CLOUD COMPUTING
    Wang, Feiping
    Gu, Xiaofeng
    2012 INTERNATIONAL CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (LCWAMTIP), 2012, : 243 - 245
  • [8] Incremental Techniques for Large-Scale Dynamic Query Processing
    Elghandour, Iman
    Kara, Ahmet
    Olteanu, Dan
    Vansummeren, Stijn
    CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 2297 - 2298
  • [9] Complex query processing in large-scale distributed system
    Zhou, Ao-Ying
    Zhou, Min-Qi
    Qian, Wei-Ning
    Zhang, Rong
    Jisuanji Xuebao/Chinese Journal of Computers, 2008, 31 (09): : 1563 - 1572
  • [10] Large-Scale Spatial Join Query Processing in Cloud
    You, Simin
    Zhang, Jianting
    Gruenwald, Le
    2015 13TH IEEE INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW), 2015, : 34 - 41