Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData

被引：0
|
作者：
Prabhu, Swathi [1 ]
Rodrigues, Anisha P. [1 ]
Prasad, Guru M. S. [2 ]
Nagesh, H. R. [3 ]
机构：
[1] NMAMIT, Dept CSE, Nitte, India
[2] SDMIT, Dept CSE, Ujire, India
[3] MITE, Dept CSE, Moodabidri, India
来源：
2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES | 2015年
关键词：
BigData; Hadoop; MapReduce; Peiformance; Baseline system;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this BigData era processing and analyzing the data is very important and tedious job. An open source framework called Hadoop, implementation of MapReduce provides efficient platform for BigData analytics. The performance of Hadoop MapReduce mainly depends on its configuration parameters. Tuning the job configuration parameters is an effective way to improve performance so that we can reduce the execution time and the disk utilization. The performance tuning mainly based on CPU usage, disk I/O rate, memory usage, network traffic components. In this paper we are discussing the tuning methods to enhance the performance of MapReduce jobs. From our experiment we can say that performance has improved by 32.97% over the baseline system.
引用
收藏
页数：7
相关论文
共 50 条
  • [41] Performance optimization for short job execution in Hadoop MapReduce
    Gu, Rong
    Yan, Jinshuang
    Yang, Xiaoliang
    Yuan, Chunfeng
    Huang, Yihua
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2014, 51 (06): : 1270 - 1280
  • [42] Mapreduce performance model for Hadoop 2.x
    Glushkova, Dada
    Jovanovic, Petar
    Abello, Alberto
    INFORMATION SYSTEMS, 2019, 79 : 32 - 43
  • [43] Performance Modeling for RDMA-Enhanced Hadoop MapReduce
    Wasi-ur-Rahman, Md.
    Lu, Xiaoyi
    Islam, Nusrat Sharmin
    Panda, Dhabaleswar K.
    2014 43RD INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP), 2014, : 50 - 59
  • [44] Performance Optimization for Short MapReduce Job Execution in Hadoop
    Yan, Jinshuang
    Yang, Xiaoliang
    Gu, Rong
    Yuan, Chunfeng
    Huang, Yihua
    SECOND INTERNATIONAL CONFERENCE ON CLOUD AND GREEN COMPUTING / SECOND INTERNATIONAL CONFERENCE ON SOCIAL COMPUTING AND ITS APPLICATIONS (CGC/SCA 2012), 2012, : 688 - 694
  • [45] Analyzing fault tolerance mechanism of Hadoop Mapreduce under different type of failures
    Yassir, Samadi
    Mostapha, Zbakh
    Tadonki, Claude
    2018 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGIES AND APPLICATIONS (CLOUDTECH), 2018,
  • [46] Bigdata clustering and classification with improved fuzzy based deep architecture under MapReduce framework
    Sakthi, Vishnu D.
    Valarmathi, V.
    Surya, V
    Karthikeyan, A.
    Malathi, E.
    INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2024, 18 (02): : 1511 - 1540
  • [47] An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics
    Taylor, Ronald C.
    BMC BIOINFORMATICS, 2010, 11
  • [48] MapReduce model for efficient image retrieval: a Hadoop-based framework
    Maher Alrahhal
    Vinod Kumar Shukla
    International Journal of Information Technology, 2025, 17 (2) : 925 - 939
  • [49] Research on Power System Harmonic Detection based on Hadoop MapReduce Framework
    Chen Wenjuan
    Chen Shihua
    Wang Zheqiang
    Li Mengjie
    Zhou Yuan
    2018 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED), 2018, : 431 - 435
  • [50] ST-Hadoop: A MapReduce Framework for Spatio-Temporal Data
    Alarabi, Louai
    Mokbel, Mohamed F.
    Musleh, Mashaal
    ADVANCES IN SPATIAL AND TEMPORAL DATABASES, SSTD 2017, 2017, 10411 : 84 - 104
12345