AMPO: Algorithm for MapReduce Performance Optimization for Enhancing Big Data Analytics

被引:0
|
作者
Yambem, Nandita [1 ]
Nandakumar, A. N. [2 ]
机构
[1] Vemana IT, ISE Dept, VTU RRC, Bangalore, Karnataka, India
[2] GSSSIETW, Dept CSE, Mysuru, Karnataka, India
关键词
Hadoop; Map Reduce; Optimization; Big Data Analytics; Cloud;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The usage of cloud computing has lead to generation of petabytes of data just in a matter of second, which required a pivotal attention for analysis along with the storage. Although, storage issues in cloud has been solved to a large extent, but performing distributed analytical operation over the cloud is still a bigger challenge. The frequently used Hadoop MapReduce can perform distributed process modeling and inspite of its advantages, its pitfalls overshadow its potential advantageous features in terms of optimization. Hence, this paper presents a technique called as Algorithm for MapReduce Performance Optimization or AMPO for enhancing the performance of big data analytics. An analytical research methodology was adopted considering a case study of larger size traffic data to find that AMPO offers faster response time and lowered cost of resources as compared to the conventional MapReduce Programs without eliminating its major mapping and reducer operations.
引用
收藏
页码:717 / 723
页数:7
相关论文
共 50 条
  • [31] Big Data, Big Data Analytics Capability, and Sustainable Innovation Performance
    Hao, Shengbin
    Zhang, Haili
    Song, Michael
    SUSTAINABILITY, 2019, 11 (24)
  • [32] A Paralleled Big Data Algorithm with MapReduce Framework for Mining Twitter Data
    Li Bing
    Chan, Keith C. C.
    2014 IEEE FOURTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING (BDCLOUD), 2014, : 121 - 128
  • [33] Optimization algorithm of power system line loss management using big data analytics
    Li, Yang
    Zhang, Danhong
    Tang, Ming
    Energy Informatics, 2024, 7 (01)
  • [34] Performance Evaluation of Big Data Frameworks: MapReduce and Spark
    Singh, Jaspreet
    Panda, S. N.
    Kaushal, Rajesh
    INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 : 1611 - 1619
  • [35] PARALLEL KNOWLEDGE ACQUISITION ALGORITHM FOR BIG DATA USING MAPREDUCE
    Qian, Jin
    Xia, Min
    Lv, Ping
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL. 1, 2015, : 316 - 321
  • [36] Incremental attribute reduction algorithm for big data using MapReduce
    Lv, Ping
    Qian, Jin
    Yue, Xiaodong
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2016, 16 (03) : 641 - 652
  • [37] Optimization Driven MapReduce Framework for Indexing and Retrieval of Big Data
    Abdalla, Hemn Barzan
    Ahmed, Awder Mohammed
    Al Sibahee, M. A.
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (05): : 1886 - 1908
  • [38] The optimization for recurring queries in big data analysis system with MapReduce
    Zhang, Bin
    Wang, Xiaoyang
    Zheng, Zhigao
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 : 549 - 556
  • [39] Big Data Analytics, Firm Size, and Performance
    Conti, Raffaele
    de Matos, Miguel Godinho
    Valentini, Giovanni
    STRATEGY SCIENCE, 2024, 9 (02)
  • [40] A Performance Study of Big Data Analytics Platforms
    Pirzadeh, Pouria
    Carey, Michael
    Westmann, Till
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2911 - 2920