Design of Distributed Parallel Computing Using by MapReduce/MPI Technology

被引:0
|
作者
Akhmed-Zaki, Darkhan [1 ]
Danaev, Nargozy [1 ]
Matkerim, Bazargul [1 ]
Bektemessov, Amanzhol [1 ]
机构
[1] Al Farabi Kazakh Natl Univ, Alma Ata 050040, Kazakhstan
关键词
MAPREDUCE; MPI; mpi[!text type='Java']Java[!/text; distributed parallel computing on heterogeneous systems; SYSTEM; MPI; IMPLEMENTATION; SUPPORT; WORLD; CLOUD;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes a constructive approach of distributed parallel computing using by hybrid union of MAPREDUCE and MPI technologies for solving oil extracting problems. We extend a common architecture of MAPREDUCE model by organizing decomposition of computational domain at different stages of MAPREDUCE process. We describes Model Driven Architecture (MDA) models for developing formal views of high-performance computing technologies using MAPREDUCE. We made computing experiments and show on specific HPC infrastructure. All implementations of programs is realize on Java platform. This approach will possible one of the ways to do cloud computing on high performance heterogeneous systems.
引用
收藏
页码:139 / 148
页数:10
相关论文
共 50 条
  • [1] A High Performance MPI for Parallel and Distributed Computing
    Prabu, D.
    Vanamala, V.
    Deka, Sanjeeb Kumar
    Sridharan, R.
    Prahlada, Rao B. B.
    Mohanrarn, N.
    PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 17, 2006, 17 : 310 - 313
  • [2] ClustalW-MPI: ClustalW analysis using distributed and parallel computing
    Li, KB
    BIOINFORMATICS, 2003, 19 (12) : 1585 - 1586
  • [3] Modules to teach parallel and distributed computing using MPI for Python']Python and Disco
    Ortiz-Ubarri, Jose
    Arce-Nazario, Rafael
    Orozco, Edusmildo
    2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2016, : 958 - 962
  • [4] Parallel Distributed Acceleration Based on MPI and OpenMP Technology
    Liu, Feng
    Wu, Haitao
    Lu, Xiaochun
    Liu, Xiyang
    INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2015, 8 (06): : 171 - 183
  • [5] Teaching Parallel and Distributed Computing with MPI on Raspberry Pi Clusters
    Brown, Richard
    Adams, Joel
    Matthews, Suzanne
    Shoop, Elizabeth
    SIGCSE'18: PROCEEDINGS OF THE 49TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, 2018, : 1054 - 1054
  • [6] Distributed Generation Placement Design and Contingency Analysis with Parallel Computing Technology
    Gao, Wenzhong
    Chen, Xi
    JOURNAL OF COMPUTERS, 2009, 4 (04) : 347 - 354
  • [7] Distributed media indexing based on MPI and MapReduce
    Mohamed, Hisham
    Marchand-Maillet, Stephane
    MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 69 (02) : 513 - 537
  • [8] Distributed media indexing based on MPI and MapReduce
    Hisham Mohamed
    Stéphane Marchand-Maillet
    Multimedia Tools and Applications, 2014, 69 : 513 - 537
  • [9] Big data mining with parallel computing: A comparison of distributed and MapReduce methodologies
    Tsai, Chih-Fong
    Lin, Wei-Chao
    Ke, Shih-Wen
    JOURNAL OF SYSTEMS AND SOFTWARE, 2016, 122 : 83 - 92
  • [10] A distributed computing environment for genetic programming using MPI
    Fernández, F
    Tomassini, M
    Vanneschi, L
    Bucher, L
    RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2000, 1908 : 322 - 329