Design of Distributed Parallel Computing Using by MapReduce/MPI Technology

被引:0
|
作者
Akhmed-Zaki, Darkhan [1 ]
Danaev, Nargozy [1 ]
Matkerim, Bazargul [1 ]
Bektemessov, Amanzhol [1 ]
机构
[1] Al Farabi Kazakh Natl Univ, Alma Ata 050040, Kazakhstan
关键词
MAPREDUCE; MPI; mpi[!text type='Java']Java[!/text; distributed parallel computing on heterogeneous systems; SYSTEM; MPI; IMPLEMENTATION; SUPPORT; WORLD; CLOUD;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes a constructive approach of distributed parallel computing using by hybrid union of MAPREDUCE and MPI technologies for solving oil extracting problems. We extend a common architecture of MAPREDUCE model by organizing decomposition of computational domain at different stages of MAPREDUCE process. We describes Model Driven Architecture (MDA) models for developing formal views of high-performance computing technologies using MAPREDUCE. We made computing experiments and show on specific HPC infrastructure. All implementations of programs is realize on Java platform. This approach will possible one of the ways to do cloud computing on high performance heterogeneous systems.
引用
收藏
页码:139 / 148
页数:10
相关论文
共 50 条
  • [31] The DFrame: Parallel programming using a distributed framework implemented in MPI.
    Mclay, Tony
    Hoppe, Andreas
    Greenhill, Darrel R.
    Khaddaj, Souheil
    2013 12TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS TO BUSINESS, ENGINEERING & SCIENCE (DCABES), 2013, : 21 - 25
  • [32] Software for parallel computing: The LAM implementation of MPI
    Swann, CA
    JOURNAL OF APPLIED ECONOMETRICS, 2001, 16 (02) : 185 - 194
  • [33] Parallel computing of kernel density estimates with MPI
    Lukasik, Szymon
    COMPUTATIONAL SCIENCE - ICCS 2007, PT 3, PROCEEDINGS, 2007, 4489 : 726 - 733
  • [34] Performance of parallel distributed bat algorithm using MPI on a PC cluster
    Noor F.
    Ibrahim A.
    Alkhattab M.M.
    Noor, Fazal (mfnoor@gmail.com), 1600, International Association for Educators and Researchers (IAER) (04): : 19 - 27
  • [35] Ch MPI: Interpretive Parallel Computing in C
    Chou, Yu-Cheng
    Nestinger, Stephen S.
    Cheng, Harry H.
    COMPUTING IN SCIENCE & ENGINEERING, 2010, 12 (02) : 54 - 67
  • [36] New TNT routines for parallel computing with MPI
    Morales, Martin E.
    Goloboff, Pablo A.
    MOLECULAR PHYLOGENETICS AND EVOLUTION, 2023, 178
  • [37] From distributed sequential computing to distributed parallel computing
    Pan, L
    Bic, LF
    Dillencourt, MB
    Lai, MK
    2003 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING WORKSHOPS, PROCEEDINGS, 2003, : 255 - 262
  • [38] A quantum computing simulator scheme using MPI technology on cloud platform
    Huang, Zhiguo
    Qian, Ling
    Cai, Dunbo
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 752 - 754
  • [39] Research and Preliminary Realization of Parallel Computing Technology of Yellow River Mathematical Model Based on MPI
    Ming, Yang
    Xin, Yu
    Ming, Wang
    2011 2ND INTERNATIONAL CONFERENCE ON CHALLENGES IN ENVIRONMENTAL SCIENCE AND COMPUTER ENGINEERING (CESCE 2011), VOL 11, PT B, 2011, 11 : 934 - 938
  • [40] MapReduce distributed parallel computing framework for diagnosis and treatment of knee joint Kashin-Beck disease
    Dang, Chenpo
    Yi, Guirong
    Zhu, Zhaomin
    Zhou, Peng
    Shao, Hongbin
    Yao, Yanbin
    Zhao, Maosheng
    Li, Lintao
    Li, Shensong
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (08): : 9088 - 9101