Design of Distributed Parallel Computing Using by MapReduce/MPI Technology

被引:0
|
作者
Akhmed-Zaki, Darkhan [1 ]
Danaev, Nargozy [1 ]
Matkerim, Bazargul [1 ]
Bektemessov, Amanzhol [1 ]
机构
[1] Al Farabi Kazakh Natl Univ, Alma Ata 050040, Kazakhstan
关键词
MAPREDUCE; MPI; mpi[!text type='Java']Java[!/text; distributed parallel computing on heterogeneous systems; SYSTEM; MPI; IMPLEMENTATION; SUPPORT; WORLD; CLOUD;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper describes a constructive approach of distributed parallel computing using by hybrid union of MAPREDUCE and MPI technologies for solving oil extracting problems. We extend a common architecture of MAPREDUCE model by organizing decomposition of computational domain at different stages of MAPREDUCE process. We describes Model Driven Architecture (MDA) models for developing formal views of high-performance computing technologies using MAPREDUCE. We made computing experiments and show on specific HPC infrastructure. All implementations of programs is realize on Java platform. This approach will possible one of the ways to do cloud computing on high performance heterogeneous systems.
引用
收藏
页码:139 / 148
页数:10
相关论文
共 50 条
  • [41] Development of a Distributed Parallel Algorithm of 3D Hydrodynamic Calculation of Oil Production on the Basis of MapReduce Hadoop and MPI Technologies
    Akhmed-Zaki, Darkhan
    Mansurova, Madina
    Imankulov, Timur
    Matkerim, Bazargul
    Dadykina, Ekaterina
    PARALLEL COMPUTING TECHNOLOGIES (PACT 2015), 2015, 9251 : 498 - 504
  • [42] Computing marginals using MapReduce
    Afrati, Foto N.
    Sharma, Shantanu
    Ullman, Jonathan R.
    Ullman, Jeffrey D.
    JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2018, 94 : 98 - 117
  • [43] A Distributed Framework for Predictive Analytics Using Big Data and MapReduce Parallel Programming
    Natesan P.
    Sathishkumar V.E.
    Mathivanan S.K.
    Venkatasen M.
    Jayagopal P.
    Allayear S.M.
    Mathematical Problems in Engineering, 2023, 2023
  • [44] MapReduce distributed parallel computing framework for diagnosis and treatment of knee joint Kashin-Beck disease
    Chenpo Dang
    Guirong Yi
    Zhaomin Zhu
    Peng Zhou
    Hongbin Shao
    Yanbin Yao
    Maosheng Zhao
    Lintao Li
    Shensong Li
    The Journal of Supercomputing, 2021, 77 : 9088 - 9101
  • [45] Distributed parallel computing using windows desktop systems
    Hart, D
    Grover, D
    Liggett, M
    Repasky, R
    PROCEEDINGS OF THE INTERNATIONAL WORKSHOP ON CHALLENGES OF LARGE APPLICATIONS IN DISTRIBUTED ENVIRONMENTS, 2003, : 34 - 38
  • [46] Using Everest Platform for Teaching Parallel and Distributed Computing
    Sukhoroslov, Oleg
    EURO-PAR 2016: PARALLEL PROCESSING WORKSHOPS, 2017, 10104 : 16 - 27
  • [47] Using of Distributed and PArallel Computing (DPAC) in the manufacturing control
    Popa, Ilie
    Ghita, Constantin
    2007 30TH INTERNATIONAL SPRING SEMINAR ON ELECTRONICS TECHNOLOGY, 2007, : 314 - 319
  • [48] Using Parallel Distributed Reasoning for Monitoring Computing Networks
    Musman, S.
    MILITARY COMMUNICATIONS CONFERENCE, 2010 (MILCOM 2010), 2010, : 417 - 422
  • [49] To Solve the TDVRPTW via Hadoop MapReduce Parallel Computing
    Li, Bo-Yi
    Wang, Chen-Shu
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS (ACIIDS 2017), PT II, 2017, 10192 : 55 - 64
  • [50] Using PVM and MPI for co-processed, distributed and parallel scientific visualization
    Haimes, R
    Jordan, KE
    PARALLEL AND DISTRIBUTED PROCESSING, 1998, 1388 : 1098 - 1105