A NEW FRAMEWORK OF CLUSTER-BASED PARALLEL PROCESSING SYSTEM FOR HIGH-PERFORMANCE GEO-COMPUTING

被引:0
|
作者
Ma, Yan [1 ]
Liu, Dingsheng [1 ]
Li, Jingshan [1 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100086, Peoples R China
关键词
high-performance computing; geo-computing; remote sensing image processing; system framework; parallel file system; parallel programming model;
D O I
暂无
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Up to now, It still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges To properly settle these main issues above, a new system framework for high performance gco-computing is presented in this paper A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
引用
收藏
页码:2429 / 2432
页数:4
相关论文
共 50 条
  • [31] Prototype Design of a Cluster-based MPSoC Architecture for Parallel video Processing
    Zhang, Lei
    Li, Da
    2011 INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND NEURAL COMPUTING (FSNC 2011), VOL I, 2011, : 314 - 317
  • [32] Parallel Soft Computing Techniques in High-Performance Computing Systems
    Dorronsoro, Bernabe
    Nesmachnow, Sergio
    COMPUTER JOURNAL, 2016, 59 (06): : 775 - 776
  • [33] Dependable high performance computing on a parallel Sysplex Cluster
    Blochinger, W
    Bündgen, R
    Heinemann, A
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 1627 - 1633
  • [34] Hybrid Parallel Programming in High Performance Computing Cluster
    Fedulov, Alexander
    Fedulova, Anastasiya
    Fedulov, Yaroslav
    THEORY AND ENGINEERING OF DEPENDABLE COMPUTER SYSTEMS AND NETWORKS, DEPCOS-RELCOMEX 2021, 2021, 1389 : 97 - 105
  • [35] Parallel Colt: A High-Performance Java']Java Library for Scientific Computing and Image Processing
    Wendykier, Piotr
    Nagy, James G.
    ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2010, 37 (03):
  • [36] High-Performance Real-Time Bus in Parallel Processing System
    Cheng Xin
    Wu Huachun
    ADVANCES IN MECHATRONICS AND CONTROL ENGINEERING, PTS 1-3, 2013, 278-280 : 1043 - 1046
  • [37] High-Performance Computing with Quantum Processing Units
    Britt, Keith A.
    Humble, Travis S.
    ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2017, 13 (03)
  • [38] High-Performance Computing for Big Data Processing
    Wu, Yulei
    Xiang, Yang
    Ge, Jingguo
    Muller, Peter
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 88 : 693 - 695
  • [39] High availability management for parallel computing in cluster system
    Chang, Yu-Fang
    Yang, Sheng-Chun
    Liu, Tian-Tian
    Ou, Zhong-Hong
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2009, 41 (SUPPL. 1): : 11 - 15
  • [40] A high performance and low cost cluster-based e-mail system
    Jeun, WC
    Kee, YS
    Kim, JS
    Ha, SH
    PARALLEL COMPUTING TECHNOLOGIES, PROCEEDINGS, 2003, 2763 : 482 - 496