A NEW FRAMEWORK OF CLUSTER-BASED PARALLEL PROCESSING SYSTEM FOR HIGH-PERFORMANCE GEO-COMPUTING

被引:0
|
作者
Ma, Yan [1 ]
Liu, Dingsheng [1 ]
Li, Jingshan [1 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100086, Peoples R China
关键词
high-performance computing; geo-computing; remote sensing image processing; system framework; parallel file system; parallel programming model;
D O I
暂无
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Up to now, It still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges To properly settle these main issues above, a new system framework for high performance gco-computing is presented in this paper A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
引用
收藏
页码:2429 / 2432
页数:4
相关论文
共 50 条
  • [41] Pool-based anonymous communication framework for high-performance computing
    Tran, Minh-Triet
    Nguyen, Thanh-Trung
    Duong, Anh-Duc
    Echizen, Isao
    JOURNAL OF SUPERCOMPUTING, 2011, 55 (02): : 246 - 268
  • [42] Pool-based anonymous communication framework for high-performance computing
    Minh-Triet Tran
    Thanh-Trung Nguyen
    Anh-Duc Duong
    Isao Echizen
    The Journal of Supercomputing, 2011, 55 : 246 - 268
  • [43] A HIGH-PERFORMANCE RECONFIGURABLE PARALLEL PROCESSING ARCHITECTURE
    SHIVELY, RR
    MORGAN, EB
    COPLEY, TW
    GORIN, AL
    PROCEEDINGS : SUPERCOMPUTING 89, 1989, : 505 - 509
  • [44] High-performance XML modeling of parallel queries based on MapReduce framework
    Kunfang Song
    Hongwei Lu
    Cluster Computing, 2016, 19 : 1975 - 1986
  • [45] High-performance XML modeling of parallel queries based on MapReduce framework
    Song, Kunfang
    Lu, Hongwei
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2016, 19 (04): : 1975 - 1986
  • [46] Teaching high-performance service in a cluster computing course
    Lopez, Pedro
    Baydal, Elvira
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2018, 117 : 138 - 147
  • [47] Building a high-performance computing cluster using FreeBSD
    Davis, B
    AuYeung, M
    Green, G
    Lee, C
    USENIX ASSOCIATION PROCEEDINGS OF BSDCON '03, 2003, : 35 - 46
  • [48] Plug-and-play cluster computing: High-performance computing for the mainstream
    Dauger, DE
    Decyk, VK
    COMPUTING IN SCIENCE & ENGINEERING, 2005, 7 (02) : 27 - 33
  • [49] Comparison of genomes using high-performance parallel computing
    Almeida, NF
    Alves, CER
    Caceres, EN
    Song, SW
    15TH SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING, PROCEEDINGS, 2003, : 142 - 148
  • [50] High-performance parallel computing for incompressible flow simulations
    O. Byrde
    W. Couzy
    M. O. Deville
    M. L. Sawley
    Computational Mechanics, 1999, 23 : 98 - 107