A NEW FRAMEWORK OF CLUSTER-BASED PARALLEL PROCESSING SYSTEM FOR HIGH-PERFORMANCE GEO-COMPUTING

被引:0
|
作者
Ma, Yan [1 ]
Liu, Dingsheng [1 ]
Li, Jingshan [1 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100086, Peoples R China
关键词
high-performance computing; geo-computing; remote sensing image processing; system framework; parallel file system; parallel programming model;
D O I
暂无
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Up to now, It still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges To properly settle these main issues above, a new system framework for high performance gco-computing is presented in this paper A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
引用
收藏
页码:2429 / 2432
页数:4
相关论文
共 50 条
  • [21] A HIGH-PERFORMANCE PARALLEL COMPUTING FRAMEWORK FOR UNCERTAINTY QUANTIFICATION ANALYSIS OF RF DEVICES
    Stantchev, George
    Cooke, Simon
    Elliott, Kyle
    Petillo, John
    2017 IEEE INTERNATIONAL CONFERENCE ON PLASMA SCIENCE (ICOPS), 2017,
  • [22] A HIGH-PERFORMANCE PARALLEL COMPUTING FRAMEWORK FOR UNCERTAINTY QUANTIFICATION ANALYSIS OF RF DEVICES
    Stantchev, George
    Cooke, Simon
    Elliott, Kyle
    Petillo, John
    2017 IEEE INTERNATIONAL CONFERENCE ON PLASMA SCIENCE (ICOPS), 2017,
  • [23] Queuing network modeling of a cluster-based parallel system
    Javadi, B
    Khorsandi, S
    Akbari, MK
    SEVENTH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND GRID IN ASIA PACIFIC REGION, PROCEEDINGS, 2004, : 304 - 307
  • [24] Parallel colt: A high-performance java library for scientific computing and image processing
    Wendykier, Piotr
    Nagy, James G.
    ACM Transactions on Mathematical Software, 2010, 37 (03):
  • [25] Implementation of a Cluster-Based Heterogeneous Edge Computing System for Resource Monitoring and Performance Evaluation
    Chan, Yu-Wei
    Fathoni, Halim
    Yen, Hao-Yi
    Yang, Chao-Tung
    IEEE ACCESS, 2022, 10 : 38458 - 38471
  • [26] PARALLEL PROCESSING MEANS HIGH-PERFORMANCE
    THURBER, KJ
    DATA MANAGEMENT, 1979, 17 (01): : 40 - 44
  • [27] A linux cluster-based parallel I/O system for high performance and out-of-core volume rendering
    Jeong, KJ
    Kim, JI
    Kim, NK
    Kim, JH
    Ryu, YJ
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 2319 - 2324
  • [28] Design and Performance Measurement of a High-Performance Computing Cluster
    George, Kiran
    Venugopal, Vivek
    2012 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2012, : 2531 - 2536
  • [29] Commodity Cluster Using Single System Image Based on Linux/Kerrighed for High-Performance Computing
    Setiawan, Iwan
    Murdyantoro, Eko
    2016 3RD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, COMPUTER, AND ELECTRICAL ENGINEERING (ICITACEE), 2016, : 367 - 372
  • [30] High-performance parallel bio-computing
    Huang, CH
    PARALLEL COMPUTING, 2004, 30 (9-10) : 999 - 1000