A NEW FRAMEWORK OF CLUSTER-BASED PARALLEL PROCESSING SYSTEM FOR HIGH-PERFORMANCE GEO-COMPUTING

被引:0
|
作者
Ma, Yan [1 ]
Liu, Dingsheng [1 ]
Li, Jingshan [1 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100086, Peoples R China
关键词
high-performance computing; geo-computing; remote sensing image processing; system framework; parallel file system; parallel programming model;
D O I
暂无
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Up to now, It still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges To properly settle these main issues above, a new system framework for high performance gco-computing is presented in this paper A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
引用
收藏
页码:2429 / 2432
页数:4
相关论文
共 50 条
  • [1] Parallel language processing system for high-performance computing
    Yamanaka, E
    Shindo, T
    FUJITSU SCIENTIFIC & TECHNICAL JOURNAL, 1997, 33 (01): : 39 - 51
  • [2] Parallel language processing system for high-performance computing
    Yamanaka, Eiji
    Shindo, Tatsuya
    Fujitsu Scientific and Technical Journal, 1997, 33 (01): : 39 - 51
  • [3] Special task scheduling and control of cluster parallel computing for high-performance ground processing system
    Zhang, Wanjun
    Liu, Dingsheng
    Li, Guoqing
    Zhang, Wenyi
    COMPUTATIONAL SCIENCE - ICCS 2006, PT 3, PROCEEDINGS, 2006, 3993 : 17 - 23
  • [4] Impact of a high-performance communication network on cluster-based parallel iterative reconstruction
    Jones, Judson P.
    Jones, William F.
    Everman, Jim
    Panin, Vladimir
    Michel, Christian
    Kehren, Frank
    Bao, Jun
    Young, John
    Casey, Michael E.
    2005 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2005, : 2273 - 2277
  • [5] Deployment of parallel computing in a hybrid high-performance cluster based on virtualization technologies
    Volovich, K., I
    Denisov, S. A.
    Malkovsky, S., I
    14TH INTERNATIONAL SYMPOSIUM INTELLIGENT SYSTEMS, 2021, 186 : 40 - 47
  • [6] Accelerating single molecule localization microscopy through parallel processing on a high-performance computing cluster
    Munro, I.
    Garcia, E.
    Yan, M.
    Guldbrand, S.
    Kumar, S.
    Kwakwa, K.
    Dunsby, C.
    Neil, M. A. A.
    French, P. M. W.
    JOURNAL OF MICROSCOPY, 2019, 273 (02) : 148 - 160
  • [7] A High-Performance Parallel Approach to Image Processing in Distributed Computing
    Rakhimov, Mekhriddin
    Mamadjanov, Doniyor
    Mukhiddinov, Abulkosim
    2020 IEEE 14TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT2020), 2020,
  • [8] Teaching high-performance computing on a high-performance cluster
    Bernreuther, M
    Brenk, M
    Bungartz, HJ
    Mundani, RP
    Muntean, IL
    COMPUTATIONAL SCIENCE - ICCS 2005, PT 2, 2005, 3515 : 1 - 9
  • [9] A Parallel Neuromorphic Text Recognition System and Its Implementation on a Heterogeneous High-Performance Computing Cluster
    Qiu, Qinru
    Wu, Qing
    Bishop, Morgan
    Pino, Robinson E.
    Linderman, Richard W.
    IEEE TRANSACTIONS ON COMPUTERS, 2013, 62 (05) : 886 - 899
  • [10] Commodity cluster-based parallel processing of hyperspectral imagery
    Plaza, A
    Valencia, D
    Plaza, J
    Martinez, P
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2006, 66 (03) : 345 - 358