Expectations of the High Performance Computing Cluster File System Selection

被引：0
|
作者：
Aladyshev, O. S. [1 ]
Shabanov, B. M. [1 ]
Zakharchenko, A. V. [1 ]
机构：
[1] Russian Acad Sci, Joint Supercomp Ctr, Sci Res Inst Syst Anal, Moscow 119334, Russia
来源：
LOBACHEVSKII JOURNAL OF MATHEMATICS | 2023年 / 44卷 / 12期
关键词：
parallel file systems; supercomputers; high performance computing; distributed locking; I/O operations;
D O I：
10.1134/S1995080223120041
中图分类号：
O1 [数学];
学科分类号：
0701 ; 070101 ;
摘要：
When constructing a high-performance computing cluster, one of the most pressing issues is ensuring efficient organization of the external storage systems. Such systems consist of both hardware and software components. The software component is a parallel file system, and consists of server and client parts. The article explores the principles of operating parallel file systems: mechanisms of data sharing between clients; metadata and data maintenance methods; as well as aspects of selecting a parallel file system for a high performance cluster computing cluster. We have had the opportunity to test some solutions on the large supercomputers of Joint Supercomputer Center of the Russian Academy of Sciences (JSCC RAS) and develop a basic model for file data flow in HPC cluster.
引用
收藏
页码：5132 / 5147
页数：16
相关论文
共 50 条
  • [41] RABL - A High Performance Run-time Active Block Layout Mechanism for Cluster File System
    Lu, Jun
    Zhu, Yi
    Du, Bin
    Ren, Liyong
    ICCSSE 2009: PROCEEDINGS OF 2009 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION, 2009, : 1953 - +
  • [42] Performance Evaluation and Tuning for MapReduce Computing in Hadoop Distributed File System
    Kim, Jongyeop
    Kumar, Ashwin T. K.
    George, K. M.
    Park, Nohpill
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2015, : 62 - 68
  • [43] High Performance Computing Cluster System and its Future Aspects in Processing Big Data
    Reddy, Kishor Kumar C.
    Chandrudu, Bala K. E.
    Anisha, P. R.
    Raju, G. V. S.
    2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 881 - 885
  • [44] Policy of file migration at server in cluster file system
    Shu, JW
    Wang, B
    Zheng, WM
    Deng, YY
    2004 IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID - CCGRID 2004, 2004, : 691 - 698
  • [45] Dependable high performance computing on a parallel Sysplex Cluster
    Blochinger, W
    Bündgen, R
    Heinemann, A
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 1627 - 1633
  • [46] Hybrid Parallel Programming in High Performance Computing Cluster
    Fedulov, Alexander
    Fedulova, Anastasiya
    Fedulov, Yaroslav
    THEORY AND ENGINEERING OF DEPENDABLE COMPUTER SYSTEMS AND NETWORKS, DEPCOS-RELCOMEX 2021, 2021, 1389 : 97 - 105
  • [47] A High Performance Computing Method of Linux Cluster's
    Wang HaiTao
    Chang ChunQin
    ISIP: 2009 INTERNATIONAL SYMPOSIUM ON INFORMATION PROCESSING, PROCEEDINGS, 2009, : 83 - +
  • [48] A file system for system programming in ubiquitous computing
    Decker, Christian
    Riedel, Till
    Beigl, Michael
    Krohn, Albert
    PERSONAL AND UBIQUITOUS COMPUTING, 2007, 11 (01) : 21 - 31
  • [49] A file system for system programming in ubiquitous computing
    Christian Decker
    Till Riedel
    Michael Beigl
    Albert Krohn
    Personal and Ubiquitous Computing, 2007, 11 : 21 - 31
  • [50] A file system for system programming in ubiquitous computing
    Decker, C
    Beigl, M
    Krohn, A
    SYSTEMS ASPECTS IN ORGANIC AND PERVASIVE COMPUTING - ARCS 2005, PROCEEDINGS, 2005, 3432 : 249 - 264
12345