Expectations of the High Performance Computing Cluster File System Selection

被引：0
|
作者：
Aladyshev, O. S. [1 ]
Shabanov, B. M. [1 ]
Zakharchenko, A. V. [1 ]
机构：
[1] Russian Acad Sci, Joint Supercomp Ctr, Sci Res Inst Syst Anal, Moscow 119334, Russia
来源：
LOBACHEVSKII JOURNAL OF MATHEMATICS | 2023年 / 44卷 / 12期
关键词：
parallel file systems; supercomputers; high performance computing; distributed locking; I/O operations;
D O I：
10.1134/S1995080223120041
中图分类号：
O1 [数学];
学科分类号：
0701 ; 070101 ;
摘要：
When constructing a high-performance computing cluster, one of the most pressing issues is ensuring efficient organization of the external storage systems. Such systems consist of both hardware and software components. The software component is a parallel file system, and consists of server and client parts. The article explores the principles of operating parallel file systems: mechanisms of data sharing between clients; metadata and data maintenance methods; as well as aspects of selecting a parallel file system for a high performance cluster computing cluster. We have had the opportunity to test some solutions on the large supercomputers of Joint Supercomputer Center of the Russian Academy of Sciences (JSCC RAS) and develop a basic model for file data flow in HPC cluster.
引用
收藏
页码：5132 / 5147
页数：16
相关论文
共 50 条
  • [1] Expectations of the High Performance Computing Cluster File System Selection
    O. S. Aladyshev
    B. M. Shabanov
    A. V. Zakharchenko
    Lobachevskii Journal of Mathematics, 2023, 44 : 5132 - 5147
  • [2] THE EDGE NODE FILE SYSTEM: A DISTRIBUTED FILE SYSTEM FOR HIGH PERFORMANCE COMPUTING
    Ponnavaikko, Kovendhan
    Janakiram, D.
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2009, 10 (01): : 115 - 130
  • [3] A High Performance Cluster File System with Standard Network File System Interface
    Lu, Jun
    Du, Bin
    Zhu, Yi
    Ren, Ly
    Li, Daiw
    2009 INTERNATIONAL FORUM ON INFORMATION TECHNOLOGY AND APPLICATIONS, VOL 1, PROCEEDINGS, 2009, : 397 - +
  • [4] Optimizing the Ceph Distributed File System for High Performance Computing
    Jeong, Kisik
    Duffy, Carl
    Kim, Jin-Soo
    Lee, Joonwon
    2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP), 2019, : 446 - 451
  • [5] Performance analysis of a cluster file system
    Du, G
    Xu, ZW
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 1933 - 1938
  • [6] Tuning a Cluster System for High Performance Computing in Engineering
    Magiera, J.
    Graniczkowski, G.
    Kapusta, P.
    PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING FOR ENGINEERING, 2009, (90): : 427 - 436
  • [7] Employing an RDMA-based file system for high performance computing
    Velusamy, V
    Skjellum, A
    Kanevsky, A
    2004 12TH IEEE INTERNATIONAL CONFERENCE ON NETWORKS, VOLS 1 AND 2 , PROCEEDINGS: UNITY IN DIVERSITY, 2004, : 66 - 70
  • [8] Implementing a global file system for high-performance Grid computing
    Andrews, P
    Kovatch, P
    Jordan, C
    GCA '05: Proceedings of the 2005 International Conference on Grid Computing and Applications, 2005, : 99 - 105
  • [9] High performance computing: Trends and expectations
    Michielse, PH
    HIGH PERFORMANCE COMPUTING IN FLUID DYNAMICS, 1996, 3 : 261 - 278
  • [10] Design and performance of the dawning cluster file system
    Xiong, J
    Wu, SN
    Meng, D
    Sun, NH
    Li, GJ
    IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, PROCEEDINGS, 2003, : 232 - 239
12345