Expectations of the High Performance Computing Cluster File System Selection

被引：0
|
作者：
Aladyshev, O. S. [1 ]
Shabanov, B. M. [1 ]
Zakharchenko, A. V. [1 ]
机构：
[1] Russian Acad Sci, Joint Supercomp Ctr, Sci Res Inst Syst Anal, Moscow 119334, Russia
来源：
LOBACHEVSKII JOURNAL OF MATHEMATICS | 2023年 / 44卷 / 12期
关键词：
parallel file systems; supercomputers; high performance computing; distributed locking; I/O operations;
D O I：
10.1134/S1995080223120041
中图分类号：
O1 [数学];
学科分类号：
0701 ; 070101 ;
摘要：
When constructing a high-performance computing cluster, one of the most pressing issues is ensuring efficient organization of the external storage systems. Such systems consist of both hardware and software components. The software component is a parallel file system, and consists of server and client parts. The article explores the principles of operating parallel file systems: mechanisms of data sharing between clients; metadata and data maintenance methods; as well as aspects of selecting a parallel file system for a high performance cluster computing cluster. We have had the opportunity to test some solutions on the large supercomputers of Joint Supercomputer Center of the Russian Academy of Sciences (JSCC RAS) and develop a basic model for file data flow in HPC cluster.
引用
收藏
页码：5132 / 5147
页数：16
相关论文
共 50 条
  • [21] Sensitivity of cluster file system access to I/O server selection
    Apon, AW
    Wolinski, PD
    Amerson, GM
    CCGRID 2002: 2ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS, 2002, : 183 - 192
  • [22] High performance computing and applied mathematics: Expectations for the future
    Astfalk, G
    ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1996, 76 : 29 - 32
  • [23] High performance computing and applied mathematics: Expectations for the future
    Astfalk, G.
    Zeitschrift fuer Angewandte Mathematik und Mechanik, ZAMM, Applied Mathematics and Mechanics, 76 (Suppl 1):
  • [24] Ad Hoc File Systems for High-Performance Computing
    Brinkmann, Andre
    Mohror, Kathryn
    Yu, Weikuan
    Carns, Philip
    Cortes, Toni
    Klasky, Scott A.
    Miranda, Alberto
    Pfreundt, Franz-Josef
    Ross, Robert B.
    Vef, Marc-Andre
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2020, 35 (01) : 4 - 26
  • [25] Ad Hoc File Systems for High-Performance Computing
    André Brinkmann
    Kathryn Mohror
    Weikuan Yu
    Philip Carns
    Toni Cortes
    Scott A. Klasky
    Alberto Miranda
    Franz-Josef Pfreundt
    Robert B. Ross
    Marc-André Vef
    Journal of Computer Science and Technology, 2020, 35 : 4 - 26
  • [26] Integrating High Performance File Systems in a Cloud Computing Environment
    Pan, Abhisek
    Walters, John Paul
    Pai, Vijay S.
    Kang, Dong-In D.
    Crago, Stephen P.
    2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 753 - 759
  • [27] High performance computing on cluster and multicore architecture
    Ashari, Ahmad
    Riasetiawan, Mardhani
    Telkomnika (Telecommunication Computing Electronics and Control), 2015, 13 (04) : 1408 - 1413
  • [28] Cluster computing: A high-performance contender
    Baker, M
    Buyya, R
    Hyde, D
    COMPUTER, 1999, 32 (07) : 79 - +
  • [29] Teaching high-performance computing on a high-performance cluster
    Bernreuther, M
    Brenk, M
    Bungartz, HJ
    Mundani, RP
    Muntean, IL
    COMPUTATIONAL SCIENCE - ICCS 2005, PT 2, 2005, 3515 : 1 - 9
  • [30] A HIGH-PERFORMANCE FILE SYSTEM FOR UNIX
    POSTON, A
    PROCEEDINGS : WORKSHOP ON UNIX AND SUPERCOMPUTERS, 1988, : 215 - 226
12345