Expectations of the High Performance Computing Cluster File System Selection

被引：0
|
作者：
Aladyshev, O. S. [1 ]
Shabanov, B. M. [1 ]
Zakharchenko, A. V. [1 ]
机构：
[1] Russian Acad Sci, Joint Supercomp Ctr, Sci Res Inst Syst Anal, Moscow 119334, Russia
来源：
LOBACHEVSKII JOURNAL OF MATHEMATICS | 2023年 / 44卷 / 12期
关键词：
parallel file systems; supercomputers; high performance computing; distributed locking; I/O operations;
D O I：
10.1134/S1995080223120041
中图分类号：
O1 [数学];
学科分类号：
0701 ; 070101 ;
摘要：
When constructing a high-performance computing cluster, one of the most pressing issues is ensuring efficient organization of the external storage systems. Such systems consist of both hardware and software components. The software component is a parallel file system, and consists of server and client parts. The article explores the principles of operating parallel file systems: mechanisms of data sharing between clients; metadata and data maintenance methods; as well as aspects of selecting a parallel file system for a high performance cluster computing cluster. We have had the opportunity to test some solutions on the large supercomputers of Joint Supercomputer Center of the Russian Academy of Sciences (JSCC RAS) and develop a basic model for file data flow in HPC cluster.
引用
收藏
页码：5132 / 5147
页数：16
相关论文
共 50 条
  • [31] Performance Optimization of Small File I/O with Adaptive Migration Strategy in Cluster File System
    Li, Xiuqiao
    Dong, Bin
    Xiao, Limin
    Ruan, Li
    HIGH PERFORMANCE COMPUTING AND APPLICATIONS, 2010, 5938 : 242 - 249
  • [32] Fastdfs: A high performance distributed file system
    Liu, Xiaoyan
    Yu, Qing
    Liao, Jianwei
    ICIC Express Letters, Part B: Applications, 2014, 5 (06): : 1741 - 1746
  • [33] High Performance Hadoop Distributed File System
    Mohamed Elkawkagy
    Heba Elbeh
    International Journal of Networked and Distributed Computing, 2020, 8 : 119 - 123
  • [34] High Performance Hadoop Distributed File System
    Elkawkagy, Mohamed
    Elbeh, Heba
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2020, 8 (03) : 119 - 123
  • [35] Design and Performance Measurement of a High-Performance Computing Cluster
    George, Kiran
    Venugopal, Vivek
    2012 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2012, : 2531 - 2536
  • [36] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Chen, ZG
    Zeng, BQ
    Xiong, C
    Deng, XH
    Zeng, ZW
    Liu, AF
    JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2005, 12 (05): : 572 - 577
  • [37] Integrating High Performance Computing into Higher Education and the Pedagogy of Cluster Computing
    Stevens, Cody
    Anderson, Sean M.
    Carlson, Adam
    PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2024, PEARC 2024, 2024,
  • [38] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    陈志刚
    曾碧卿
    熊策
    邓晓衡
    曾志文
    刘安丰
    Journal of Central South University of Technology(English Edition), 2005, (05) : 572 - 577
  • [39] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Zhi-gang Chen
    Bi-qing Zeng
    Ce Xiong
    Xiao-heng Deng
    Zhi-wen Zeng
    An-feng Liu
    Journal of Central South University of Technology, 2005, 12 : 572 - 577
  • [40] RANKING AND SELECTION IN A HIGH PERFORMANCE COMPUTING ENVIRONMENT
    Ni, Eric C.
    Hunter, Susan R.
    Henderson, Shane G.
    2013 WINTER SIMULATION CONFERENCE (WSC), 2013, : 833 - 845
12345