A high availability mechanism for parallel file system

被引:0
|
作者
Zhang, H [1 ]
Wu, WG
Dong, XS
Qian, DP
机构
[1] Xian Jiaotong Univ, Dept Comp Sci, Xian 710049, Shaanxi, Peoples R China
[2] Beihang Univ, Sch Comp Sci, Beijing 100083, Peoples R China
来源
ADVANCED PARALLEL PROCESSING TECHNOLOGIES, PROCEEDINGS | 2005年 / 3756卷
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Parallel file systems achieve a high I/O throughput by dividing a file into multiple blocks and storing them on multiple I/O nodes. However, the reliability and availability of the parallel file systems are sacrificed for the stripping of file data over multi I/O nodes. A new mechanism named Logic Mirror Ring (LMR), has been developed to improve the reliability and availability of the parallel file systems in this study. A logic mirror ring is built over all I/O nodes to indicate the mirror relationship among the nodes, i.e., each node maintains not only its own data but also the mirror data of other nodes. The fault tolerant capability of the system is improved because the node maintaining the mirror data of the failed node will takeover the requests to the failed node. The mirror depth can be adjusted to different levels based on the requirements of the reliability and availability. A model is developed to evaluate the reliability and availability of the paxallel file systems. The effects of LMR on the reliability and availability of the parallel file system is studied. The results show that LMR can be used to improve the reliability and availability of the parallel file systems effectively.
引用
收藏
页码:194 / 203
页数:10
相关论文
共 50 条
  • [21] ENHANCING PERFORMANCE IN A PARALLEL FILE SYSTEM
    MILLER, LL
    INGLETT, SR
    MICROPROCESSING AND MICROPROGRAMMING, 1994, 40 (04): : 261 - 274
  • [22] A Year in the Life of a Parallel File System
    Lockwood, Glenn K.
    Snyder, Shane
    Wang, Teng
    Byna, Suren
    Carns, Philip
    Wright, Nicholas J.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE, AND ANALYSIS (SC'18), 2018,
  • [23] A novel cluster parallel file system
    Wei, Wenguo
    Dong, Shoubin
    Zhang, Ling
    Li, Jialin
    SEVENTEENTH INTERNATIONAL CONFERENCE ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2006, : 119 - +
  • [24] A global and parallel file system for grids
    Garcia-Carballeira, Felix
    Carretero, Jesus
    Calderon, Alejandro
    Garcia, J. Daniel
    Sanchez, Luis. M.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2007, 23 (01): : 116 - 122
  • [25] Coding for high availability of a distributed-parallel storage system
    Malluhi, QM
    Johnston, WE
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1998, 9 (12) : 1237 - 1252
  • [26] DPFS: A Distributed Parallel File System
    Shen, XH
    Choudhary, A
    PROCEEDINGS OF THE 2001 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2001, : 533 - 541
  • [27] Building a parallel file system simulator
    Molina-Estolano, E.
    Maltzahn, C.
    Bent, J.
    Brandt, S. A.
    SCIDAC 2009: SCIENTIFIC DISCOVERY THROUGH ADVANCED COMPUTING, 2009, 180
  • [28] High availability for parallel computers
    Rexachs, Dolores
    Luque, Emilio
    JOURNAL OF COMPUTER SCIENCE & TECHNOLOGY, 2010, 10 (03): : 110 - 116
  • [29] RAMA: An easy-to-use, high-performance parallel file system
    Miller, EL
    Katz, RH
    PARALLEL COMPUTING, 1997, 23 (4-5) : 419 - 446
  • [30] Authentication and Availability in a Flexible and Adaptable Distributed File System
    Neto, Mario Camara
    Lobato, Renata Spolon
    Manacero, Aleardo, Jr.
    Spolon, Roberta
    Cavenaghi, Marcos Antonio
    2017 12TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2017,