Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system

被引:0
|
作者
陈志刚
曾碧卿
熊策
邓晓衡
曾志文
刘安丰
机构
[1] School of Information Science and Engineering Central South University Changsha 410083 China
[2] School of Information Science and Engineering Central South University Changsha 410083 China
关键词
cluster computing; parallel I/O; file sorted assignment; variance of service time;
D O I
暂无
中图分类号
TP315 [管理程序、管理系统];
学科分类号
1201 ;
摘要
A new file assignment strategy of parallel I/O, which is named heuristic file sorted assignment algorithm was proposed on cluster computing system. Based on the load balancing, it assigns the files to the same disk according to the similar service time. Firstly, the files were sorted and stored at the set I in descending order in terms of their service time, then one disk of cluster node was selected randomly when the files were to be assigned, and at last the continuous files were taken orderly from the set I to the disk until the disk reached its load maximum. The experimental results show that the new strategy improves the performance by 20.2% when the load of the system is light and by 31.6% when the load is heavy. And the higher the data access rate, the more evident the improvement of the performance obtained by the heuristic file sorted assignment algorithm.
引用
收藏
页码:572 / 577
页数:6
相关论文
共 50 条
  • [11] Automatic I/O scheduling algorithm selection for parallel file systems
    Boito, Francieli Zanon
    Kassick, Rodrigo Virote
    Navaux, Philippe O. A.
    Denneulin, Yves
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2457 - 2472
  • [12] UFCR: An efficient I/O method for parallel file system
    Huo, Yanmei
    Ju, Jiubin
    Hu, Liang
    SEVENTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PROCEEDINGS, 2006, : 223 - +
  • [13] Benchmarking Parallel File System Sensitiveness to I/O patterns
    Chasapis, Konstantinos
    Vet, Jean-Yves
    Acquaviva, Jean-Thomas
    2019 IEEE 27TH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS, AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS (MASCOTS 2019), 2019, : 427 - 428
  • [14] Enabling dynamic file I/O path selection at runtime for parallel file system
    Xiuqiao Li
    Limin Xiao
    Meikang Qiu
    Bin Dong
    Li Ruan
    The Journal of Supercomputing, 2014, 68 : 996 - 1021
  • [15] Enabling dynamic file I/O path selection at runtime for parallel file system
    Li, Xiuqiao
    Xiao, Limin
    Qiu, Meikang
    Dong, Bin
    Ruan, Li
    JOURNAL OF SUPERCOMPUTING, 2014, 68 (02): : 996 - 1021
  • [16] FILE CONCEPTS FOR PARALLEL I/O
    CROCKETT, TW
    PROCEEDINGS : SUPERCOMPUTING 89, 1989, : 574 - 579
  • [17] An efficient parallel file system for cluster grids
    Frattolillo, F
    D'Onofrio, S
    RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2005, 3666 : 94 - 101
  • [18] Sensitivity of cluster file system access to I/O server selection
    Apon, AW
    Wolinski, PD
    Amerson, GM
    CCGRID 2002: 2ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS, 2002, : 183 - 192
  • [19] Parallel I/O Architecture Modelling Based on File System Counters
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2016 INTERNATIONAL WORKSHOPS, 2016, 9945 : 627 - 637
  • [20] MPI-I/O with a shared file pointer using a parallel virtual file system in remote I/O operations
    Tsujita, Y
    DISTRIBUTED AND PARALLEL SYSTEMS: CLUSTER AND GRID COMPUTING, 2005, 777 : 47 - 54