Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system

被引:0
|
作者
陈志刚
曾碧卿
熊策
邓晓衡
曾志文
刘安丰
机构
[1] School of Information Science and Engineering Central South University Changsha 410083 China
[2] School of Information Science and Engineering Central South University Changsha 410083 China
关键词
cluster computing; parallel I/O; file sorted assignment; variance of service time;
D O I
暂无
中图分类号
TP315 [管理程序、管理系统];
学科分类号
1201 ;
摘要
A new file assignment strategy of parallel I/O, which is named heuristic file sorted assignment algorithm was proposed on cluster computing system. Based on the load balancing, it assigns the files to the same disk according to the similar service time. Firstly, the files were sorted and stored at the set I in descending order in terms of their service time, then one disk of cluster node was selected randomly when the files were to be assigned, and at last the continuous files were taken orderly from the set I to the disk until the disk reached its load maximum. The experimental results show that the new strategy improves the performance by 20.2% when the load of the system is light and by 31.6% when the load is heavy. And the higher the data access rate, the more evident the improvement of the performance obtained by the heuristic file sorted assignment algorithm.
引用
收藏
页码:572 / 577
页数:6
相关论文
共 50 条
  • [31] I/O performance of an RAID-10 style parallel file system
    Feng, D
    Jiang, H
    Zhu, YF
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2004, 19 (06) : 965 - 972
  • [32] Dynamic I/O Reconfiguration for a NFS-based Parallel File System
    Kassick, Rodrigo
    Boito, Francieli Zanon
    Navaux, Philippe O. A.
    PROCEEDINGS OF THE 19TH INTERNATIONAL EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING, 2011, : 11 - 18
  • [33] Algorithmic influences on I/O access patterns and parallel file system performance
    Smirni, E
    Elford, CE
    Lavery, AJ
    Chien, AA
    1997 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, PROCEEDINGS, 1997, : 794 - 801
  • [34] An adaptive parallel genetic algorithm system for i-computing environment
    Wong, YY
    Lee, KH
    Leung, KS
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2003, 15 (06): : 581 - 606
  • [35] A Paravirtualized File System for Accelerating File I/O
    Lee, Kihong
    Lee, Dongwoo
    Eom, Young Ik
    2014 INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2014, : 309 - 313
  • [36] Scheduling parallel jobs with CPU and I/O resource requirements in cluster computing systems
    Abawajy, JH
    Dandamudi, SP
    PROCEEDINGS OF THE 11TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS AND SIMULATION OF COMPUTER TELECOMMUNICATIONS SYSTEMS, 2003, : 336 - 343
  • [37] Parallel I/O scheduling in the presence of data duplication on multiprogrammed cluster computing systems
    Abawajy, J. H.
    2006 IEEE INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS, VOLS 1-3, 2006, : 1117 - 1124
  • [38] Enhancing Blowfish File Encryption Algorithm through Parallel Computing on GPU
    Mahajan, Tejal
    Masih, Shraddha
    2015 INTERNATIONAL CONFERENCE ON COMPUTER, COMMUNICATION AND CONTROL (IC4), 2015,
  • [39] Expectations of the High Performance Computing Cluster File System Selection
    Aladyshev, O. S.
    Shabanov, B. M.
    Zakharchenko, A. V.
    LOBACHEVSKII JOURNAL OF MATHEMATICS, 2023, 44 (12) : 5132 - 5147
  • [40] Expectations of the High Performance Computing Cluster File System Selection
    O. S. Aladyshev
    B. M. Shabanov
    A. V. Zakharchenko
    Lobachevskii Journal of Mathematics, 2023, 44 : 5132 - 5147