Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system

被引:0
|
作者
陈志刚
曾碧卿
熊策
邓晓衡
曾志文
刘安丰
机构
[1] School of Information Science and Engineering Central South University Changsha 410083 China
[2] School of Information Science and Engineering Central South University Changsha 410083 China
关键词
cluster computing; parallel I/O; file sorted assignment; variance of service time;
D O I
暂无
中图分类号
TP315 [管理程序、管理系统];
学科分类号
1201 ;
摘要
A new file assignment strategy of parallel I/O, which is named heuristic file sorted assignment algorithm was proposed on cluster computing system. Based on the load balancing, it assigns the files to the same disk according to the similar service time. Firstly, the files were sorted and stored at the set I in descending order in terms of their service time, then one disk of cluster node was selected randomly when the files were to be assigned, and at last the continuous files were taken orderly from the set I to the disk until the disk reached its load maximum. The experimental results show that the new strategy improves the performance by 20.2% when the load of the system is light and by 31.6% when the load is heavy. And the higher the data access rate, the more evident the improvement of the performance obtained by the heuristic file sorted assignment algorithm.
引用
收藏
页码:572 / 577
页数:6
相关论文
共 50 条
  • [1] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Chen, ZG
    Zeng, BQ
    Xiong, C
    Deng, XH
    Zeng, ZW
    Liu, AF
    JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2005, 12 (05): : 572 - 577
  • [2] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Zhi-gang Chen
    Bi-qing Zeng
    Ce Xiong
    Xiao-heng Deng
    Zhi-wen Zeng
    An-feng Liu
    Journal of Central South University of Technology, 2005, 12 : 572 - 577
  • [3] A HEURISTIC ALGORITHM FOR THE RELIABILITY-ORIENTED FILE ASSIGNMENT IN A DISTRIBUTED COMPUTING SYSTEM
    CHEN, DJ
    HOL, WC
    CHEN, RS
    CHEN, DTK
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 1995, 29 (10) : 85 - 104
  • [4] Heuristic algorithm for the reliability-oriented file assignment in a distributed computing system
    Chen, D.-J.
    Hol, W.C.
    Chen, R.-S.
    Chen, D.T.K.
    Computers and Mathematics with Applications, 1995, 29 (10): : 85 - 104
  • [5] Distributed parallel file system for I/O intensive parallel computing on clusters
    Domínguez-Domínguez, S
    Buenabad-Chávez, J
    2004 1st International Conference on Electrical and Electronics Engineering (ICEEE), 2004, : 194 - 199
  • [6] A File Assignment Strategy for Parallel I/O System with Minimum I/O Contention Probability
    Dong, Bin
    Li, Xiuqiao
    Xiao, Limin
    Ruan, Li
    GRID AND DISTRIBUTED COMPUTING, 2011, 261 : 445 - 454
  • [7] File assignment in parallel I/O systems with minimal variance of service time
    Lee, LW
    Scheuermann, P
    Vingralek, R
    IEEE TRANSACTIONS ON COMPUTERS, 2000, 49 (02) : 127 - 140
  • [8] A novel cluster parallel file system
    Wei, Wenguo
    Dong, Shoubin
    Zhang, Ling
    Li, Jialin
    SEVENTEENTH INTERNATIONAL CONFERENCE ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2006, : 119 - +
  • [9] Parallel I/O scheduling in multiprogrammed cluster computing systems
    Abawajy, JH
    COMPUTATIONAL SCIENCE - ICCS 2003, PT IV, PROCEEDINGS, 2003, 2660 : 223 - 229
  • [10] A non-partitioning file assignment scheme with approximating average waiting time in parallel I/O system
    Yao, Nianmin
    Chen, Jinzhong
    Cai, Shaobin
    Journal of Software, 2013, 8 (02) : 302 - 309