Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system

被引:0
|
作者
陈志刚
曾碧卿
熊策
邓晓衡
曾志文
刘安丰
机构
[1] School of Information Science and Engineering Central South University Changsha 410083 China
[2] School of Information Science and Engineering Central South University Changsha 410083 China
关键词
cluster computing; parallel I/O; file sorted assignment; variance of service time;
D O I
暂无
中图分类号
TP315 [管理程序、管理系统];
学科分类号
1201 ;
摘要
A new file assignment strategy of parallel I/O, which is named heuristic file sorted assignment algorithm was proposed on cluster computing system. Based on the load balancing, it assigns the files to the same disk according to the similar service time. Firstly, the files were sorted and stored at the set I in descending order in terms of their service time, then one disk of cluster node was selected randomly when the files were to be assigned, and at last the continuous files were taken orderly from the set I to the disk until the disk reached its load maximum. The experimental results show that the new strategy improves the performance by 20.2% when the load of the system is light and by 31.6% when the load is heavy. And the higher the data access rate, the more evident the improvement of the performance obtained by the heuristic file sorted assignment algorithm.
引用
收藏
页码:572 / 577
页数:6
相关论文
共 50 条
  • [21] Using file system counters in modelling parallel I/O architectures
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    OPERATING SYSTEMS REVIEW, 2016, 50 (02) : 37 - 46
  • [22] Parallel File System Analysis Through Application I/O Tracing
    Wright, S. A.
    Hammond, S. D.
    Pennycook, S. J.
    Bird, R. F.
    Herdman, J. A.
    Miller, I.
    Vadgama, A.
    Bhalerao, A.
    Jarvis, S. A.
    COMPUTER JOURNAL, 2013, 56 (02): : 141 - 155
  • [23] Performance Optimization of Small File I/O with Adaptive Migration Strategy in Cluster File System
    Li, Xiuqiao
    Dong, Bin
    Xiao, Limin
    Ruan, Li
    HIGH PERFORMANCE COMPUTING AND APPLICATIONS, 2010, 5938 : 242 - 249
  • [24] HySF: A Striped File Assignment Strategy for Parallel File System with Hybrid Storage
    Zhu, Mingfa
    Li, Guoying
    Ruan, Li
    Xie, Ke
    Xiao, Limin
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 511 - 517
  • [25] Performance analysis of parallel I/O scheduling approaches on cluster computing systems
    Abawajy, JH
    CCGRID 2003: 3RD IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS, 2003, : 724 - 729
  • [26] SOR: A Static File Assignment Strategy Immune to Workload Characteristic Assumptions in Parallel I/O Systems
    Xie, Tao
    2007 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING WORKSHOPS (ICPP), 2007, : 267 - 274
  • [27] Cooperative caching in the pCFS parallel cluster file system
    Lopes, Paulo A.
    Medeiros, Pedro D.
    HPDC-15: PROCEEDINGS OF THE 15TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, 2005, : 347 - 348
  • [28] Providing PVM with a parallel file system for cluster grids
    Frattolillo, Franco
    D'Onofrio, Salvatore
    WMSCI 2005: 9th World Multi-Conference on Systemics, Cybernetics and Informatics, Vol 3, 2005, : 24 - 29
  • [29] The cluster file system: Integration of high performance communication and I/O in clusters
    Cristaldi, R
    Iannello, G
    Delfino, F
    CCGRID 2002: 2ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS, 2002, : 173 - 182
  • [30] I/O performance of an RAID-10 style parallel file system
    Dan Feng
    Hong Jiang
    Yi-Feng Zhu
    Journal of Computer Science and Technology, 2004, 19 : 965 - 972