Improving File Tree Traversal Performance by Scheduling I/O Operations in User space

被引:1
|
作者
Lunde, Carl Henrik [1 ]
Espeland, Havard [1 ]
Stensland, Hakon Kvale [1 ]
Halvorsen, Pal [1 ]
机构
[1] Univ Oslo, Dept Informat, N-0316 Oslo, Norway
来源
2009 IEEE 28TH INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCC 2009) | 2009年
关键词
D O I
10.1109/PCCC.2009.5403829
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Current in-kernel disk schedulers provide efficient means to optimize the order (and minimize disk seeks) of issued, in-queue I/O requests. However, they fail to optimize sequential multi-file operations, like traversing a large file tree, because only requests from one file are available in the scheduling queue at a time. We have therefore investigated a user-level, I/O request sorting approach to reduce inter-file disk arm movements. This is achieved by allowing applications to utilize the placement of modes and disk blocks to make a one sweep schedule for all file I/Os requested by a process, i.e., data placement information is read first before issuing the low-level I/O requests to the storage system. Our experiments with a modified version of tar show reduced disk arm movements and large performance improvements.
引用
收藏
页码:145 / +
页数:2
相关论文
共 50 条
  • [31] Analysis and Evaluation of Scheduling Policies for Consolidated I/O Operations
    Konstantinos Kontodimas
    Panagiotis Kokkinos
    Yossi Kuperman
    Athanasios Houbavlis
    Emmanouel Varvarigos
    Journal of Grid Computing, 2017, 15 : 107 - 125
  • [32] FusionFS: Fusing I/O Operations using CISCops in Firmware File Systems
    Zhang, Jian
    Ren, Yujie
    Kannan, Sudarsun
    PROCEEDINGS OF THE 20TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 2022, 2022, : 297 - 312
  • [33] Improving performance of dispatch rules for daily scheduling of assembly and test operations
    Jia, Shihui
    Bard, Jonathan F.
    Chacon, Rodolfo
    Stuber, John
    COMPUTERS & INDUSTRIAL ENGINEERING, 2015, 90 : 86 - 106
  • [34] On evaluating decentralized parallel I/O scheduling strategies for parallel file systems
    Isaila, Florin
    Singh, David
    Carretero, Jesus
    Garcia, Felix
    HIGH PERFORMANCE COMPUTING FOR COMPUTATIONAL SCIENCE - VECPAR 2006, 2007, 4395 : 120 - +
  • [35] AGIOS: Application-guided I/O Scheduling for Parallel File Systems
    Boito, Francieli Zanon
    Kassick, Rodrigo Virote
    Navaux, Philippe O. A.
    Denneulin, Yves
    2013 19TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2013), 2013, : 43 - 50
  • [36] Improving I/O performance in distributed file systems for flash-based SSDs by access pattern reshaping
    Kim, Sunggon
    Han, Jaehyun
    Eom, Hyeonsang
    Son, Yongseok
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 115 : 365 - 373
  • [37] Towards Enhanced I/O Performance of NVM File Systems
    Bang, Jiwoo
    Kim, Chungyong
    Byun, Eun-Kyu
    Sung, Hanul
    Lee, Jaehwan
    Eom, Hyeonsang
    2023 IEEE 30TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA, AND ANALYTICS, HIPC 2023, 2023, : 319 - 323
  • [38] Hadoop I/O Performance Improvement by File Layout Optimization
    Fujishima, Eita
    Nakashima, Kenji
    Yamaguchi, Saneyasu
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (02): : 415 - 427
  • [39] Research on Sharing Access and Performance Improvement Based on User-Space File System
    Yang H.
    Yang Y.
    Sun G.
    Yang, Yahui (yhyang@ss.pku.edu.cn), 1600, Peking University (56): : 1020 - 1030
  • [40] Performance Optimization of Small File I/O with Adaptive Migration Strategy in Cluster File System
    Li, Xiuqiao
    Dong, Bin
    Xiao, Limin
    Ruan, Li
    HIGH PERFORMANCE COMPUTING AND APPLICATIONS, 2010, 5938 : 242 - 249