Improving File Tree Traversal Performance by Scheduling I/O Operations in User space

被引:1
|
作者
Lunde, Carl Henrik [1 ]
Espeland, Havard [1 ]
Stensland, Hakon Kvale [1 ]
Halvorsen, Pal [1 ]
机构
[1] Univ Oslo, Dept Informat, N-0316 Oslo, Norway
来源
2009 IEEE 28TH INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCC 2009) | 2009年
关键词
D O I
10.1109/PCCC.2009.5403829
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Current in-kernel disk schedulers provide efficient means to optimize the order (and minimize disk seeks) of issued, in-queue I/O requests. However, they fail to optimize sequential multi-file operations, like traversing a large file tree, because only requests from one file are available in the scheduling queue at a time. We have therefore investigated a user-level, I/O request sorting approach to reduce inter-file disk arm movements. This is achieved by allowing applications to utilize the placement of modes and disk blocks to make a one sweep schedule for all file I/Os requested by a process, i.e., data placement information is read first before issuing the low-level I/O requests to the storage system. Our experiments with a modified version of tar show reduced disk arm movements and large performance improvements.
引用
收藏
页码:145 / +
页数:2
相关论文
共 50 条
  • [1] Improving Small File I/O Performance for Massive Digital Archives
    Kim, Hwajung
    Yeom, Heonyoung
    2017 IEEE 13TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE), 2017, : 256 - 265
  • [2] Improving the Performance of Read Operations in Distributed File System
    Krishna, T. Lakshmi Siva Rama
    Ragunathan, T.
    Battula, Sudheer Kumar
    2014 6TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS, 2014, : 1126 - 1130
  • [3] SCHEDULING AND CONTROLLING I/O OPERATIONS
    CRICK, A
    DATA PROCESSING, 1974, 16 (03): : 170 - 171
  • [4] Heuristics for scheduling I/O operations
    Jain, R
    Somalwar, K
    Werth, J
    Browne, JC
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1997, 8 (03) : 310 - 320
  • [5] File Placing Control for Improving the I/O Performance of Hadoop in Virtualized Environment
    Nakashima, Kenji
    Fujishima, Eita
    Yamaguchi, Saneyasu
    2016 FOURTH INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING (CANDAR), 2016, : 402 - 407
  • [6] The traversal method for user address space in Windows 10 system based on VAD tree
    Zhai J.
    Sun H.
    Zhao L.
    Yang H.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2022, 40 (03): : 699 - 707
  • [7] To FUSE or Not to FUSE: Performance of User-Space File Systems
    Vangoor, Bharath Kumar Reddy
    Tarasov, Vasily
    Zadok, Erez
    PROCEEDINGS OF FAST '17: 15TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2017, : 59 - 72
  • [8] Parallelizing Shared File I/O Operations of NVM File System for Manycore Servers
    Kim, June-Hyung
    Kim, Youngjae
    Jamil, Safdar
    Lee, Chang-Gyu
    Park, Sungyong
    IEEE ACCESS, 2021, 9 : 24570 - 24585
  • [9] MPI-I/O with a shared file pointer using a parallel virtual file system in remote I/O operations
    Tsujita, Y
    DISTRIBUTED AND PARALLEL SYSTEMS: CLUSTER AND GRID COMPUTING, 2005, 777 : 47 - 54
  • [10] I/O and Space-Efficient Path Traversal in Planar Graphs
    Dillabaugh, Craig
    He, Meng
    Maheshwari, Anil
    Zeh, Norbert
    ALGORITHMS AND COMPUTATION, PROCEEDINGS, 2009, 5878 : 1175 - +