Improving File Tree Traversal Performance by Scheduling I/O Operations in User space

被引:1
|
作者
Lunde, Carl Henrik [1 ]
Espeland, Havard [1 ]
Stensland, Hakon Kvale [1 ]
Halvorsen, Pal [1 ]
机构
[1] Univ Oslo, Dept Informat, N-0316 Oslo, Norway
来源
2009 IEEE 28TH INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCC 2009) | 2009年
关键词
D O I
10.1109/PCCC.2009.5403829
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Current in-kernel disk schedulers provide efficient means to optimize the order (and minimize disk seeks) of issued, in-queue I/O requests. However, they fail to optimize sequential multi-file operations, like traversing a large file tree, because only requests from one file are available in the scheduling queue at a time. We have therefore investigated a user-level, I/O request sorting approach to reduce inter-file disk arm movements. This is achieved by allowing applications to utilize the placement of modes and disk blocks to make a one sweep schedule for all file I/Os requested by a process, i.e., data placement information is read first before issuing the low-level I/O requests to the storage system. Our experiments with a modified version of tar show reduced disk arm movements and large performance improvements.
引用
收藏
页码:145 / +
页数:2
相关论文
共 50 条
  • [41] A New File System I/O Mode for Efficient User-level Caching
    Park, Jiwoong
    Min, Cheolgi
    Yeom, HeonYoung
    2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, : 649 - 658
  • [42] Multithreaded Two-Phase I/O: Improving Collective MPI-IO Performance on a Lustre File System
    Tsujita, Yuichi
    Yoshinaga, Kazumi
    Hori, Atsushi
    Sato, Mikiko
    Namiki, Mitaro
    Ishikawa, Yutaka
    2014 22ND EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2014), 2014, : 232 - 235
  • [43] Performance Models for Communication in Collective I/O Operations
    Jha, Shweta
    Gabriel, Edgar
    2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, : 982 - 991
  • [44] Improving I/O Performance in Container with OverlayFS
    Mizusawa, Naoki
    Kon, Joichiro
    Seki, Yuya
    Tao, Jian
    Yamaguchi, Saneyasu
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 5395 - 5395
  • [45] Improving I/O Performance in Smart TVs
    Lee, Cheolhee
    Hwang, Taeho
    Won, Youjip
    2014 INTERNATIONAL CONFERENCE ON FUTURE INTERNET OF THINGS AND CLOUD (FICLOUD), 2014, : 399 - 404
  • [46] High-performance file I/O in Java: Existing approaches and bulk I/O extensions
    Bonachea, Dan
    Dickens, Phillip
    Thakur, Rajeev
    Concurrency and Computation: Practice and Experience, 2001, 13 (8-9): : 713 - 736
  • [47] Integrating Human Performance Measures into Space Operations: Beyond Our Scheduling Capabilities?
    Marquez, Jessica J.
    2015 IEEE AEROSPACE CONFERENCE, 2015,
  • [48] View I/O: improving the performance of non-contiguous I/O
    Isaila, F
    Tichy, WF
    IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, PROCEEDINGS, 2003, : 336 - 343
  • [49] High performance file I/O for the Blue Gene/L supercomputer
    Yu, H.
    Sahoo, R. K.
    Howson, C.
    Almasi, G.
    Castanos, J. G.
    Gupta, M.
    Moreira, J. E.
    Parker, J. J.
    Engelsiepen, T. E.
    Ross, R. B.
    Thakur, R.
    Latham, R.
    Gropp, W. D.
    TWELFTH INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE COMPUTER ARCHITECTURE, PROCEEDINGS, 2006, : 190 - +
  • [50] Throttling I/O streams to accelerate file-IO performance
    Seelam, Seetharami
    Kerstens, Andre
    Teller, Patricia J.
    HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, PROCEEDINGS, 2007, 4782 : 718 - +