Massive stripe cache and prefetching for massive file I/O

被引:0
|
作者
Baek, Sung Hoon [1 ]
Park, Kyu Ho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Elect Engn & Comp Sci, Taejon, South Korea
来源
ICCE: 2007 DIGEST OF TECHNICAL PAPERS INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS | 2007年
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a massive stripe prefetching (MSP) scheme on a massive stripe cache (MSC) structure, which has been implemented in a Linux kernel. Our schemes efficiently perform on massive riles such as audio/video files and a bulk of small files. MSC exploits spatial locality. MSP discriminates metadata reads and contiguous data reads in the stripe level, thereby boosting the read performance independently of a file-based prefetching.
引用
收藏
页码:203 / +
页数:2
相关论文
共 50 条
  • [1] Improving Small File I/O Performance for Massive Digital Archives
    Kim, Hwajung
    Yeom, Heonyoung
    2017 IEEE 13TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE), 2017, : 256 - 265
  • [2] Massive Files Prefetching Model Based on LSTM Neural Network with Cache Transaction Strategy
    Zhu, Dongjie
    Du, Haiwen
    Sun, Yundong
    Li, Xiaofang
    Qu, Rongning
    Hu, Hao
    Dong, Shuangshuang
    Zhou, Helen Min
    Cao, Ning
    CMC-COMPUTERS MATERIALS & CONTINUA, 2020, 63 (02): : 979 - 993
  • [3] Adaptive prefetching for device-independent file I/O
    Revel, D
    McNamee, D
    Steere, D
    Walpole, J
    MULTIMEDIA COMPUTING AND NETWORKING 1998, 1997, 3310 : 139 - 149
  • [4] Parallel I/O Prefetching Using MPI File Caching and I/O Signatures
    Byna, Surendra
    Chen, Yong
    Sun, Xian-He
    Thakur, Rajeev
    Gropp, William
    INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2008, : 350 - +
  • [5] Parallel file system using dual cache scheme and prefetching
    Cho, JH
    Kim, CY
    Seo, DW
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 2765 - 2770
  • [6] Cache Replacement Strategy Based on User Behaviour Analysis for a Massive Small File Storage System
    Liu, Chenyun
    Ding, Shun
    Ye, Liang
    Chen, Xingyu
    Zhu, Wenhao
    2022 14TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2022), 2022, : 178 - 183
  • [7] Improving reading performance by file prefetching mechanism in distributed cache systems
    Gui, Jing
    Wang, Yongbin
    Shuai, Wuyue
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (22):
  • [8] THE STRIPE 82 MASSIVE GALAXY PROJECT. I. CATALOG CONSTRUCTION
    Bundy, Kevin
    Leauthaud, Alexie
    Saito, Shun
    Bolton, Adam
    Lin, Yen-Ting
    Maraston, Claudia
    Nichol, Robert C.
    Schneider, Donald P.
    Thomas, Daniel
    Wake, David A.
    ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2015, 221 (01):
  • [9] Prefetching Scheme for Massive Spatiotemporal Data in a Smart City
    Xiong, Lian
    Xu, Zhengquan
    Wang, Hao
    Jia, Shan
    Zhu, Li
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2016,
  • [10] I/O Buffer Cache Mechanism Based on the Frequency of File Usage
    Katakami, Tatsuya
    Tabata, Toshihiro
    Taniguchi, Hideo
    THIRD 2008 INTERNATIONAL CONFERENCE ON CONVERGENCE AND HYBRID INFORMATION TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 76 - 82