Design of Cache backend using Remote Memory for Network File System

被引:2
|
作者
Lim, Eun-Ji [1 ]
Ahn, Shin-Young [1 ]
Kim, Young-Ho [1 ]
Cha, Gyu-Il [1 ]
Choi, Wan [1 ]
机构
[1] ETRI, High Performance Comp Res Grp, Daejeon, South Korea
来源
2017 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS) | 2017年
关键词
cachedm; network file system cache; distributed memory cache system; fs-cache; DMIF;
D O I
10.1109/HPCS.2017.131
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In supporting high-performance data processing, performance gap between the computation device and storage prevents the full utilization of the computation resource and causes a system bottleneck. In addition, some big-data applications which require interactive, real-time, and complicated computation need faster data I/O than distributed file systems. So we propose a new cache backend facility called CacheDM for network file system, which utilizes the distributed memory as a cache media in the cluster environment where computing nodes are connected via high speed network. CacheDM can provide low-latency and high-speed cache by supporting direct memory copy based access to the cached data by using RDMA. CacheDM is designed as a cache backend of the FS-Cache, therefore users can use CacheDM and gain its performance advantage without modification of existing application and NFS.
引用
收藏
页码:864 / 869
页数:6
相关论文
共 50 条
  • [21] Using neuro-fuzzy methodology in cache memory design
    Diab, H
    Abdul-Samad, R
    Saade, JJ
    Mrad, F
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2000, 8 (04) : 289 - 300
  • [22] Design of a NAND Flash Memory File System to Improve System Boot Time
    Park, Song-Hwa
    Lee, Tae-Hoon
    Chung, Ki-Dong
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2006, 2 (03): : 147 - 152
  • [23] Using cache optimizing compiler for managing software cache on distributed shared memory system
    Nanri, T
    Sato, H
    Shimasaki, M
    HIGH PERFORMANCE COMPUTING ON THE INFORMATION SUPERHIGHWAY - HPC ASIA '97, PROCEEDINGS, 1997, : 312 - 318
  • [24] Optimizing File Systems on Heterogeneous Memory by Integrating DRAM Cache with Virtual Memory Management
    Liu, Yubo
    Ren, Yuxin
    Liu, Mingrui
    Li, Hongbo
    Guo, Hanjun
    Miao, Xie
    Hu, Xinwei
    Chen, Haibo
    PROCEEDINGS OF THE 21ST USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, NSDI 24, 2024, : 71 - 87
  • [25] Network optimization for distributed memory file system on high performance computers
    Wu, Chun-Jia
    Liu, Guang-Ming
    Liu, Xin
    PROCEEDINGS OF THE 2ND ANNUAL INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND INFORMATION SCIENCE (EEEIS 2016), 2016, 117 : 758 - 763
  • [26] Optimizing File Systems on Heterogeneous Memory by Integrating DRAM Cache with Virtual Memory Management
    Liu, Yubo
    Ren, Yuxin
    Liu, Mingrui
    Li, Hongbo
    Guo, Hanjun
    Miao, Xie
    Hu, Xinwei
    Chen, Haibo
    PROCEEDINGS OF THE 22ND USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 24, 2024, : 71 - 87
  • [27] The Rio file cache: Surviving operating system crashes
    Chen, PM
    Ng, WT
    Chandra, S
    Aycock, C
    Rajamani, G
    Lowell, D
    ACM SIGPLAN NOTICES, 1996, 31 (09) : 74 - 83
  • [28] Delta service in a mobile file system client cache
    Blake, W
    Mahgoub, I
    1998 IEEE INTERNATIONAL PERFORMANCE, COMPUTING AND COMMUNICATIONS CONFERENCE, 1997, : 222 - 228
  • [29] A network file system over HTTP:: remote access and modification of files and files
    Kiselyov, O
    PROCEEDINGS OF THE FREENIX TRACK: 1999 USENIX ANNUAL TECHNICAL CONFERENCE, 1999, : 75 - 80
  • [30] DESIGN FOR NETWORK FILE FORENSICS SYSTEM BASED ON APPROXIMATE MATCHING
    Xu, Fei
    Liu, Pinxin
    FORENSIC SCIENCE INTERNATIONAL, 2017, 277 : 120 - 120