Distributed File System: Efficiency Experiments for Data Access and Communication

被引：0
|
作者：
Upadhyaya, Bipin [1 ]
Azimov, Fahriddin [1 ]
Doan, Thanh Tran [1 ]
Choi, Eunmi [1 ]
Kim, SangBum [2 ]
Kim, Pilsung [2 ]
机构：
[1] Kookmin Univ, Sch Business IT, Seoul, South Korea
[2] SK Telecom Convergence & nternet R&D Ctr, Seoul, South Korea
来源：
NCM 2008: 4TH INTERNATIONAL CONFERENCE ON NETWORKED COMPUTING AND ADVANCED INFORMATION MANAGEMENT, VOL 2, PROCEEDINGS | 2008年
关键词：
Distributed File System; Buffer management; Disk Input/Output Performance; I/O tuning;
D O I：
10.1109/NCM.2008.164
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In a Distributed File System, operations such as read, write, send and receive should be efficient and must increase the overall performance of the system. Especially every remote read and write operation we encounter network and secondary storage latencies. In order to reduce this latency time and improve the performance of Distributed File System, we analyze the problem of selecting application-level buffer size for the Network communication and Disk Input/Output operations. A number of experiments were carried out to identify the optimal size for our application-level Buffer.
引用
收藏
页码：400 / +
页数：2
相关论文
共 50 条
  • [41] The Direct Access File System
    DeBergalis, M
    Corbett, P
    Kleiman, S
    Lent, A
    Noveck, D
    Talpey, T
    Wittle, M
    USENIX ASSOCIATION PROCEEDINGS OF THE 2ND USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES (FAST'03), 2003, : 175 - 188
  • [42] ALDM: Algorithm of Adaptive Loading Data Migration in Distributed File System
    Tan Zhipeng
    Zhou Wei
    Zhang Wenhua
    Feng Dan
    2012 DIGEST ASIA-PACIFIC MAGNETIC RECORDING CONFERENCE (APMRC), 2012,
  • [43] Computer Performance Determination System Based on Big Data Distributed File
    Lu, Kong
    CYBER SECURITY INTELLIGENCE AND ANALYTICS, 2020, 928 : 877 - 884
  • [44] Key technology in distributed file system towards big data analysis
    Zhou, J. (zhoujiang@ncic.ac.cn), 1600, Science Press (51):
  • [45] Analysis of DNA Data Using Hadoop Distributed File System.
    Senthilkumar, M.
    Ilango, P.
    RESEARCH JOURNAL OF PHARMACEUTICAL BIOLOGICAL AND CHEMICAL SCIENCES, 2016, 7 (03): : 796 - 803
  • [46] GDedup: Distributed File System Level Deduplication for Genomic Big Data
    Bartus, Paul
    Arzuaga, Emmanuel
    2018 IEEE INTERNATIONAL CONGRESS ON BIG DATA (IEEE BIGDATA CONGRESS), 2018, : 120 - 127
  • [47] An approach for Big Data Security based on Hadoop Distributed File system
    Mahmoud, Hadeer
    Hegazy, Abdelfatah
    Khafagy, Mohamed H.
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON INNOVATIVE TRENDS IN COMPUTER ENGINEERING (ITCE' 2018), 2018, : 109 - 114
  • [48] HDFSX: Big Data Distributed File System with Small Files Support
    EIKafrawy, Passent M.
    Sauber, Amr M.
    Hafez, Mohamed M.
    ICENCO 2016 - 2016 12TH INTERNATIONAL COMPUTER ENGINEERING CONFERENCE (ICENCO) - BOUNDLESS SMART SOCIETIES, 2016, : 131 - 135
  • [49] Sharing lattice QCD data over a widely distributed file system
    Amagasa, T.
    Aoki, S.
    Aoki, Y.
    Aoyama, T.
    Doi, T.
    Fukumura, K.
    Ishii, N.
    Ishikawa, K. -I
    Jitsumoto, H.
    Kamano, H.
    Konno, Y.
    Matsufuru, H.
    Mikami, Y.
    Miura, K.
    Sato, M.
    Takeda, S.
    Tatebe, O.
    Togawa, H.
    Ukawa, A.
    Ukita, N.
    Watanabe, Y.
    Yamazaki, T.
    Yoshie, T.
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [50] Data-Intensive Workload Consolidation for the Hadoop Distributed File System
    Moraveji, Reza
    Taheri, Javid
    Reza, Mohammad
    Rizvandi, Nikzad Babaii
    Zomaya, Albert Y.
    2012 ACM/IEEE 13TH INTERNATIONAL CONFERENCE ON GRID COMPUTING (GRID), 2012, : 95 - 103
12345