Extending TCP for Accelerating Replication on Cluster File Systems over SDNs

被引:0
|
作者
Lim, Sungheon [1 ]
Kim, Hyogon [2 ]
机构
[1] Korea Univ, Comp Sci & Engn, Seoul, South Korea
[2] Korea Univ, Comp Sci, Seoul, South Korea
关键词
TCP extension; Software Defined Networking (SDN); cluster file system; data replication; network utilization; HDFS; RELIABLE MULTICAST;
D O I
10.1109/netsoft.2019.8806672
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.
引用
收藏
页码:48 / 53
页数:6
相关论文
共 50 条
  • [21] First impressions of different parallel cluster file systems
    Boenisch, TP
    Haas, PW
    Hess, M
    Krischok, B
    PARALLEL COMPUTING: SOFTWARE TECHNOLOGY, ALGORITHMS, ARCHITECTURES AND APPLICATIONS, 2004, 13 : 551 - 558
  • [22] Design and Implementation of Networking Virtualization for Cluster File Systems
    Kim, Junghan
    Kim, Inhyuk
    Kim, Taehyoung
    Eom, Young Ik
    Kim, Hong-Yeon
    Kim, Youngkyun
    PROCEEDINGS OF THE 2009 INTERNATIONAL CONFERENCE OF COMPUTATIONAL SCIENCES AND ITS APPLICATIONS, 2009, : 79 - +
  • [23] An efficient metadata distribution policy for cluster file systems
    Xiong, Jin
    Tang, Rongfeng
    Wu, Sining
    Meng, Dan
    Sun, Ninghui
    2005 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2006, : 263 - 272
  • [24] The MOSIX Direct File System Access Method for Supporting Scalable Cluster File Systems
    Lior Amar
    Amnon Barak
    Amnon Shiloh
    Cluster Computing, 2004, 7 (2) : 141 - 150
  • [25] Detecting Sybils in Peer-to-Peer File Replication Systems
    Haribabu, K.
    Hota, Chittaranjan
    Saravana
    INFORMATION SECURITY AND DIGITAL FORENSICS, 2010, 41 : 123 - +
  • [26] Efficient and Effective File Replication in Structured P2P File Sharing Systems
    Shen, Haiying
    2009 IEEE NINTH INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING (P2P 2009), 2009, : 159 - 162
  • [27] Large file transmissions over high delay data communication channels using TCP
    Wiedemeier, PD
    Tyrer, HW
    2003 IEEE AEROSPACE CONFERENCE PROCEEDINGS, VOLS 1-8, 2003, : 1237 - 1243
  • [28] ADAM: An Adaptive Directory Accelerating Mechanism for NVM-Based File Systems
    Cui, Xin
    Huang, Linpeng
    Zheng, Shengan
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT I, 2018, 11334 : 578 - 592
  • [29] Comparison of Methods for Accelerating the Response Time of TCP Sessions over Long Delay Paths
    Tambuwal, Ahmed Yusuf
    Secchi, Raffaello
    Fairhurst, Gorry
    2013 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2013,
  • [30] Adaptive Prefetching for Accelerating Read and Write in NVM-based File Systems
    Zheng, Shengan
    Mei, Hong
    Huang, Linpeng
    Shen, Yanyan
    Zhu, Yanmin
    2017 IEEE 35TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), 2017, : 49 - 56