Extending TCP for Accelerating Replication on Cluster File Systems over SDNs

被引:0
|
作者
Lim, Sungheon [1 ]
Kim, Hyogon [2 ]
机构
[1] Korea Univ, Comp Sci & Engn, Seoul, South Korea
[2] Korea Univ, Comp Sci, Seoul, South Korea
关键词
TCP extension; Software Defined Networking (SDN); cluster file system; data replication; network utilization; HDFS; RELIABLE MULTICAST;
D O I
10.1109/netsoft.2019.8806672
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.
引用
收藏
页码:48 / 53
页数:6
相关论文
共 50 条
  • [31] An Efficient and Adaptive Decentralized File Replication Algorithm in P2P File Sharing Systems
    Shen, Haiying
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2010, 21 (06) : 827 - 840
  • [32] Towards a WebJDK: Extending OpenJDK 7 for client file system access over cloud
    Deshpande, C. V.
    Shetye, A. S.
    Ghuge, S. S.
    Aghav, J. V.
    2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES (ICT 2013), 2013, : 1253 - 1258
  • [33] Extending JXTA protocols for P2P file sharing systems
    Xhafa, Fatos
    Barolli, Leonard
    Fernandez, Raul
    Daradoumis, Thanasis
    Caballe, Santi
    Kolici, Vladi
    CISIS 2008: THE SECOND INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS, PROCEEDINGS, 2008, : 35 - +
  • [34] Fault-tolerant model for replication in distributed-file systems
    Chang Jung Univ, Tainan, Taiwan
    Proc Natl Sci Counc Repub China Part A Phys Sci Eng, 3 (402-410):
  • [35] Modeling TCP long file transfer latency over long delay wireless multilink PPP
    Zaghloul, S
    Frost, V
    Mohammad, AJ
    IEEE COMMUNICATIONS LETTERS, 2005, 9 (11) : 988 - 990
  • [36] TCP/IP over ATM based HFC systems
    Angelopoulos, JD
    Grilo, A
    Nunes, MS
    Orphanoudakis, TG
    SIXTH IEE CONFERENCE ON TELECOMMUNICATIONS, 1998, (451): : 6 - 10
  • [37] A cluster file system for high data availability using locality-aware partial replication
    Kim, Jinseok
    Sim, Sangman
    Park, Sungyong
    2007 CIT: 7TH IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY, PROCEEDINGS, 2007, : 345 - 350
  • [38] EAD: An Efficient and Adaptive Decentralized File Replication Algorithm in P2P File Sharing Systems
    Shen, Haiying
    P2P'08: EIGHTH INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING, PROCEEDINGS, 2008, : 99 - 108
  • [39] Multigranularity Space Management Scheme for Accelerating the Write Performance of In-Memory File Systems
    Wu, Ting
    Liu, Kai
    Xiao, ChunHua
    Liu, Bingyi
    Zhuge, Qingfeng
    Sha, Edwin H. -M.
    IEEE SYSTEMS JOURNAL, 2020, 14 (04): : 5429 - 5440
  • [40] A Flash-Aware Cluster Allocation Scheme for Legacy File Systems
    Kim, Sung-Kwan
    Kwon, Hunki
    Lee, Dong-Hee
    Noh, Sam H.
    Min, Sang Lyul
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2009, 25 (04) : 1191 - 1220