Extending TCP for Accelerating Replication on Cluster File Systems over SDNs

被引:0
|
作者
Lim, Sungheon [1 ]
Kim, Hyogon [2 ]
机构
[1] Korea Univ, Comp Sci & Engn, Seoul, South Korea
[2] Korea Univ, Comp Sci, Seoul, South Korea
关键词
TCP extension; Software Defined Networking (SDN); cluster file system; data replication; network utilization; HDFS; RELIABLE MULTICAST;
D O I
10.1109/netsoft.2019.8806672
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.
引用
收藏
页码:48 / 53
页数:6
相关论文
共 50 条
  • [41] An Efficient Replication Scheme to increase file Availability in Mobile Peer to Peer Systems
    Moufida, Rahmani
    Benchaiba, Mahfoud
    2017 INTERNATIONAL SYMPOSIUM ON NETWORKS, COMPUTERS AND COMMUNICATIONS (ISNCC), 2017,
  • [42] Swarm Intelligence Based File Replication and Consistency Maintenance in Structured P2P File Sharing Systems
    Shen, Haiying
    Liu, Guoxin
    Chandler, Harrison
    IEEE TRANSACTIONS ON COMPUTERS, 2015, 64 (10) : 2953 - 2967
  • [43] TCP/IP performance over satellite and HAP integrated systems
    Cianca, E
    De Luise, A
    De Sanctis, M
    Ruggieri, M
    Prasad, R
    2004 IEEE AEROSPACE CONFERENCE PROCEEDINGS, VOLS 1-6, 2004, : 1209 - 1216
  • [44] Cluster Allocation Strategies of the ExFAT and FAT File Systems: A Comparative Study in Embedded Storage Systems
    Munegowda, Keshava
    Raju, G. T.
    Raju, Veera Manikandan
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, 2013, 174 : 691 - 698
  • [45] Cluster systems (file shared parallel systems) provided by ACOS-4/XVP PX
    Tomiyama, T
    Fujiyoshi, Y
    Yamamoto, M
    Iwamoto, K
    Kato, M
    Itoh, H
    NEC RESEARCH & DEVELOPMENT, 1997, 38 (02): : 245 - 252
  • [46] Mean time offset protocol for cluster of auction servers over TCP/IP network
    Yew, KM
    Zahidur, RM
    Lee, SP
    INTERNET APPLICATIONS, 1999, 1749 : 323 - 328
  • [47] Efficient cooperative caching for file systems in cluster-based web servers
    Ahn, WH
    Park, SH
    Park, D
    CLUSTER 2000: IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, PROCEEDINGS, 2000, : 326 - 334
  • [48] Metadata Distribution and Consistency Techniques for Large-Scale Cluster File Systems
    Xiong, Jin
    Hu, Yiming
    Li, Guojie
    Tang, Rongfeng
    Fan, Zhihua
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2011, 22 (05) : 803 - 816
  • [49] A Non-Forced-Write Atomic Commit Protocol for Cluster File Systems
    Bing-Qing Shao
    Jun-Wei Zhang
    Cai-Ping Zheng
    Hao Zhang
    Zhen-Jun Liu
    Lu Xu
    Journal of Computer Science and Technology, 2014, 29 : 303 - 315
  • [50] Accelerating Data Transfer over Tier Systems for LHC Experiments
    Seok, Woojin
    Lee, Minsun
    Kong, Jonguk
    Kwak, Jaiseung
    JOURNAL OF THE KOREAN PHYSICAL SOCIETY, 2009, 55 (05) : 2253 - 2257