Extending TCP for Accelerating Replication on Cluster File Systems over SDNs

被引:0
|
作者
Lim, Sungheon [1 ]
Kim, Hyogon [2 ]
机构
[1] Korea Univ, Comp Sci & Engn, Seoul, South Korea
[2] Korea Univ, Comp Sci, Seoul, South Korea
关键词
TCP extension; Software Defined Networking (SDN); cluster file system; data replication; network utilization; HDFS; RELIABLE MULTICAST;
D O I
10.1109/netsoft.2019.8806672
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.
引用
收藏
页码:48 / 53
页数:6
相关论文
共 50 条
  • [1] Extending cluster file systems beyond last miles
    Chiou, Hann-Huei
    Tsai, Pan-Lung
    Lee, Jiunn-Jye
    Tung, Hsing-Fu
    Huang, Chun-Ying
    Lei, Chin-Laung
    TENCON 2005 - 2005 IEEE REGION 10 CONFERENCE, VOLS 1-5, 2006, : 1695 - +
  • [2] A Cluster-based File Replication Scheme for DHT-based File Backup Systems
    Dinh Nghia Nguyen
    Xuan Hoang Tran
    Hoai Son Nguyen
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR COMMUNICATIONS (ATC), 2016, : 204 - 209
  • [3] Cluster-based file replication in large-scale distributed systems
    Sandhu, Harjinder
    Zhou, Songnian
    Performance Evaluation Review, 1992, 20 (01):
  • [4] TPF: TCP plugged file system for efficient data delivery over TCP
    Lim, Sang Seok
    Park, Kyu Ho
    IEEE TRANSACTIONS ON COMPUTERS, 2007, 56 (04) : 459 - 473
  • [5] Extending file systems using stackable templates
    Zadok, E
    Badulescu, I
    Shender, A
    PROCEEDINGS OF THE 1999 USENIX ANNUAL TECHNICAL CONFERENCE, 1999, : 57 - 70
  • [6] An effective file migration algorithm in cluster file systems
    Liu, W
    Zheng, WM
    Shen, MM
    On, XM
    Wu, M
    2000 INTERNATIONAL WORKSHOPS ON PARALLEL PROCESSING, PROCEEDINGS, 2000, : 329 - 335
  • [7] Performance Evaluation of NVMe-over-TCP Using Journaling File Systems in International WAN
    Yu, Se-young
    ELECTRONICS, 2021, 10 (20)
  • [8] Cluster file systems: a case study
    Wang, JY
    Xu, ZW
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2002, 18 (03): : 373 - 387
  • [9] Improving data availability for a cluster file system through replication
    Xiong, Jin
    Li, Jianyu
    Tang, Rongfeng
    Hu, Yiming
    2008 IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL & DISTRIBUTED PROCESSING, VOLS 1-8, 2008, : 306 - +
  • [10] Building Highly Available Cluster File System Based on Replication
    Cao, Liang
    Wang, Yu
    Xiong, Jin
    2009 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES (PDCAT 2009), 2009, : 94 - 101