Backup and Disaster Recovery System for HDFS

被引:0
|
作者
Luo, Shengmei [1 ]
Wang, Yu [2 ]
Huang, Wei [2 ]
Yu, Hongliang [2 ]
机构
[1] ZTE Corp, Cloud Comp & IT Inst, Nanjing, Jiangsu, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing, Peoples R China
关键词
HDFS; Backup; Disaster Recovery;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
HDFS has been widely used for storing massive scale data which is vulnerable to site disaster. The file system backup is an important strategy for data retention. In this paper, we present an efficient, easy-to-use Backup and Disaster Recovery System for HDFS. The system includes a client based on HDFS with additional feature of remote backup, and a remote server with a HDFS cluster to keep the backup data. It supports full backup and regularly incremental backup to the server with very low cost and high throughout. In our experiment, the average speed of backup and recovery is up to 95 MB/s, approaching the theoretical maximum speed of gigabit Ethernet.
引用
收藏
页码:154 / 157
页数:4
相关论文
共 50 条
  • [1] DISASTER RECOVERY PLANNING - BACKUP FOR A DISTRIBUTED SYSTEM
    WONG, K
    INFORMATION PRIVACY, 1981, 3 (03): : 86 - 88
  • [2] Review of disaster backup and recovery technology of information system
    Yang, Yi-Xian
    Yao, Wen-Bin
    Chen, Zhao
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2010, 33 (02): : 1 - 6
  • [3] Changing expectations for backup and disaster recovery
    Covenco Recovery Services, United Kingdom
    Comput. Fraud Secur., 2013, 1 (16-18):
  • [4] A Transmission Mechanism of the Backup for Disaster Recovery in DCNs
    Shi, Zhan
    Wang, Chenyue
    Wen, Qili
    Su, Wei
    Zhou, Huachun
    Gao, Shuai
    2017 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS (NANA), 2017, : 214 - 219
  • [5] Blackout prompts rethink of backup and disaster recovery
    Schultz, E
    COMPUTERS & SECURITY, 2003, 22 (07) : 563 - 563
  • [6] Backup for Cloud and Disaster Recovery for Consumers and SMBs
    Javaraiah, Vijaykumar
    2011 IEEE 5TH INTERNATIONAL CONFERENCE ON ADVANCED NETWORKS AND TELECOMMUNICATION SYSTEMS (ANTS), 2011,
  • [7] Design and Realization of the Cloud Data Backup System Based on HDFS
    Guo, Dong
    Du, Yong
    Li, Qiang
    Hu, Liang
    EMERGING RESEARCH IN WEB INFORMATION SYSTEMS AND MINING, 2011, 238 : 396 - 403
  • [8] MANAGEMENT OF A REMOTE BACKUP COPY FOR DISASTER RECOVERY
    KING, RP
    HALIM, N
    GARCIAMOLINA, H
    POLYZOIS, CA
    ACM TRANSACTIONS ON DATABASE SYSTEMS, 1991, 16 (02): : 338 - 368
  • [9] Overview of Data backup and Disaster Recovery in Cloud
    Suguna, S.
    Suhasini, A.
    2014 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2014,
  • [10] Evaluation of a Backup-as-a-Service Environment for Disaster Recovery
    Mendonca, Julio
    Lima, Ricardo
    Queiroz, Ewerton
    Andrade, Ermeson
    Kim, Dong Seong
    2019 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2019, : 595 - 600