De-duplication in File Sharing Network

被引:0
|
作者
Yadav, Divakar [1 ]
Dani, Deepali [1 ]
Kumari, Preeti [1 ]
机构
[1] Jaypee Inst Informat Technol, Noida, India
来源
CONTEMPORARY COMPUTING | 2011年 / 168卷
关键词
De-duplication; three-tier architecture; Hash Algorithm; Bandwidth conservation; Storage reduction;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Redundant data transfer over a network is one of the important reasons of traffic congestion today. In this paper, we proposed an efficient and secure file sharing model using de-duplication technology to resolve it. A file sharing based de-duplication system reduce bandwidth and storage at both client and server machine. It does not download duplicate blocks that already have been downloaded. To achieve the security of client data, three-tier architecture is proposed in this work. For this purpose SHA-1 hash function is being used, in which 8KB block of data is converted into a 20 bytes digest. Thus the design presents a dramatic reduction in storage space requirement for various workloads and hence reduces time to perform backup in bandwidth constraint environment.
引用
收藏
页码:551 / 553
页数:3
相关论文
共 50 条
  • [21] Sequence of hashes compression in data de-duplication
    Balachandran, Subashini
    Constantinescu, Cornel
    DCC: 2008 DATA COMPRESSION CONFERENCE, PROCEEDINGS, 2008, : 505 - 505
  • [22] De-duplication Approach with Enhance Security for Integrity
    Pokale, Minal Bharat
    Chaware, Sandeep M.
    2018 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING COMMUNICATION CONTROL AND AUTOMATION (ICCUBEA), 2018,
  • [23] De-duplication Framework to Reduce the Record Linkage Problem
    Dagade, Akshata
    Mali, Manisha
    2017 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS (ICCCI), 2017,
  • [24] DE DUPLICATION SCALABLE SECURE FILE SHARING ON UNTRUSTED STORAGE IN BIG DATA
    Keerthana, S.
    Monisha, C.
    Priyanka, S.
    Veena, S.
    2017 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2017,
  • [25] A Bayesian approach for de-duplication in the presence of relational data
    Sosa, Juan
    Rodriguez, Abel
    JOURNAL OF APPLIED STATISTICS, 2024, 51 (02) : 197 - 215
  • [26] Data Structure for Packet De-duplication in Distributed Environments
    Finta, Istvan
    Farkas, Lorant
    Szenasi, Sandor
    2020 IEEE SIXTH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (BIGDATASERVICE 2020), 2020, : 184 - 189
  • [27] Energy Aware Data Layout for De-duplication System
    Yan Fang
    Tan YuAn
    Liang QingGang
    Xing NingNing
    Wang YaoLei
    Zhang Xiang
    2012 13TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS, AND TECHNOLOGIES (PDCAT 2012), 2012, : 511 - 516
  • [28] A strategy of de-duplication based on the similarity of adjacent chunks
    Zhou B.
    Tan J.-H.
    2017, Taru Publications (20) : 1577 - 1580
  • [29] GDup: De-duplication of Scholarly Communication Big Graphs
    Atzori, Claudio
    Manghi, Paolo
    Bardi, Alessia
    2018 IEEE/ACM 5TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING APPLICATIONS AND TECHNOLOGIES (BDCAT), 2018, : 142 - 151
  • [30] Markov Logic Networks with its application in de-duplication
    Zhang, Yu-Fang
    Huang, Tao
    Ai, Dong-Mei
    Xiong, Zhong-Yang
    Tang, Rong-Jun
    Chongqing Daxue Xuebao/Journal of Chongqing University, 2010, 33 (08): : 36 - 41