Efficient data storage: adaptively changing chunk size in cloud computing storage systems

被引:0
|
作者
Baya, Chalabi [1 ]
Yahya, Slimani [2 ]
机构
[1] Ecole Natl Super Informat ESI, Lab Commun Syst Informat, 68M Oued Smar, Algiers 16270, Algeria
[2] Univ Manouba, ISAMM, Manouba, Tunisia
关键词
cloud computing; data striping; data management system; data storage; BlobSeer; chunk size; Hadoop; big data; scalability; concurrent access;
D O I
10.1504/IJGUC.2023.133455
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Cloud computing enables users to utilise a shared pool of resources on demand. BLOB storage is a type of cloud storage for unstructured data. Most data management systems use chunk sizes equal to a given BLOB. Despite the simplicity of this strategy, as the nodes in the system are heterogeneous, the BLOB sizes are different and access to the data is not consistent due to these issues. We propose an adaptive strategy in order to define an adequate chunk size by taking into account metrics concerning the actual resources (bandwidth, storage usage), the size of the BLOB/file and the access rate of the chunks. Our experimental results show that our proposed approach provides an execution time that is about 24% better than that of a method based only on one chunk size and about 96% better than that of a method based on a random choice of the chunk size.
引用
收藏
页码:516 / 525
页数:11
相关论文
共 50 条
  • [41] A Framework for Secure Data Storage in Mobile Cloud Computing
    Thumar, Vinodray
    Vekariya, Vipul
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ICT FOR SUSTAINABLE DEVELOPMENT ICT4SD 2015, VOL 2, 2016, 409 : 791 - 800
  • [42] Efficient proof of ownership for cloud storage systems
    Zhong, Weiwei
    Liu, Zhusong
    GREEN ENERGY AND SUSTAINABLE DEVELOPMENT I, 2017, 1864
  • [43] An Efficient Protocol With Bidirectional Verification for Storage Security in Cloud Computing
    Feng, Bin
    Ma, Xinzhu
    Guo, Cheng
    Shi, Hui
    Fu, Zhangjie
    Qiu, Tie
    IEEE ACCESS, 2016, 4 : 7899 - 7911
  • [44] A Power Efficient Persistent Storage Consolidation Algorithm for Cloud Computing
    Galloway, Jeffrey M.
    Vrbsky, Susan V.
    2012 INTERNATIONAL GREEN COMPUTING CONFERENCE (IGCC), 2012,
  • [45] An efficient algorithm for dynamic storage allocation in cloud computing environment
    Lin, Wen-Hui
    Lei, Zhen-Ming
    Liu, Jun
    Liu, Fang
    He, Gang
    International Journal of Applied Mathematics and Statistics, 2013, 48 (18): : 254 - 262
  • [46] Efficient Dynamic Replicated Data Possession Checking in Distributed Cloud Storage Systems
    Wei, Jinxia
    Liu, Jianyi
    Zhang, Ru
    Niu, Xinxin
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2016,
  • [47] IoT-Based Big Data Storage Systems in Cloud Computing: Perspectives and Challenges
    Cai, Hongming
    Xu, Boyi
    Jiang, Lihong
    Vasilakos, Athanasios V.
    IEEE INTERNET OF THINGS JOURNAL, 2017, 4 (01): : 75 - 87
  • [48] Storage Cost efficient approach for Cloud storage and Intermediate Data Sets in Clouds
    Khare, Mayank Deep
    Tripathi, Aditi
    Singh, Pradeep Kumar
    2015 INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND INTERNET OF THINGS (ICGCIOT), 2015, : 1475 - 1480
  • [49] Data deduplication mechanism for cloud storage systems
    Xu, Xiaolong
    Tu, Qun
    2015 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY, 2015, : 286 - 294
  • [50] Organization of Cloud Storage Data in Distributed Systems
    Strubytskyi, Rostyslav
    2016 13TH INTERNATIONAL CONFERENCE ON MODERN PROBLEMS OF RADIO ENGINEERING, TELECOMMUNICATIONS AND COMPUTER SCIENCE (TCSET), 2016, : 463 - 467