CaseDB: Lightweight Key-Value Store for Edge Computing Environment

被引:5
|
作者
Tulkinbekov, Khikmatullo [1 ]
Kim, Deok-Hwan [1 ]
机构
[1] Inha Univ, Dept Elect Engn, Incheon 22211, South Korea
基金
新加坡国家研究基金会;
关键词
Compaction; Nonvolatile memory; Big Data; Metadata; Edge computing; Databases; Merging; Key-value store; LSM-tree; NoSQL; write and space amplification; edge computing; TREE;
D O I
10.1109/ACCESS.2020.3016680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Key-value stores based on a log-structured merge (LSM) tree have emerged in big data systems because of their scalability and reliability. An LSM-tree offers a multilevel data structure with a simple interface. However, it performs file rewrites at the disk level, which causes write amplification. This study is concerned with this problem in relation to an embedded board environment, which can be used in edge computing. Addressing the major problems associated with an LSM-tree, we propose a new key-value store named CaseDB, which aggressively separates keys and bloom filters on the non-volatile memory express (NVMe) drive and stores the values on the SSD. Our solution reduces the I/O cost and enhances the overall performance in a cost-efficient manner. CaseDB employs a memory component, CBuffer, to avoid small write operations, and a delayed value compaction technique that guarantees the sorted order for both keys and values. CaseDB also utilizes deduction-based data deduplication to prevent space amplification in the values layer. The experiments show that CaseDB outperforms LevelDB and WiscKey 5.7 and 1.8 times, respectively, with respect to data writes, and additionally improves the read performance by 1.5 times. CaseDB also avoids the space amplification of WiscKey.
引用
收藏
页码:149775 / 149786
页数:12
相关论文
共 50 条
  • [31] An extra spatial hierarchical schema in key-value store
    Zheng, Kun
    Zheng, Kang
    Fang, Falin
    Zhang, Miao
    Li, Qi
    Wang, Yanghui
    Zhao, Wenyu
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 3): : S6483 - S6497
  • [32] SconeKV: A Scalable, Strongly Consistent Key-Value Store
    Goncalves, Joao
    Matos, Miguel
    Rodrigues, Rodrigo
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 4164 - 4175
  • [33] ChameleonDB: a Key-value Store for Optane Persistent Memory
    Zhang, Wenhui
    Zhao, Xingsheng
    Jiang, Song
    Jiang, Hong
    PROCEEDINGS OF THE SIXTEENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS (EUROSYS '21), 2021, : 194 - 209
  • [34] Distributed Key-Value Storage for Edge Computing and its Explicit Data Distribution Method
    Nagato, Takehiro
    Tsutano, Takumi
    Kamada, Tomio
    Takaki, Yumi
    Ohta, Chikara
    33RD INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2019), 2019, : 147 - 152
  • [35] Distributed Key-Value Storage for Edge Computing and Its Explicit Data Distribution Method
    Nagato, Takehiro
    Tsutano, Takumi
    Kamada, Tomio
    Takaki, Yumi
    Ohta, Chikara
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2020, E103B (01) : 20 - 31
  • [36] Lightweight and Accurate Memory Allocation in Key-Value Cache
    Pan, Cheng
    Zhou, Lan
    Luo, Yingwei
    Wang, Xiaolin
    Wang, Zhenlin
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2019, 47 (03) : 451 - 466
  • [37] Lightweight and Accurate Memory Allocation in Key-Value Cache
    Cheng Pan
    Lan Zhou
    Yingwei Luo
    Xiaolin Wang
    Zhenlin Wang
    International Journal of Parallel Programming, 2019, 47 : 451 - 466
  • [38] PLDB: Protecting LSM-based Key-Value Store using Trusted Execution Environment
    Shen, Chenkai
    Fan, Lei
    2023 IEEE 22ND INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, BIGDATASE, CSE, EUC, ISCI 2023, 2024, : 762 - 771
  • [39] EMT: Elegantly Measured Tanner for Key-Value Store on SSD
    Chang, Tai
    Hsieh, Jen-Wei
    Chang, Tai-Chieh
    Lai, Liang-Wei
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (01) : 91 - 103
  • [40] KVell: the Design and Implementation of a Fast Persistent Key-Value Store
    Lepers, Baptiste
    Balmau, Oana
    Gupta, Karan
    Zwaenepoel, Willy
    PROCEEDINGS OF THE TWENTY-SEVENTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES (SOSP '19), 2019, : 447 - 461