CaseDB: Lightweight Key-Value Store for Edge Computing Environment

被引:5
|
作者
Tulkinbekov, Khikmatullo [1 ]
Kim, Deok-Hwan [1 ]
机构
[1] Inha Univ, Dept Elect Engn, Incheon 22211, South Korea
基金
新加坡国家研究基金会;
关键词
Compaction; Nonvolatile memory; Big Data; Metadata; Edge computing; Databases; Merging; Key-value store; LSM-tree; NoSQL; write and space amplification; edge computing; TREE;
D O I
10.1109/ACCESS.2020.3016680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Key-value stores based on a log-structured merge (LSM) tree have emerged in big data systems because of their scalability and reliability. An LSM-tree offers a multilevel data structure with a simple interface. However, it performs file rewrites at the disk level, which causes write amplification. This study is concerned with this problem in relation to an embedded board environment, which can be used in edge computing. Addressing the major problems associated with an LSM-tree, we propose a new key-value store named CaseDB, which aggressively separates keys and bloom filters on the non-volatile memory express (NVMe) drive and stores the values on the SSD. Our solution reduces the I/O cost and enhances the overall performance in a cost-efficient manner. CaseDB employs a memory component, CBuffer, to avoid small write operations, and a delayed value compaction technique that guarantees the sorted order for both keys and values. CaseDB also utilizes deduction-based data deduplication to prevent space amplification in the values layer. The experiments show that CaseDB outperforms LevelDB and WiscKey 5.7 and 1.8 times, respectively, with respect to data writes, and additionally improves the read performance by 1.5 times. CaseDB also avoids the space amplification of WiscKey.
引用
收藏
页码:149775 / 149786
页数:12
相关论文
共 50 条
  • [41] Key-value Store Chip Design for Low Power Consumption
    Tokusashi, Yuta
    Matsutani, Hiroki
    Amano, Hideharu
    2019 IEEE SYMPOSIUM IN LOW-POWER AND HIGH-SPEED CHIPS (COOL CHIPS 22), 2019,
  • [42] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    PROCEEDINGS OF THE 21ST USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, NSDI 24, 2024, : 209 - 224
  • [43] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    PROCEEDINGS OF THE 22ND USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 24, 2024, : 209 - 224
  • [44] Rethinking Key-Value Store for Parallel I/O Optimization
    Yin, Yanlong
    Kougkas, Antonios
    Feng, Kun
    Eslami, Hassan
    Lu, Yin
    Sun, Xian-He
    Thakur, Rajeev
    Gropp, William
    2014 INTERNATIONAL WORKSHOP ON DATA-INTENSIVE SCALABLE COMPUTING SYSTEMS (DISCS), 2014, : 33 - 40
  • [45] FacetsBase: A Key-Value Store Optimized for Querying on Scholarly Data
    Song, Jie
    Bi, Yuanguo
    Han, Guangjie
    Li, Tiantian
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (01) : 302 - 315
  • [46] A Custom Key-Value Store Hardware on FPGA for IPsec Protocol
    Benli, Murat
    Ozcan, Erdem
    Tureli, Ufuk
    2020 12TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONICS ENGINEERING (ELECO), 2020, : 150 - 154
  • [47] A Fast Learned Key-Value Store for Concurrent and Distributed Systems
    Li, Pengfei
    Hua, Yu
    Jia, Jingnan
    Zuo, Pengfei
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (06) : 2301 - 2315
  • [48] A Multicore-Friendly Persistent Memory Key-Value Store
    Wang Q.
    Zhu B.
    Shu J.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (02): : 397 - 405
  • [49] SKV: A SmartNIC-Offloaded Distributed Key-Value Store
    Sun, Shangyi
    Zhang, Rui
    Yan, Ming
    Wu, Jie
    2022 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2022), 2022, : 1 - 11
  • [50] Pantheon: Private Retrieval from Public Key-Value Store
    Ahmad, Ishtiyaque
    Agrawal, Divyakant
    El Abbadi, Amr
    Gupta, Trinabh
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 16 (04): : 643 - 656