GHStore: A High Performance Global Hash Based Key-Value Store

被引:0
|
作者
Li, Jiaoyang [1 ,2 ]
Yue, Yinliang [1 ,2 ]
Wang, Weiping [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
关键词
Key-value store; LSM-tree; Compaction; Global segmented hashmap;
D O I
10.1007/978-3-031-00123-9_39
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Log-Structured Merge tree (LSM-tree) has become the mainstream data structure of persistent key-value (KV) stores, but it suffers from serious write and read amplification. In update intensive workloads, repeated and useless compaction of outdated data makes the problem more serious. So we design an efficient global segmented hashmap to record the level of the latest KV pairs, and we present GHStore based on it, which is a key-value store that improves overall performance in write, read and range query simultaneously for update intensive workloads. A read operation of GHStore does not need to search from top to bottom, and a write-induced compaction operation ignores outdated records. The experiments show that for update intensive workloads, compared to widely-used key-value stores (e.g. RocksDB, Wisckey and PebblesDB), GHStore decreases read latency by 10%-50%, range query latency by 15%-60%, while increases write throughput by 4%-55%.
引用
收藏
页码:493 / 508
页数:16
相关论文
共 50 条
  • [21] KVRangeDB: RangeQueries for a Hash-based Key-Value Device
    Qin, Mian
    Zheng, Qing
    Lee, Jason
    Settlemyer, Bradley
    Wen, Fei
    Reddy, Narasimha
    Gratz, Paul
    ACM TRANSACTIONS ON STORAGE, 2023, 19 (03)
  • [22] PapyrusKV: A High-Performance Parallel Key-Value Store for Distributed NVM Architectures
    Kim, Jungwon
    Lee, Seyong
    Vetter, Jeffrey S.
    SC'17: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2017,
  • [23] SASS: A High-Performance Key-Value Store Design for Massive Hybrid Storage
    Wang, Jiangtao
    Guo, Zhiliang
    Meng, Xiaofeng
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PT1, 2015, 9049 : 145 - 159
  • [24] Memory Efficient and High Performance Key-value Store on FPGA Using Cuckoo Hashing
    Liang, Wei
    Yin, Wenbo
    Kang, Ping
    Wang, Lingli
    2016 26TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2016,
  • [25] RepKV: A Replicated Key-Value Store to Boost Multiple Indices for Key-Value Separation
    Tang, Chenlei
    Wan, Jiguang
    Tan, Zhihu
    Li, Guokuan
    2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, : 187 - 194
  • [26] Generalization and Implementation of RAM-Based Key-Value Store
    Tian, Tian
    Zhang, Chengfei
    Yu, Kai
    Zhang, Yiming
    Zhong, Ping
    2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE & COMPUTATIONAL INTELLIGENCE (CSCI), 2016, : 1412 - 1413
  • [27] BFC: High-Performance Distributed Big-File Cloud Storage Based On Key-Value Store
    Thanh Trung Nguyen
    Tin Khac Vu
    Minh Hieu Nguyen
    2015 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2015, : 253 - 258
  • [28] HTStore: A High-Performance Mixed Index Based Key-Value Store for Update-Intensive Workloads
    Liu, Jinzhou
    Yue, Yinliang
    Zhou, Jiang
    Fan, Zhixin
    Yao, Zekun
    WEB AND BIG DATA, PT III, APWEB-WAIM 2023, 2024, 14333 : 507 - 521
  • [29] Monkey: Optimal Navigable Key-Value Store
    Dayan, Niv
    Athanassoulis, Manos
    Idreos, Stratos
    SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, : 79 - 94
  • [30] DINOMO: An Elastic, Scalable, High-Performance Key-Value Store for Disaggregated Persistent Memory
    Lee, Sekwon
    Ponnapalli, Soujanya
    Singhal, Sharad
    Aguilera, Marcos K.
    Keeton, Kimberly
    Chidambaram, Vijay
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (13): : 4023 - 4037