GHStore: A High Performance Global Hash Based Key-Value Store

被引:0
|
作者
Li, Jiaoyang [1 ,2 ]
Yue, Yinliang [1 ,2 ]
Wang, Weiping [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
关键词
Key-value store; LSM-tree; Compaction; Global segmented hashmap;
D O I
10.1007/978-3-031-00123-9_39
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Log-Structured Merge tree (LSM-tree) has become the mainstream data structure of persistent key-value (KV) stores, but it suffers from serious write and read amplification. In update intensive workloads, repeated and useless compaction of outdated data makes the problem more serious. So we design an efficient global segmented hashmap to record the level of the latest KV pairs, and we present GHStore based on it, which is a key-value store that improves overall performance in write, read and range query simultaneously for update intensive workloads. A read operation of GHStore does not need to search from top to bottom, and a write-induced compaction operation ignores outdated records. The experiments show that for update intensive workloads, compared to widely-used key-value stores (e.g. RocksDB, Wisckey and PebblesDB), GHStore decreases read latency by 10%-50%, range query latency by 15%-60%, while increases write throughput by 4%-55%.
引用
收藏
页码:493 / 508
页数:16
相关论文
共 50 条
  • [1] ZDB-High performance key-value store
    Thanh Nguyen Trung
    Minh Nguyen Hieu
    2013 THIRD WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES (WICT), 2013, : 311 - 316
  • [2] High-Performance Key-Value Store On OpenSHMEM
    Fu, Huansong
    Venkata, Manjunath Gorentla
    Choudhury, Ahana Roy
    Imam, Neena
    Yu, Weikuan
    2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, : 559 - 568
  • [3] TurboHash: A Hash Table for Key-value Store on Persistent Memory
    Zhao, Xingsheng
    Zhong, Chen
    Jiang, Song
    PROCEEDINGS OF THE 16TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE, SYSTOR 2023, 2023, : 35 - 48
  • [4] Dhcache: a dual-hash cache for optimizing the read performance in key-value store
    Lu, Jinkang
    Lv, Meng
    Li, Peixuan
    Yuan, Zhu
    Xie, Ping
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (02):
  • [5] Building New Key-value Store with High Performance and High Availability
    Zhu Y.-A.
    Jian H.-B.
    Long Y.-C.
    Li B.
    Wang S.
    Wu X.-L.
    Zhong Z.-C.
    Zhang Y.-S.
    Zhu, Yue-An (iwillgoon@126.com); Zhu, Yue-An (iwillgoon@126.com), 1600, Chinese Academy of Sciences (32): : 3203 - 3218
  • [6] Toward an in-kernel high performance key-value store implementation
    Blin, Antoine
    Lazri, Kahina
    Sopena, Julien
    Muller, Gilles
    2019 IEEE 38TH INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS 2019), 2019, : 268 - 268
  • [7] HyperKV: A High Performance Concurrent Key-Value Store for Persistent Memory
    Sun, Penghao
    Xue, Dongliang
    You, Litong
    Yan, Yan
    Huang, Linpeng
    19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 125 - 134
  • [8] FlashKey:A High-Performance Flash Friendly Key-Value Store
    Ray, Madhurima
    Kant, Krishna
    Li, Peng
    Trika, Sanjeev
    2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM IPDPS 2020, 2020, : 976 - 985
  • [9] A High-Performance Key-Value Query Solution Based on Hash dictionary and Trie tree
    Yan, Zhijia
    Sun, Zhonghan
    Zheng, Yidong
    Bu, Jiajun
    Wang, Wei
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INTELLIGENT COMMUNICATION, 2015, 16 : 171 - 174
  • [10] Improving Write Performance of LSMT-based Key-Value Store
    Zhang, WeiTao
    Xu, Yinlong
    Li, Yongkun
    Li, Dinglong
    2016 IEEE 22ND INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2016, : 553 - 560