SCMKV: A Lightweight Log-Structured Key-Value Store on SCM

被引:4
|
作者
Wang, Zhenjie [1 ]
Huang, Linpeng [1 ]
Zhu, Yanmin [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
来源
基金
国家高技术研究发展计划(863计划); 中国国家自然科学基金;
关键词
Storage Class Memory; Key-value store; Memory management; Log structure;
D O I
10.1007/978-3-319-68210-5_1
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Storage Class Memories (SCMs) are promising technologies that would change the future of storage, with many attractive capabilities such as byte addressability, low latency and persistence. Existing keyvalue stores proposed for block devices use SCMs as block devices, which conceal the performance that SCMs provide. A few existing key-value stores for SCMs fail to provide consistency when hardware supports such as cache flush on power failure are unavailable. In this paper, we present a key-value store called SCMKV that provides consistency, performance and scalability. It takes advantage of characteristics of key-value workloads and leverages the log-structured technique for high throughput. In particular, we propose a static concurrent cache-friendly hash table to accelerate accesses to key-value objects, and maintain separate data logs and memory allocators for each worker thread for achieving high concurrency. To reduce write latency, it tries to reduce writes to SCMs and cache flushing instructions. Our experiments show that SCMKV achieves much higher throughput and has better scalability than state-of-the-art key-value stores.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [1] Deferred Lightweight Indexing for Log-Structured Key-Value Stores
    Tang, Yuzhe
    Iyengar, Arun
    Tan, Wei
    Fong, Liana
    Liu, Ling
    Palanisamy, Balaji
    2015 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING, 2015, : 11 - 20
  • [2] Pacman: An Efficient Compaction Approach for Log-Structured Key-Value Store on Persistent Memory
    Wang, Jing
    Lu, Youyou
    Wang, Qing
    Xie, Minhui
    Huang, Keji
    Shu, Jiwu
    PROCEEDINGS OF THE 2022 USENIX ANNUAL TECHNICAL CONFERENCE, 2022, : 773 - 787
  • [3] A Read-Optimized Index Structure for Distributed Log-Structured Key-Value Store
    Kang, In-Su
    Kim, Bo-Kyeong
    Lee, Dong-Ho
    IEEE 39TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSAC 2015), VOL 3, 2015, : 650 - 651
  • [4] NVLSM: A Persistent Memory Key-Value Store Using Log-Structured Merge Tree with Accumulative Compaction
    Zhang, Baoquan
    Du, David H. C.
    ACM TRANSACTIONS ON STORAGE, 2021, 17 (03)
  • [5] Rethinking HBase: Design and Implementation of an Elastic Key-Value Store over Log-Structured Local Volumes
    Saloustros, Giorgos
    Magoutis, Kostas
    2015 14TH INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED COMPUTING (ISPDC), 2015, : 225 - 234
  • [6] Efficient key-value stores with Ranged Log-structured Merge Trees
    Song, Nae Young
    Yeom, Heon Young
    Han, Hyuck
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 652 - 659
  • [7] Realizing Strong Determinism Contract on Log-Structured Merge Key-Value Stores
    Kwon, Miryeong
    Lee, Seungjun
    Choi, Hyunkyu
    Hwang, Jooyoung
    Jung, Myoungsoo
    ACM TRANSACTIONS ON STORAGE, 2023, 19 (02)
  • [8] Concurrent Log-Structured Memory for Many-Core Key-Value Stores
    Merritt, Alexander
    Gavrilovska, Ada
    Chen, Yuan
    Milojicic, Dejan
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2017, 11 (04): : 458 - 471
  • [9] FlatStore: An Efficient Log-Structured Key-Value Storage Engine for Persistent Memory
    Chen, Youmin
    Lu, Youyou
    Yang, Fan
    Wang, Qing
    Wang, Yang
    Shu, Jiwu
    TWENTY-FIFTH INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS (ASPLOS XXV), 2020, : 1077 - 1091
  • [10] SILK: Preventing Latency Spikes in Log-Structured Merge Key-Value Stores
    Balmau, Oana
    Dinu, Florin
    Zwaenepoel, Willy
    Gupta, Karan
    Chandhiramoorthi, Ravishankar
    Didona, Diego
    PROCEEDINGS OF THE 2019 USENIX ANNUAL TECHNICAL CONFERENCE, 2019, : 753 - 766