SCMKV: A Lightweight Log-Structured Key-Value Store on SCM

被引:4
|
作者
Wang, Zhenjie [1 ]
Huang, Linpeng [1 ]
Zhu, Yanmin [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
来源
基金
国家高技术研究发展计划(863计划); 中国国家自然科学基金;
关键词
Storage Class Memory; Key-value store; Memory management; Log structure;
D O I
10.1007/978-3-319-68210-5_1
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Storage Class Memories (SCMs) are promising technologies that would change the future of storage, with many attractive capabilities such as byte addressability, low latency and persistence. Existing keyvalue stores proposed for block devices use SCMs as block devices, which conceal the performance that SCMs provide. A few existing key-value stores for SCMs fail to provide consistency when hardware supports such as cache flush on power failure are unavailable. In this paper, we present a key-value store called SCMKV that provides consistency, performance and scalability. It takes advantage of characteristics of key-value workloads and leverages the log-structured technique for high throughput. In particular, we propose a static concurrent cache-friendly hash table to accelerate accesses to key-value objects, and maintain separate data logs and memory allocators for each worker thread for achieving high concurrency. To reduce write latency, it tries to reduce writes to SCMs and cache flushing instructions. Our experiments show that SCMKV achieves much higher throughput and has better scalability than state-of-the-art key-value stores.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [21] Towards Building a Lightweight Key-Value Store on Parallel File System
    Zeng, Jiaan
    Plale, Beth
    2015 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING - CLUSTER 2015, 2015, : 539 - 540
  • [22] Lightweight Indexing of Observational Data in Log-Structured Storage
    Wang, Sheng
    Maier, David
    Ooi, Beng Chin
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 7 (07): : 529 - 540
  • [23] Using Paxos to Build a Lightweight, Highly Available Key-value Data Store
    Tang, Jiayong
    Yang, Fei
    Zhang, Yong
    Xing, Chunxiao
    2013 10TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA 2013), 2013, : 300 - +
  • [24] FoundationDB: A Distributed Key-Value Store
    Zhou, Jingyu
    Xu, Meng
    Shraer, Alexander
    Namasivayam, Bala
    Miller, Alex
    Tschannen, Evan
    Atherton, Steve
    Beamon, Andrew J.
    Sears, Rusty
    Leach, John
    Rosenthal, Dave
    Dong, Xin
    Wilson, Will
    Collins, Ben
    Scherer, David
    Grieser, Alec
    Liu, Yang
    Moore, Alvin
    Muppana, Bhaskar
    Su, Xiaoge
    Yadav, Vishesh
    COMMUNICATIONS OF THE ACM, 2023, 66 (06) : 97 - 105
  • [25] TRIAD: Creating Synergies Between Memory, Disk and Log in Log Structured Key-Value Stores
    Balmau, Oana
    Didona, Diego
    Guerraoui, Rachid
    Zwaenepoel, Willy
    Yuan, Huapeng
    Arora, Aashray
    Gupta, Karan
    Konka, Pavan
    2017 USENIX ANNUAL TECHNICAL CONFERENCE (USENIX ATC '17), 2017, : 363 - 375
  • [26] Partial Tiering: A Hybrid Merge Policy for Log Structured Key-Value Stores
    Lee, Hoyoung
    Lee, Minho
    Eom, Young Ik
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2021), 2021, : 20 - 23
  • [27] RepKV: A Replicated Key-Value Store to Boost Multiple Indices for Key-Value Separation
    Tang, Chenlei
    Wan, Jiguang
    Tan, Zhihu
    Li, Guokuan
    2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, : 187 - 194
  • [28] iFKVS: Lightweight Key-Value Store for Flash-Based Intermittently Computing Devices
    Chen, Yen-Hsun
    Liao, Ting-En
    Chang, Li-Pin
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (11) : 3564 - 3575
  • [29] Vigil-KV: Hardware-Software Co-Design to Integrate Strong Latency Determinism into Log-Structured Merge Key-Value Stores
    Kwon, Miryeong
    Lee, Seungjun
    Choi, Hyunkyu
    Hwang, Jooyoung
    Jung, Myoungsoo
    PROCEEDINGS OF THE 2022 USENIX ANNUAL TECHNICAL CONFERENCE, 2022, : 755 - 771
  • [30] Monkey: Optimal Navigable Key-Value Store
    Dayan, Niv
    Athanassoulis, Manos
    Idreos, Stratos
    SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, : 79 - 94