High-availability in-memory key-value store using RDMA and Optane DCPMM

被引:3
|
作者
Qi, Xuecheng [1 ]
Hu, Huiqi [1 ]
Guo, Jinwei [1 ]
Huang, Chenchen [1 ]
Zhou, Xuan [1 ]
Xu, Ning [2 ]
Fu, Yu [2 ]
Zhou, Aoying [1 ]
机构
[1] East China Normal Univ, Sch Data Sci & Engn, Shanghai 200062, Peoples R China
[2] China Construct Bank Financial Technol Co Ltd, Shanghai 200120, Peoples R China
关键词
Data persistence - High availability - Key-value stores - Memory keys - Performance - Remote data - Round trip - Write amplifications;
D O I
10.1007/s11704-022-1123-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a fast high-availability in-memory key-value store based on RDMA network and Optane DCPMM named FaHA. FaHA proposes RDMA persist PRC that enables remote data persistence for fast log shipping with minimal round-trip and persistence overhead. FaHA further designs append-only storage with pipeline batching scheme in NVM and a hotness-aware differential hash index in DRAM to relieve read/write amplification of Optane DCPMM. Evaluations show that FaHA supports up to 2–3 synchronous backups without significantly lowering the primary’s performance, and outperforms existing works.
引用
收藏
页数:3
相关论文
共 50 条
  • [1] High-availability in-memory key-value store using RDMA and Optane DCPMM
    Xuecheng Qi
    Huiqi Hu
    Jinwei Guo
    Chenchen Huang
    Xuan Zhou
    Ning Xu
    Yu Fu
    Aoying Zhou
    Frontiers of Computer Science, 2023, 17
  • [2] ChameleonDB: a Key-value Store for Optane Persistent Memory
    Zhang, Wenhui
    Zhao, Xingsheng
    Jiang, Song
    Jiang, Hong
    PROCEEDINGS OF THE SIXTEENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS (EUROSYS '21), 2021, : 194 - 209
  • [3] Fast In-Memory Key-Value Cache System with RDMA
    Ghen, Wei
    Yu, Songping
    Wang, Zhiying
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2019, 28 (05)
  • [4] LibreKV: A Persistent in-Memory Key-Value Store
    Liu, Hao
    Huang, Linpeng
    Zhu, Yanmin
    Shen, Yanyan
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2020, 8 (04) : 916 - 927
  • [5] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    PROCEEDINGS OF THE 21ST USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, NSDI 24, 2024, : 209 - 224
  • [6] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    PROCEEDINGS OF THE 22ND USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 24, 2024, : 209 - 224
  • [7] SKVM: Scaling In-Memory Key-Value Store on Multicore
    Zheng, Ran
    Wang, Wenjin
    Jin, Hai
    Zhang, Qin
    2015 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATION (ISCC), 2015, : 601 - 606
  • [8] Rethinking Key-Value Store for Byte-Addressable Optane Persistent Memory
    Wu, Sung-Ming
    Chang, Li-Pin
    PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 805 - 810
  • [9] HotRing: A Hotspot-Aware In-Memory Key-Value Store
    Chen, Jiqiang
    Chen, Liang
    Wang, Sheng
    Zhu, Guoyun
    Sun, Yuanyuan
    Liu, Huan
    Li, Feifei
    PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2020, : 239 - 252
  • [10] SwapKV: A Hotness Aware In-Memory Key-Value Store for Hybrid Memory Systems
    Cui, Lixiao
    He, Kewen
    Li, Yusen
    Li, Peng
    Zhang, Jiachen
    Wang, Gang
    Liu, Xiaoguang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 917 - 930