High-availability in-memory key-value store using RDMA and Optane DCPMM

被引:3
|
作者
Qi, Xuecheng [1 ]
Hu, Huiqi [1 ]
Guo, Jinwei [1 ]
Huang, Chenchen [1 ]
Zhou, Xuan [1 ]
Xu, Ning [2 ]
Fu, Yu [2 ]
Zhou, Aoying [1 ]
机构
[1] East China Normal Univ, Sch Data Sci & Engn, Shanghai 200062, Peoples R China
[2] China Construct Bank Financial Technol Co Ltd, Shanghai 200120, Peoples R China
关键词
Data persistence - High availability - Key-value stores - Memory keys - Performance - Remote data - Round trip - Write amplifications;
D O I
10.1007/s11704-022-1123-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a fast high-availability in-memory key-value store based on RDMA network and Optane DCPMM named FaHA. FaHA proposes RDMA persist PRC that enables remote data persistence for fast log shipping with minimal round-trip and persistence overhead. FaHA further designs append-only storage with pipeline batching scheme in NVM and a hotness-aware differential hash index in DRAM to relieve read/write amplification of Optane DCPMM. Evaluations show that FaHA supports up to 2–3 synchronous backups without significantly lowering the primary’s performance, and outperforms existing works.
引用
收藏
页数:3
相关论文
共 50 条
  • [41] Applying Software-based Memory Error Correction for In-Memory Key-Value Store: Case Studies on Memcached and RAMCloud
    Li, Yin
    Wang, Hao
    Zhao, Xiaoqing
    Sun, Hongbin
    Zhang, Tong
    MEMSYS 2016: PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON MEMORY SYSTEMS, 2016, : 268 - 278
  • [42] A Scalable and Persistent Key-Value Store Using Non-Volatile Memory
    Kim, Doyoung
    Choi, Won Gi
    Sung, Hanseung
    Park, Sanghyun
    SAC '19: PROCEEDINGS OF THE 34TH ACM/SIGAPP SYMPOSIUM ON APPLIED COMPUTING, 2019, : 464 - 467
  • [43] Poster: Load Balancing for In-Memory Key-Value Data Stores
    Azqueta-Alzuaz, Ainhoa
    Pahno-Martinez, Marta
    2024 IEEE 44TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS 2024, 2024, : 1442 - 1443
  • [44] Replicating Persistent Memory Key-Value Stores with E fficient RDMA Abstraction
    Wang, Qing
    Lu, Youyou
    Wang, Jing
    Shu, Jiwu
    PROCEEDINGS OF THE 17TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, OSDI 2023, 2023, : 441 - 459
  • [45] A Multicore-Friendly Persistent Memory Key-Value Store
    Wang Q.
    Zhu B.
    Shu J.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (02): : 397 - 405
  • [46] TurboHash: A Hash Table for Key-value Store on Persistent Memory
    Zhao, Xingsheng
    Zhong, Chen
    Jiang, Song
    PROCEEDINGS OF THE 16TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE, SYSTOR 2023, 2023, : 35 - 48
  • [47] AStore: Uniformed Adaptive Learned Index and Cache for RDMA-Enabled Key-Value Store
    Qiao, Pengpeng
    Zhang, Zhiwei
    Li, Yuntong
    Yuan, Ye
    Wang, Shuliang
    Wang, Guoren
    Yu, Jeffrey Xu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (07) : 2877 - 2894
  • [48] Ultra-Low-Latency and Flexible In-Memory Key-Value Store System Design on CPU-FPGA
    Qiu, Yunhui
    Lv, Hankun
    Xie, Jinyu
    Yin, Wenbo
    Wang, Lingli
    2018 INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (FPT 2018), 2018, : 145 - 152
  • [49] FUSEE: A Fully Memory-Disaggregated Key-Value Store
    Shen, Jiacheng
    Zuo, Pengfei
    Luo, Xuchuan
    Yang, Tianyi
    Su, Yuxin
    Zhou, Yangfan
    Lyu, Michael R.
    PROCEEDINGS OF THE 21ST USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 2023, 2023, : 81 - 97
  • [50] ZDB-High performance key-value store
    Thanh Nguyen Trung
    Minh Nguyen Hieu
    2013 THIRD WORLD CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGIES (WICT), 2013, : 311 - 316