High-availability in-memory key-value store using RDMA and Optane DCPMM

被引：3

作者：

Qi, Xuecheng ^{[1
]}

Hu, Huiqi ^{[1
]}

Guo, Jinwei ^{[1
]}

Huang, Chenchen ^{[1
]}

Zhou, Xuan ^{[1
]}

Xu, Ning ^{[2
]}

Fu, Yu ^{[2
]}

Zhou, Aoying ^{[1
]}

机构：

[1] East China Normal Univ, Sch Data Sci & Engn, Shanghai 200062, Peoples R China

[2] China Construct Bank Financial Technol Co Ltd, Shanghai 200120, Peoples R China

来源：

FRONTIERS OF COMPUTER SCIENCE | 2023年 / 17卷 / 01期

关键词：

Data persistence - High availability - Key-value stores - Memory keys - Performance - Remote data - Round trip - Write amplifications;

D O I：

10.1007/s11704-022-1123-8

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper, we propose a fast high-availability in-memory key-value store based on RDMA network and Optane DCPMM named FaHA. FaHA proposes RDMA persist PRC that enables remote data persistence for fast log shipping with minimal round-trip and persistence overhead. FaHA further designs append-only storage with pipeline batching scheme in NVM and a hotness-aware differential hash index in DRAM to relieve read/write amplification of Optane DCPMM. Evaluations show that FaHA supports up to 2–3 synchronous backups without significantly lowering the primary’s performance, and outperforms existing works.

引用

页数：3

共 50 条

[31] Memory Efficient and High Performance Key-value Store on FPGA Using Cuckoo Hashing
Liang, Wei
Yin, Wenbo
Kang, Ping
Wang, Lingli
2016 26TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2016,
[32] S3: A Scalable In-memory Skip-List Index for Key-Value Store
Zhang, Jingtian
Wu, Sai
Tan, Zeyuan
Chen, Gang
Cheng, Zhushi
Cao, Wei
Gao, Yusong
Feng, Xiaojie
PROCEEDINGS OF THE VLDB ENDOWMENT, 2019, 12 (12): : 2183 - 2194
[33] BiloKey : A Scalable Bi-Index Locality-Aware In-Memory Key-Value Store
Ma, Wenlong
Zhu, Yuqing
Li, Cheng
Guo, Mengying
Bao, Yungang
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (07) : 1528 - 1540
[34] HyperKV: A High Performance Concurrent Key-Value Store for Persistent Memory
Sun, Penghao
Xue, Dongliang
You, Litong
Yan, Yan
Huang, Linpeng
19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 125 - 134
[35] Efficient Software Rejuvenation of In-memory Key-Value Storages
Jumonji, Yuto
Yamada, Hiroshi
2017 IEEE 28TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2017), 2017, : 280 - 285
[36] ShieldStore: Shielded In-memory Key-value Storage with SGX
Kim, Taehoon
Park, Joongun
Woo, Jaewook
Jeon, Seungheun
Huh, Jaehyuk
PROCEEDINGS OF THE FOURTEENTH EUROSYS CONFERENCE 2019 (EUROSYS '19), 2019,
[37] XStore: Fast RDMA-Based Ordered Key-Value Store Using Remote Learned Cache
Wei, Xingda
Chen, Rong
Chen, Haibo
Zang, Binyu
ACM TRANSACTIONS ON STORAGE, 2021, 17 (03)
[38] RHKV: An RDMA and HTM friendly key-value store for data-intensive computing
Wu, Renke
Huang, Linpeng
Zhou, Haojie
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 92 : 162 - 177
[39] XTENSTORE: Fast Shielded In-memory Key-Value Store on a Hybrid x86-FPGA System
Oh, Hyunyoung
Hwang, Dongil
Malenko, Maja
Cho, Myunghyun
Moon, Hyungon
Baunach, Marcel
Paek, Yunheung
PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 560 - 563
[40] SILT: A Memory-Efficient, High-Performance Key-Value Store
Lim, Hyeontaek
Fan, Bin
Andersen, David G.
Kaminsky, Michael
SOSP 11: PROCEEDINGS OF THE TWENTY-THIRD ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, 2011, : 1 - 13

← 1 2 3 4 5 →