Dalio: In-Kernel Centralized Replication for Key-Value Stores

被引:0
|
作者
Kim, Gyuyeong [1 ]
机构
[1] Sungshin Womens Univ, Dept Comp Engn, Seoul, South Korea
关键词
networking stacks; replication protocol; in-kernel acceleration;
D O I
10.1587/transinf.2024EDL8060
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Replication is commonly used in distributed key-value stores for high availability. Recent works show that centralized replication provides high throughput through low-overhead write coordination and consistency-aware read forwarding. Unfortunately, they rely on specialized hardware, which is deploy-challenging and poses various limitations. To this end, we present Dalio, a software-based centralized replication system that does not require extra hardware while supporting high throughput. Our key idea is to offload the replication function to per-shard load balancers with eBPF, an emerging kernel-native technique. By building a replication coordinator with eBPF, we can avoid burdensome kernel networking stack overhead. Our experimental results show that Dalio achieves throughput better than the vanilla Linux by up to 2.05x and is comparable to a hardware-based solution.
引用
收藏
页码:157 / 160
页数:4
相关论文
共 50 条
  • [41] An adaptive replica placement approach for distributed key-value stores
    Costa Filho, Jose S.
    Cavalcante, Denis M.
    Moreira, Leonardo O.
    Machado, Javam C.
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (11):
  • [42] Chapar: Certified Causally Consistent Distributed Key-Value Stores
    Lesani, Mohsen
    Bell, Christian J.
    Chlipala, Adam
    ACM SIGPLAN NOTICES, 2016, 51 (01) : 357 - 370
  • [43] Oblivious Key-Value Stores and Amplification for Private Set Intersection
    Garimella, Gayathri
    Pinkas, Benny
    Rosulek, Mike
    Ni Trieu
    Yanai, Avishay
    ADVANCES IN CRYPTOLOGY - CRYPTO 2021, PT II, 2021, 12826 : 395 - 425
  • [44] Chisel: Reshaping Queries to Trim Latency in Key-Value Stores
    Birke, Robert
    Perez, Juan E.
    Ben Mokhtar, Sonia
    Rameshan, Navaneeth
    Chen, Lydia Y.
    2019 IEEE INTERNATIONAL CONFERENCE ON AUTONOMIC COMPUTING (ICAC 2019), 2019, : 42 - 51
  • [45] Compressed Incremental Checkpointing for Efficient Replicated Key-Value Stores
    Guler, Berkin
    Ozkasap, Oznur
    2017 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2017, : 76 - 81
  • [46] Understanding and improvement of the selection of replica servers in key-value stores
    Jiang, Wanchun
    Xie, Haiming
    Zhou, Xiangqian
    Fang, Liyuan
    Wang, Jianxin
    INFORMATION SYSTEMS, 2019, 83 : 218 - 228
  • [47] BigSecret: A Secure Data Management Framework for Key-Value Stores
    Pattuk, Erman
    Kantarcioglu, Murat
    Khadilkar, Vaibhav
    Ulusoy, Huseyin
    Mehrotra, Sharad
    2013 IEEE SIXTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2013), 2013, : 147 - 154
  • [48] Enabling Low Tail Latency on Multicore Key-Value Stores
    Lersch, Lucas
    Schreter, Ivan
    Oukid, Ismail
    Lehner, Wolfgang
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2020, 13 (07): : 1091 - 1104
  • [49] Consistent Low Latency Scheduler for Distributed Key-Value Stores
    Jiang, Wanchun
    Li, Haoyang
    Yan, Yulong
    Ji, Fa
    Huang, Jiawei
    Wang, Jianxin
    Zhang, Tong
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (12) : 3012 - 3027
  • [50] A Novel Design to Support Skyline Query In Key-Value Stores
    Chang, Che-Wei
    Chu, Cheng-Lung
    Chao, Yu-Chang
    2012 6TH INTERNATIONAL CONFERENCE ON NEW TRENDS IN INFORMATION SCIENCE, SERVICE SCIENCE AND DATA MINING (ISSDM2012), 2012, : 813 - 818