Dalio: In-Kernel Centralized Replication for Key-Value Stores

被引:0
|
作者
Kim, Gyuyeong [1 ]
机构
[1] Sungshin Womens Univ, Dept Comp Engn, Seoul, South Korea
关键词
networking stacks; replication protocol; in-kernel acceleration;
D O I
10.1587/transinf.2024EDL8060
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Replication is commonly used in distributed key-value stores for high availability. Recent works show that centralized replication provides high throughput through low-overhead write coordination and consistency-aware read forwarding. Unfortunately, they rely on specialized hardware, which is deploy-challenging and poses various limitations. To this end, we present Dalio, a software-based centralized replication system that does not require extra hardware while supporting high throughput. Our key idea is to offload the replication function to per-shard load balancers with eBPF, an emerging kernel-native technique. By building a replication coordinator with eBPF, we can avoid burdensome kernel networking stack overhead. Our experimental results show that Dalio achieves throughput better than the vanilla Linux by up to 2.05x and is comparable to a hardware-based solution.
引用
收藏
页码:157 / 160
页数:4
相关论文
共 50 条
  • [31] Enabling Encrypted Rich Queries in Distributed Key-Value Stores
    Guo, Yu
    Yuan, Xingliang
    Wang, Xinyu
    Wang, Cong
    Li, Baochun
    Jia, Xiaohua
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (06) : 1283 - 1297
  • [32] Crowdsourced Data Integrity Verification for Key-Value Stores in the Cloud
    Weintraub, Grisha
    Gudes, Ehud
    2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, : 498 - 503
  • [33] Rethink the Linearizability Constraints of Raft for Distributed Key-Value Stores
    Wang, Yangyang
    Wang, Zikai
    Chai, Yunpeng
    Wang, Xin
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 1877 - 1882
  • [34] KVSwitch: An In-network Load Balancer for Key-Value Stores
    Shi, Yang
    Fei, Jiawei
    Wen, Mei
    Zhang, Chunyuan
    2019 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2019, : 657 - 663
  • [35] Ontology-Mediated Query Answering for Key-Value Stores
    Bienvenu, Meghyn
    Bourhis, Pierre
    Mugnier, Marie-Laure
    Tison, Sophie
    Ulliana, Federico
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 844 - 851
  • [36] GeoWave: Utilizing Distributed Key-Value Stores for Multidimensional Data
    Whitby, Michael A.
    Fecher, Rich
    Bennight, Chris
    ADVANCES IN SPATIAL AND TEMPORAL DATABASES, SSTD 2017, 2017, 10411 : 105 - 122
  • [37] SplinterDB: Closing the Bandwidth Gap for NVMe Key-Value Stores
    Conway, Alex
    Gupta, Abhishek
    Chidambaran, Vijay
    Farach-Colton, Martin
    Spillane, Rick
    Tai, Amy
    Johnson, Rob
    PROCEEDINGS OF THE 2020 USENIX ANNUAL TECHNICAL CONFERENCE, 2020, : 49 - 63
  • [38] Accordion: Better Memory Organization for LSM Key-Value Stores
    Bortnikov, Edward
    Braginsky, Anastasia
    Hillel, Eshcar
    Keidar, Idit
    Sheffi, Gali
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2018, 11 (12): : 1863 - 1875
  • [39] Brief Announcement: Robust Data Sharing with Key-Value Stores
    Basescu, Cristina
    Cachin, Christian
    Eyal, Ittay
    Haas, Robert
    Vukolic, Marko
    PODC 11: PROCEEDINGS OF THE 2011 ACM SYMPOSIUM PRINCIPLES OF DISTRIBUTED COMPUTING, 2011, : 221 - 222
  • [40] COBRA: Making Transactional Key-Value Stores Verifiably Serializable
    Tan, Cheng
    Zhao, Changgeng
    Mu, Shuai
    Walfish, Michael
    PROCEEDINGS OF THE 14TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDI '20), 2020, : 63 - 80