Weaver: A High-Performance, Transactional Graph Database Based on Refinable Timestamps

被引:29
|
作者
Dubey, Ayush [1 ]
Hill, Greg D. [2 ]
Escriva, Robert [1 ]
Sirer, Emin Gun [1 ]
机构
[1] Cornell Univ, Ithaca, NY 14853 USA
[2] Stanford Univ, Stanford, CA 94305 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2016年 / 9卷 / 11期
基金
美国国家科学基金会;
关键词
D O I
10.14778/2983200.2983202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph databases have become a common infrastructure component. Yet existing systems either operate on offline snapshots, provide weak consistency guarantees, or use expensive concurrency control techniques that limit performance. In this paper, we introduce a new distributed graph database, called Weaver, which enables efficient, transactional graph analyses as well as strictly serializable ACID transactions on dynamic graphs. The key insight that allows Weaver to combine strict serializability with horizontal scalability and high performance is a novel request ordering mechanism called refinable timestamps. This technique couples coarse-grained vector timestamps with a fine-grained timeline oracle to pay the overhead of strong consistency only when needed. Experiments show that Weaver enables a Bitcoin blockchain explorer that is 8x faster than Blockchain. info, and achieves 10 : 9x higher throughput than the Titan graph database on social network workloads and 4x lower latency than GraphLab on offline graph traversal workloads.
引用
收藏
页码:852 / 863
页数:12
相关论文
共 50 条
  • [1] High-Performance with an In-GPU Graph Database Cache
    Morishima, Shin
    Matsutani, Hiroki
    IT PROFESSIONAL, 2017, 19 (06) : 58 - 64
  • [2] ByteGraph: A High-Performance Distributed Graph Database in ByteDance
    Li, Changji
    Chen, Hongzhi
    Zhang, Shuai
    Hu, Yingqian
    Chen, Chao
    Zhang, Zhenjie
    Li, Meng
    Li, Xiangchen
    Han, Dongqing
    Chen, Xiaohui
    Wang, Xudong
    Zhu, Huiming
    Fu, Xuwei
    Wu, Tingwei
    Tan, Hongfei
    Ding, Hengtian
    Liu, Mengjin
    Wang, Kangcheng
    Ye, Ting
    Li, Lei
    Li, Xin
    Wang, Yu
    Zheng, Chenguang
    Yang, Hao
    Cheng, James
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (12): : 3306 - 3318
  • [3] High-Performance Transactional Event Processing
    Cunei, Antonio
    Guerraoui, Rachid
    Spring, Jesper Honig
    Privat, Jean
    Vitek, Jan
    COORDINATION MODELS AND LANGUAGES, PROCEEDINGS, 2009, 5521 : 27 - +
  • [4] GeaBase: A High-Performance Distributed Graph Database for Industry-Scale Applications
    Fu, Zhisong
    Wu, Zhengwei
    Li, Houyi
    Li, Yize
    Wu, Min
    Chen, Xiaojie
    Ye, Xiaomeng
    Yu, Benquan
    Hu, Xi
    2017 FIFTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2017, : 170 - 175
  • [5] Pageserver: High-Performance SSD-Based Checkpointing of Transactional Distributed Memory
    Gerhold, Steffen
    Kaemmer, Nico
    Weggerle, Alexander
    Himpel, Christian
    Schulthess, Peter
    2010 SECOND INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATIONS: ICCEA 2010, PROCEEDINGS, VOL 1, 2010, : 235 - 239
  • [6] Transactional execution: Toward reliable, high-performance multithreading
    Rajwar, R
    Goodman, J
    IEEE MICRO, 2003, 23 (06) : 117 - 125
  • [7] Performance Evaluation of Intel® Transactional Synchronization Extensions for High-Performance Computing
    Yoo, Richard M.
    Hughes, Christopher J.
    Lai, Konrad
    Rajwar, Ravi
    2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC), 2013,
  • [8] A High-Performance Energy Management System Based on Evolving Graph
    Liu, Guangyi
    Yuan, Chen
    Chen, Xi
    Wu, Jingjin
    Dai, Renchang
    Wang, Zhiwei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (02) : 350 - 354
  • [9] Graph BLAST: A High-Performance Linear Algebra-based Graph Framework on the GPU
    Yang, Carl
    Buluc, Aydin
    Owens, John D.
    ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2022, 48 (01):
  • [10] Graph analysis with high-performance computing
    Hendrickson, Bruce
    Berry, JonatHan W.
    COMPUTING IN SCIENCE & ENGINEERING, 2008, 10 (02) : 14 - 19