Weaver: A High-Performance, Transactional Graph Database Based on Refinable Timestamps

被引:29
|
作者
Dubey, Ayush [1 ]
Hill, Greg D. [2 ]
Escriva, Robert [1 ]
Sirer, Emin Gun [1 ]
机构
[1] Cornell Univ, Ithaca, NY 14853 USA
[2] Stanford Univ, Stanford, CA 94305 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2016年 / 9卷 / 11期
基金
美国国家科学基金会;
关键词
D O I
10.14778/2983200.2983202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph databases have become a common infrastructure component. Yet existing systems either operate on offline snapshots, provide weak consistency guarantees, or use expensive concurrency control techniques that limit performance. In this paper, we introduce a new distributed graph database, called Weaver, which enables efficient, transactional graph analyses as well as strictly serializable ACID transactions on dynamic graphs. The key insight that allows Weaver to combine strict serializability with horizontal scalability and high performance is a novel request ordering mechanism called refinable timestamps. This technique couples coarse-grained vector timestamps with a fine-grained timeline oracle to pay the overhead of strong consistency only when needed. Experiments show that Weaver enables a Bitcoin blockchain explorer that is 8x faster than Blockchain. info, and achieves 10 : 9x higher throughput than the Titan graph database on social network workloads and 4x lower latency than GraphLab on offline graph traversal workloads.
引用
收藏
页码:852 / 863
页数:12
相关论文
共 50 条
  • [21] High-performance Graph Analytics on Manycore Processors
    Slota, George M.
    Rajamanickam, Sivasankaran
    Madduri, Kamesh
    2015 IEEE 29TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2015, : 17 - 27
  • [22] JobViewer: Graph-based Visualization for Monitoring High-Performance Computing System
    Dang, Tommy
    Nguyen, Ngan V. T.
    Li, Jie
    Sill, Alan
    Hass, Jon
    Chen, Yong
    2022 IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, BDCAT, 2022, : 110 - 119
  • [23] High-Performance Graph Storage and Mutation for Graph Processing and Streaming: A Review
    Firmli, Soukaina
    Chiadmi, Dalila
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2025, 16 (01) : 19 - 30
  • [24] A DATABASE CACHE FOR HIGH-PERFORMANCE AND FAST RESTART IN DATABASE-SYSTEMS
    ELHARDT, K
    BAYER, R
    ACM TRANSACTIONS ON DATABASE SYSTEMS, 1984, 9 (04): : 503 - 525
  • [25] Log(Graph): A Near-Optimal High-Performance Graph Representation
    Besta, Maciej
    Stanojevic, Dimitri
    Zivic, Tijana
    Singh, Jagpreet
    Hoerold, Maurice
    Hoefler, Torsten
    27TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES (PACT 2018), 2018,
  • [26] Galaxybase: A High Performance Native Distributed Graph Database for HTAP
    Tong, Bing
    Zhou, Yan
    Zhang, Chen
    Tang, Jianheng
    Tang, Jing
    Yang, Leihong
    Li, Qiye
    Lin, Manwu
    Bao, Zhongxin
    Li, Jia
    Chen, Lei
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2024, 17 (12): : 3893 - 3905
  • [27] Data Encryption on GPU for High-Performance Database Systems
    Jo, Heeseung
    Hong, Seung-Tae
    Chang, Jae-Woo
    Choi, Dong Hoon
    4TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT 2013), THE 3RD INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY INFORMATION TECHNOLOGY (SEIT-2013), 2013, 19 : 147 - 154
  • [28] GRIP - A HIGH-PERFORMANCE ARCHITECTURE FOR PARALLEL GRAPH REDUCTION
    JONES, SLP
    CLACK, C
    SALKILD, J
    HARDIE, M
    LECTURE NOTES IN COMPUTER SCIENCE, 1987, 274 : 98 - 112
  • [29] HPGA: A High-Performance Graph Analytics Framework on the GPU
    Yang, Haoduo
    Su, Huayou
    Wen, Mei
    Zhang, Chunyuan
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS AND COMPUTER AIDED EDUCATION (ICISCAE 2018), 2018, : 488 - 492
  • [30] High-performance operations using a compressed database architecture
    Cockshott, WP
    McGregor, D
    Wilson, J
    COMPUTER JOURNAL, 1998, 41 (05): : 283 - 296