Version Traveler: Fast and Memory-Efficient Version Switching in Graph Processing Systems

被引:0
作者
Ju, Xiaoen [1 ]
Williams, Dan [2 ]
Jamjoom, Hani [2 ]
Shin, Kang G. [1 ]
机构
[1] Univ Michigan, Ann Arbor, MI 48109 USA
[2] IBM TJ Watson Res Ctr, Yorktown Hts, NY USA
来源
PROCEEDINGS OF USENIX ATC '16: 2016 USENIX ANNUAL TECHNICAL CONFERENCE | 2016年
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Multi-version graph processing, where each version corresponds to a snapshot of an evolving graph, is a common scenario in large-scale graph processing. Straightforward application of existing graph processing systems often yields suboptimal performance due to high version-switching cost. We present Version Traveler (VT), a graph processing system featuring fast and memory-efficient version switching. VT achieves fast version switching by (i) representing differences among versions as deltas and (ii) constructing the next version by integrating the in-memory graph representation of the current version with the delta(s) relating the two versions. Furthermore, VT maintains high computation performance and memory compactness. Our evaluation using multi-version processing workloads with realistic datasets shows that VT outperforms PowerGraph-running 23x faster with a 15% memory overhead. VT is also superior to four multi-version processing systems, achieving up to 90% improvement when jointly considering processing time and resource consumption.
引用
收藏
页码:523 / 536
页数:14
相关论文
共 29 条
  • [1] [Anonymous], 2013, P 8 ACM EUR C COMP S, DOI DOI 10.1145/2465351.2465369
  • [2] [Anonymous], 2014, OSDI 14
  • [3] [Anonymous], 2013, P VLDB ENDOW
  • [4] [Anonymous], 2009, P 2 ACM SIGCOMM WORK
  • [5] [Anonymous], 2012, P 7 ACM EUROPEAN C C
  • [6] [Anonymous], 2012, P 10 USENIX S OP SYS
  • [7] [Anonymous], 2011, WWW
  • [8] Ben-Yehuda O. A., 2012, HOTCLOUD
  • [9] Bhardwaj Anant P., 2015, 7 BIENN C INN DAT SY
  • [10] Bhattacherjee S, 2015, PROC VLDB ENDOW, V8, P1346, DOI 10.14778/2824032.2824035