Parallel Overlapping Community Detection Algorithm on GPU

被引:10
|
作者
Zheng, Zhigao [1 ]
Shi, Xuanhua [1 ]
Jin, Hai [1 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Engn Res Ctr Big DataTechnol & Syst, Serv Comp Technol & Syst Lab, Wuhan 430074, Peoples R China
基金
美国国家科学基金会; 国家重点研发计划;
关键词
Graphics processing units; Message systems; Detection algorithms; Image edge detection; Big Data; Parallel processing; Instruction sets; Overlapping community detection; B-Tree; warp-centric thread assignment strategy; GPGPU; parallelism; POWER-LAW DISTRIBUTIONS;
D O I
10.1109/TBDATA.2022.3180360
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Community detection is one of the most representative graph mining applications, which is often assembled as a concurrent graph partition application to explore the maximum modularity (or gained modularity) of each community. However, many branch divergence operations create significant obstacles to unleashing GPU's high throughput and memory bandwidth, which are needed in community detection applications to divide the vertices into different communities. In this paper, we present Lugger, a GPU-based overlapping community detection algorithm that reduces GPU's branch divergence via the customer-designed cache-aware parallel searching technique. In Lugger, we first design a cache-aware parallel searching policy using the B-Tree structure. Then, we set the B-Tree node matches with the GPU cache line to meet the coalesced memory access manner and avoid the branch divergence in warps. Moreover, we design a positive node splitting scheme to reduce the lock operation and idle threads when building the B-Tree structure. In addition, we implement a warp-centric thread assignment strategy to make sure the workloads across threads are balanced. We implement the proposed algorithm on NVIDIA GPU and evaluate the performance on eight large graphs (up to 3 M vertices and 117 M edges) with ground-truth communities. The experimental results show that Lugger can outperform the state-of-the-art works on scalability and detection quality.
引用
收藏
页码:677 / 687
页数:11
相关论文
共 50 条
  • [32] An overlapping community detection algorithm based on rough clustering of links
    Gupta, Samrat
    Kumar, Pradeep
    DATA & KNOWLEDGE ENGINEERING, 2020, 125
  • [33] A link clustering based memetic algorithm for overlapping community detection
    Li, Mingming
    Liu, Jing
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2018, 503 : 410 - 423
  • [34] Density Peaks Based Clustering Algorithm for Overlapping Community Detection
    Liu, Hongtao
    Zhao, Chaoyue
    Tian, Yuan
    Yang, Juan
    PROCEEDINGS OF 2016 12TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2016, : 1 - 8
  • [35] A Parallel and Scalable Framework for Non-overlapping Community Detection Algorithms
    Jin, Songchang
    Zhang, Yuchao
    Nie, Yuanping
    Zhu, Xiang
    Yin, Hong
    Li, Aiping
    Yang, Shuqiang
    WEB TECHNOLOGIES AND APPLICATIONS, APWEB 2014, PT II, 2014, 8710 : 115 - 126
  • [36] Fuzzy Modularity Based Louvain Algorithm For Overlapping Community Detection
    Cao, KeYin
    Liu, Yu
    Zhang, HuaXin
    2019 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION PROCESSING (ICIIP 2019), 2019, : 18 - 23
  • [37] Density-Peak-Based Overlapping Community Detection Algorithm
    Sun, Liping
    Ye, Tao
    Sun, Jian
    Duan, Xiaoyu
    Luo, Yonglong
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2022, 9 (04): : 1211 - 1223
  • [38] Overlapping community detection algorithm based on similarity of node relationship
    Liu, Hongtao
    Li, Zhiqiang
    Wang, Ning
    SOFT COMPUTING, 2023, 27 (19) : 13689 - 13700
  • [39] Overlapping community detection algorithm based on similarity of node relationship
    Hongtao Liu
    Zhiqiang Li
    Ning Wang
    Soft Computing, 2023, 27 : 13689 - 13700
  • [40] An Ant Colony Random Walk Algorithm for Overlapping Community Detection
    Ma, TianRen
    Xia, Zhengyou
    Yang, Fan
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2017, 2017, 10585 : 20 - 26