DCMSL: Dual influenced community strength-boosted multi-scale graph contrastive learning

被引:0
|
作者
Chen, Han [1 ,2 ]
Li, Yuhua [1 ]
Yu, Philip S. [3 ]
Zou, Yixiong [1 ]
Li, Ruixuan [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, 1037 Luoyu East Rd, Wuhan 430074, Hubei, Peoples R China
[2] Huazhong Univ Sci & Technol, Inst Artificial Intelligence, 1037 Luoyu East Rd, Wuhan 430074, Hubei, Peoples R China
[3] Univ Illinois, Dept Comp Sci, 851 South Morgan St, Chicago, IL 60607 USA
基金
中国国家自然科学基金;
关键词
Graph neural networks; Dual influenced community strength; Node cruciality; Contrastive learning; Multi-scale learning; NETWORKS;
D O I
10.1016/j.knosys.2024.112472
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Contrastive Learning (GCL) effectively mitigates label dependency, defining positive and negative pairs for node embeddings. Nevertheless, most GCL methods, including those considering communities, overlooking the simultaneous influence of community and node-a crucial factor for accurate embeddings. In this paper, we propose Dual influenced Community Strength-boosted Multi-Scale Graph Contrastive Learning (DCMSL), concurrently considering community and node influence for comprehensive contrastive learning. Firstly, we define dual influenced community strength which can be adaptable to diverse datasets. Based on it, we define node cruciality to differentiate node importance. Secondly, two graph data augmentation methods, NCNAM and NCED, respectively, are put forward based on node cruciality, guiding graph augmentation to preserve more influential semantic information. Thirdly, a joint multi-scale graph contrastive scheme is raised to guide the graph encoder to learn data semantic information at two scales: (1) Propulsive force node-level graph contrastive learning-a node-level graph contrastive loss defining the force to push negative pairs in GCL farther away. (2) Community-level graph contrastive learning-enabling the graph encoder to learn from data on the community level, improving model performance. DCMSL achieves state-of-the-art results, demonstrating its effectiveness and versatility in two node-level tasks: node classification and node clustering and one edge-level task: link prediction. Our code is available at: https://github.com/HanChen-HUST/DCMSL.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] ANEMONE: Graph Anomaly Detection with Multi-Scale Contrastive Learning
    Jin, Ming
    Liu, Yixin
    Zheng, Yu
    Chi, Lianhua
    Li, Yuan-Fang
    Pan, Shirui
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3122 - 3126
  • [2] Multi-Scale Subgraph Contrastive Learning
    Liu, Yanbei
    Zhao, Yu
    Wang, Xiao
    Geng, Lei
    Xiao, Zhitao
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 2215 - 2223
  • [3] Deep image clustering with contrastive learning and multi-scale graph convolutional networks
    Xu, Yuankun
    Huang, Dong
    Wang, Chang-Dong
    Lai, Jian-Huang
    PATTERN RECOGNITION, 2024, 146
  • [4] Automated Multi-scale Contrastive Learning with Sample-Awareness for Graph Classification
    Li, Yafang
    Kang, Jie
    Li, Xuyang
    Jia, Caiyan
    Zu, Baokai
    WEB AND BIG DATA, APWEB-WAIM 2024, PT III, 2024, 14963 : 145 - 160
  • [5] DMSPool: Dual Multi-Scale Pooling for Graph Representation Learning
    Yu, Hualei
    Luo, Chong
    Du, Yuntao
    Cheng, Hao
    Cao, Meng
    Wang, Chongjun
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 375 - 384
  • [6] Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning
    Duan, Jingcan
    Zhang, Pei
    Wang, Siwei
    Hu, Jingtao
    Jin, Hu
    Zhang, Jiaxin
    Zhou, Haifang
    Liu, Xinwang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7502 - 7511
  • [7] Multi-scale Contrastive Learning for Gastroenteroscopy Classification
    Li, Dan
    Li, Xuechen
    Peng, Zhibin
    Chen, Wenting
    Shen, Linlin
    Wu, Guangyao
    2023 IEEE 36TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS, CBMS, 2023, : 852 - +
  • [8] Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning
    Jin, Ming
    Zheng, Yizhen
    Li, Yuan-Fang
    Gong, Chen
    Zhou, Chuan
    Pan, Shirui
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1477 - 1483
  • [9] Multi-Scale Self-Supervised Graph Contrastive Learning With Injective Node Augmentation
    Zhang, Haonan
    Ren, Yuyang
    Fu, Luoyi
    Wang, Xinbing
    Chen, Guihai
    Zhou, Chenghu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (01) : 261 - 274
  • [10] Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented View
    Duan, Jingcan
    Wang, Siwei
    Zhang, Pei
    Zhu, En
    Hu, Jingtao
    Jin, Hu
    Liu, Yue
    Dong, Zhibin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7459 - 7467