M 2 ixKG: Mixing for harder negative samples in knowledge graph

被引:3
|
作者
Che, Feihu [1 ]
Tao, Jianhua [1 ,2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Negative sampling; Knowledge graph; Mixing operation; Hard negatives;
D O I
10.1016/j.neunet.2024.106358
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph embedding (KGE) involves mapping entities and relations to low -dimensional dense embeddings, enabling a wide range of real -world applications. The mapping is achieved via distinguishing the positive and negative triplets in knowledge graphs. Therefore, how to design high -quality negative triplets is critical in the effectiveness of KEG models. Existing KGE models face challenges in generating high -quality negative triplets. Some models employ simple static distributions, i.e. uniform or Bernoulli distribution, and it is difficult for these methods to be trained distinguishably because of the sampled uninformative negative triplets. Furthermore, current methods are confined to constructing negative triplets from existing entities within the knowledge graph, limiting their ability to explore harder negatives. We introduce a novel mixing strategy in knowledge graphs called M 2 ixKG. M 2 ixKG adopts mixing operation in generating harder negative samples from two aspects: one is mixing among the heads and tails in triplets with the same relation to strengthen the robustness and generalization of the entity embeddings; the other is mixing the negatives with high scores to generate harder negatives. Our experiments, utilizing three datasets and four classical score functions, highlight the exceptional performance of M 2 ixKG in comparison to previous negative sampling algorithms.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] DropMix: Better Graph Contrastive Learning with Harder Negative Samples
    Ma, Yueqi
    Chen, Minjie
    Li, Xiang
    2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, : 1105 - 1112
  • [2] Effects of Negative Sampling on Knowledge Graph Completion
    Bayrak, Betul
    2020 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2020, : 264 - 267
  • [3] Reinforced Negative Sampling for Knowledge Graph Embedding
    Xie, Yushun
    Wang, Haiyan
    Wang, Le
    Luo, Lei
    Lie, Jianxin
    Gu, Zhaoquan
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2024, PT IV, 2024, 14853 : 358 - 374
  • [4] Biomedical Knowledge Graph Embeddings with Negative Statements
    Sousa, Rita T.
    Silva, Sara
    Paulheim, Heiko
    Pesquita, Catia
    SEMANTIC WEB, ISWC 2023, PART I, 2023, 14265 : 428 - 446
  • [5] Negative samples selecting strategy for graph contrastive learning
    Miao, Rui
    Yang, Yintao
    Ma, Yao
    Juan, Xin
    Xue, Haotian
    Tang, Jiliang
    Wang, Ying
    Wang, Xin
    INFORMATION SCIENCES, 2022, 613 : 667 - 681
  • [6] Effective negative triplet sampling for knowledge graph embedding
    Khobragade, Anish
    Mahajan, Rushikesh
    Langi, Hrithik
    Mundhe, Rohit
    Ghumbre, Shashikant
    JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2022, 43 (08): : 2075 - 2087
  • [7] Reinforced Negative Sampling over Knowledge Graph for Recommendation
    Wang, Xiang
    Xu, Yaokun
    He, Xiangnan
    Cao, Yixin
    Wang, Meng
    Chua, Tat-Seng
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 99 - 109
  • [8] Simple and automated negative sampling for knowledge graph embedding
    Zhang, Yongqi
    Yao, Quanming
    Chen, Lei
    VLDB JOURNAL, 2021, 30 (02): : 259 - 285
  • [9] Simple and automated negative sampling for knowledge graph embedding
    Yongqi Zhang
    Quanming Yao
    Lei Chen
    The VLDB Journal, 2021, 30 : 259 - 285
  • [10] Enhancing Knowledge Graph Embedding with Probabilistic Negative Sampling
    Kanojia, Vibhor
    Maeda, Hideyuki
    Togashi, Riku
    Fujita, Sumio
    WWW'17 COMPANION: PROCEEDINGS OF THE 26TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2017, : 801 - 802