M 2 ixKG: Mixing for harder negative samples in knowledge graph

被引:3
|
作者
Che, Feihu [1 ]
Tao, Jianhua [1 ,2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Negative sampling; Knowledge graph; Mixing operation; Hard negatives;
D O I
10.1016/j.neunet.2024.106358
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph embedding (KGE) involves mapping entities and relations to low -dimensional dense embeddings, enabling a wide range of real -world applications. The mapping is achieved via distinguishing the positive and negative triplets in knowledge graphs. Therefore, how to design high -quality negative triplets is critical in the effectiveness of KEG models. Existing KGE models face challenges in generating high -quality negative triplets. Some models employ simple static distributions, i.e. uniform or Bernoulli distribution, and it is difficult for these methods to be trained distinguishably because of the sampled uninformative negative triplets. Furthermore, current methods are confined to constructing negative triplets from existing entities within the knowledge graph, limiting their ability to explore harder negatives. We introduce a novel mixing strategy in knowledge graphs called M 2 ixKG. M 2 ixKG adopts mixing operation in generating harder negative samples from two aspects: one is mixing among the heads and tails in triplets with the same relation to strengthen the robustness and generalization of the entity embeddings; the other is mixing the negatives with high scores to generate harder negatives. Our experiments, utilizing three datasets and four classical score functions, highlight the exceptional performance of M 2 ixKG in comparison to previous negative sampling algorithms.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Extending the YAGO2 Knowledge Graph with Precise Geospatial Knowledge
    Karalis, Nikolaos
    Mandilaras, Georgios
    Koubarakis, Manolis
    SEMANTIC WEB - ISWC 2019, PT II, 2019, 11779 : 181 - 197
  • [42] Graph2Seq: Fusion Embedding Learning for Knowledge Graph Completion
    Li, Weidong
    Zhang, Xinyu
    Wang, Yaqian
    Yan, Zhihuan
    Peng, Rong
    IEEE ACCESS, 2019, 7 : 157960 - 157971
  • [43] Every 2-choosable graph is (2m, m)-choosable
    Tuza, Z
    Voigt, M
    JOURNAL OF GRAPH THEORY, 1996, 22 (03) : 245 - 252
  • [44] The crossing number of the circular graph C(2m+2, m)
    Ma, DJ
    Ren, H
    Lu, JJ
    DISCRETE MATHEMATICS, 2005, 304 (1-3) : 88 - 93
  • [45] M2KGRL: A semantic-matching based framework for multimodal knowledge graph representation learning
    Chen, Tao
    Wang, Tiexin
    Zhang, Huihui
    Xu, Jianqiu
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 269
  • [46] Simple Knowledge Graph Completion Model Based on Differential Negative Sampling and Prompt Learning
    Duan, Li
    Wang, Jing
    Luo, Bing
    Sun, Qiao
    INFORMATION, 2023, 14 (08)
  • [47] A Novel Negative Sampling Based on Frequency of Relational Association Entities for Knowledge Graph Embedding
    Zhang, Yi
    Cao, Wanhua
    Liu, Juntao
    Rao, Ziyun
    JOURNAL OF WEB ENGINEERING, 2021, 20 (06): : 1867 - 1884
  • [48] FedEAN: Entity-Aware Adversarial Negative Sampling for Federated Knowledge Graph Reasoning
    Meng, Lingyuan
    Liang, Ke
    Yu, Hao
    Liu, Yue
    Zhou, Sihang
    Liu, Meng
    Liu, Xinwang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 8206 - 8219
  • [49] Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embedding
    Zhang, Yichi
    Chen, Mingyang
    Zhang, Wen
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [50] Entity-Relation Distribution-Aware Negative Sampling for Knowledge Graph Embedding
    Yao, Naimeng
    Liu, Qing
    Yang, Yi
    Li, Weihua
    Bai, Quan
    SEMANTIC WEB, ISWC 2023, PART I, 2023, 14265 : 234 - 252