M 2 ixKG: Mixing for harder negative samples in knowledge graph

被引:3
|
作者
Che, Feihu [1 ]
Tao, Jianhua [1 ,2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Negative sampling; Knowledge graph; Mixing operation; Hard negatives;
D O I
10.1016/j.neunet.2024.106358
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph embedding (KGE) involves mapping entities and relations to low -dimensional dense embeddings, enabling a wide range of real -world applications. The mapping is achieved via distinguishing the positive and negative triplets in knowledge graphs. Therefore, how to design high -quality negative triplets is critical in the effectiveness of KEG models. Existing KGE models face challenges in generating high -quality negative triplets. Some models employ simple static distributions, i.e. uniform or Bernoulli distribution, and it is difficult for these methods to be trained distinguishably because of the sampled uninformative negative triplets. Furthermore, current methods are confined to constructing negative triplets from existing entities within the knowledge graph, limiting their ability to explore harder negatives. We introduce a novel mixing strategy in knowledge graphs called M 2 ixKG. M 2 ixKG adopts mixing operation in generating harder negative samples from two aspects: one is mixing among the heads and tails in triplets with the same relation to strengthen the robustness and generalization of the entity embeddings; the other is mixing the negatives with high scores to generate harder negatives. Our experiments, utilizing three datasets and four classical score functions, highlight the exceptional performance of M 2 ixKG in comparison to previous negative sampling algorithms.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Aggregating neighborhood information for negative sampling for knowledge graph embedding
    Hai Liu
    Kairong Hu
    Fu-Lee Wang
    Tianyong Hao
    Neural Computing and Applications, 2020, 32 : 17637 - 17653
  • [22] New attention strategy for negative sampling in knowledge graph embedding
    Si Cen
    Xizhao Wang
    Xiaoying Zou
    Chao Liu
    Guoquan Dai
    Applied Intelligence, 2023, 53 : 26418 - 26438
  • [23] NSCaching: Simple and Efficient Negative Sampling for Knowledge Graph Embedding
    Zhang, Yongqi
    Yao, Quanming
    Shao, Yingxia
    Chen, Lei
    2019 IEEE 35TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2019), 2019, : 614 - 625
  • [24] Strong Consistency of M Estimator in Linear Model for φ-mixing Samples
    Wang Xue-jun
    Hu Shu-he
    Ling Ji-min
    Wei Yun-fei
    Chen Zhu-qiang
    Wang De-Hui
    CommunicationsinMathematicalResearch, 2013, 29 (01) : 32 - 40
  • [25] Heterogeneous data augmentation in graph contrastive learning for effective negative samples
    Ali, Adnan
    Li, Jinlong
    Chen, Huanhuan
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [26] Heterogeneous data augmentation in graph contrastive learning for effective negative samples
    Ali, Adnan
    Li, Jinlong
    Chen, Huanhuan
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [27] Relation-enhanced Negative Sampling for Multimodal Knowledge Graph Completion
    Xu, Derong
    Xu, Tong
    Wu, Shiwei
    Zhou, Jingbo
    Chen, Enhong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3857 - 3866
  • [28] The Impact of Negative Triple Generation Strategies and Anomalies on Knowledge Graph Completion
    Bansal, Iti
    Tiwari, Sudhanshu
    Rivero, Carlos R.
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 45 - 54
  • [29] Aggregating neighborhood information for negative sHarm probabilityampling for knowledge graph embedding
    Liu, Hai
    Hu, Kairong
    Wang, Fu-Lee
    Hao, Tianyong
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (23): : 17637 - 17653
  • [30] Negative Sampling for Knowledge Graph Completion Based on Generative Adversarial Network
    Le, Thanh
    Pham, Trinh
    Le, Bac
    COMPUTATIONAL COLLECTIVE INTELLIGENCE (ICCCI 2021), 2021, 12876 : 3 - 15