Effective Knowledge Graph Embedding with Quaternion Convolutional Networks

被引:0
|
作者
Liang, Qiuyu [1 ,2 ,3 ]
Wang, Weihua [1 ,2 ,3 ]
Yu, Lie [4 ]
Bao, Feilong [1 ,2 ,3 ]
机构
[1] Inner Mongolia Univ, Coll Comp Sci, Hohhot, Peoples R China
[2] Natl & Local Joint Engn Res Ctr Intelligent Infor, Hohhot, Peoples R China
[3] Inner Mongolia Key Lab Multilingual Artificial In, Hohhot, Peoples R China
[4] Natl Univ Def Technol, Coll Comp Sci, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Quaternion algebra; Knowledge graph embedding; Link prediction; Convolutional neural network; NEURAL-NETWORKS;
D O I
10.1007/978-981-97-9437-9_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional Neural Networks (CNNs) have demonstrated effectiveness in knowledge graph embedding, but existing CNN-based methods encounter two main challenges. Firstly, CNN-based models with simple architectures are unable to extract latent features. Secondly, these models enhance feature extraction by adding extra modules, which inevitably increases training cost with limited performance improvement. To address these challenges, we go beyond traditional CNNs and propose a novel knowledge graph embedding model, which utilizes the powerful capability of Quaternion Convolutional Neural Networks (QCNNs) for effective representation learning. Specifically, we learn representations of entities and relations in a quaternion space and utilize QCNN to extract the inherent information of the entity-relation matrix. We evaluate the performance of our model on multiple knowledge graph completion benchmark datasets. Experimental results show that our model achieves effective improvements compared to existing CNN-based models. Moreover, in terms of training time, our model is faster than other outstanding models. The code of all experiments is available at https://github.com/llqy123/ConvQE.
引用
收藏
页码:183 / 196
页数:14
相关论文
共 50 条
  • [31] Effective negative triplet sampling for knowledge graph embedding
    Khobragade, Anish
    Mahajan, Rushikesh
    Langi, Hrithik
    Mundhe, Rohit
    Ghumbre, Shashikant
    JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2022, 43 (08): : 2075 - 2087
  • [32] Temporal Knowledge Graph Embedding for Effective Service Recommendation
    Mezni, Haithem
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (05) : 3077 - 3088
  • [33] Distilling Knowledge from Graph Convolutional Networks
    Yang, Yiding
    Qiu, Jiayan
    Song, Mingli
    Tao, Dacheng
    Wang, Xinchao
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7072 - 7081
  • [34] Knowledge Graph Convolutional Networks for Recommender Systems
    Wang, Hongwei
    Zhao, Miao
    Xie, Xing
    Li, Wenjie
    Guo, Minyi
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 3307 - 3313
  • [35] Joint embedding of structure and features via graph convolutional networks
    Lerique, Sebastien
    Abitbol, Jacob Levy
    Karsai, Marton
    APPLIED NETWORK SCIENCE, 2020, 5 (01)
  • [36] Joint embedding of structure and features via graph convolutional networks
    Sébastien Lerique
    Jacob Levy Abitbol
    Márton Karsai
    Applied Network Science, 5
  • [37] Higher-Order Graph Convolutional Embedding for Temporal Networks
    Mo, Xian
    Pang, Jun
    Liu, Zhiming
    WEB INFORMATION SYSTEMS ENGINEERING, WISE 2020, PT I, 2020, 12342 : 3 - 15
  • [38] Heterogeneous Information Network Embedding with Convolutional Graph Attention Networks
    Cao, Meng
    Ma, Xiying
    Zhu, Kai
    Xu, Ming
    Wang, Chongjun
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [39] Dynamic Embedding Graph Attention Networks for Temporal Knowledge Graph Completion
    Wang, Jingqi
    Zhu, Cui
    Zhu, Wenjun
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2022, 13368 : 722 - 734
  • [40] KGIE: Knowledge graph convolutional network for recommender system with interactive embedding
    Li, Mingqi
    Ma, Wenming
    Chu, Zihao
    KNOWLEDGE-BASED SYSTEMS, 2024, 295