Hierarchical Knowledge-Enhancement Framework for multi-hop knowledge graph reasoning

被引:1
|
作者
Xie, Shaorong [1 ]
Liu, Ruishen [1 ]
Wang, Xinzhi
Luo, Xiangfeng [1 ]
Sugumaran, Vijayan [2 ]
Yu, Hang [1 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
[2] Oakland Univ, Dept Decis & Informat Sci, Rochester, MI 48309 USA
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
Sparse knowledge graph; Multi-hop reasoning; Hierarchical reinforcement learning;
D O I
10.1016/j.neucom.2024.127673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi -hop reasoning has gained significant attention in the area of knowledge graph completion, intending to predict missing facts through existing knowledge. However, due to sparsity knowledge and lack of reachable paths for the model to make sensible decisions, most multi -hop reasoning models suffer from degradation performance on the sparse knowledge graphs (KGs). Faced with this challenge, we propose the Hierarchical Knowledge -Enhancement Framework (Hi-KnowE), which improves reasoning performance over sparse KGs by conducting hierarchical dynamic path completion under various background knowledge guidance. Hi-KnowE is based on hierarchical reinforcement learning, breaking the task into high-level and low-level processes. Firstly, we apply high-level policy to reason relations and the relation action space is enlarged under rule guidance. Secondly, tail entities are obtained by low-level policy and semantic knowledge is used to refine the entity action space. The sparsity problem is alleviated by generating reliable information. Moreover, we introduce rule -based inner attention, adopting the overall semantics of relevant rules to assist agent reasoning. This strategy makes the path for the agent more logical and flexible. We further evaluate Hi-KnowE on four sparse datasets extracted from Wikidata and FreeBase. The results outperform the baseline models, demonstrating improvements of up to 1.5% and 1.9% in MRR and Hit@10.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning
    Zhang, Lu
    Yu, Mo
    Gao, Tian
    Yu, Yue
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 3948 - 3954
  • [22] Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniques
    Li, Chen
    Zheng, Haotian
    Sun, Yiping
    Wang, Cangqing
    Yu, Liqiang
    Chang, Che
    Tian, Xinyu
    Liu, Bo
    2024 4TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND INTELLIGENT SYSTEMS ENGINEERING, MLISE 2024, 2024, : 1 - 5
  • [23] Multi-hop temporal knowledge graph reasoning with temporal path rules guidance
    Bai, Luyi
    Chen, Mingzhuo
    Zhu, Lin
    Meng, Xiangxi
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 223
  • [24] Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph
    Lv, Xin
    Han, Xu
    Hou, Lei
    Li, Juanzi
    Liu, Zhiyuan
    Zhang, Wei
    Zhang, Yichi
    Kong, Hao
    Wu, Suhui
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 5694 - 5703
  • [25] Enhancing Multi-Hop Knowledge Graph Reasoning through Reward Shaping Techniques
    Li, Chen
    Zheng, Haotian
    Sun, Yiping
    Wang, Cangqing
    Yu, Liqiang
    Chang, Che
    Tian, Xinyu
    Liu, Bo
    2024 4th International Conference on Machine Learning and Intelligent Systems Engineering, MLISE 2024, 2024, : 1 - 5
  • [26] Reasoning Path Generation for Answering Multi-hop Questions Over Knowledge Graph
    Xiang, Yuxuan
    Wu, Jiajun
    Wang, Tiexin
    Wang, Meng
    Dai, Tianlun
    Wang, Gaoxu
    Xu, Shidong
    Li, Jing
    WEB AND BIG DATA, PT II, APWEB-WAIM 2022, 2023, 13422 : 195 - 209
  • [27] HierarT: Multi-hop temporal knowledge graph forecasting with hierarchical reinforcement learning
    Luo, Xuewei
    Zhu, Anjie
    Zhang, Jiasheng
    Shao, Jie
    KNOWLEDGE-BASED SYSTEMS, 2024, 300
  • [28] Interpretable multi-hop knowledge reasoning for gastrointestinal disease
    Wang, Dujuan
    Wang, Xinwei
    Abedin, Mohammad Zoynul
    Wang, Sutong
    Yin, Yunqiang
    ANNALS OF OPERATIONS RESEARCH, 2023,
  • [29] Path Spuriousness-aware Reinforcement Learning for Multi-Hop Knowledge Graph Reasoning
    Jiang, Chunyang
    Zhu, Tianchen
    Zhou, Haoyi
    Liu, Chang
    Deng, Ting
    Hu, Chunming
    Li, Jianxin
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 3181 - 3192
  • [30] Attention-based exploitation and exploration strategy for multi-hop knowledge graph reasoning
    Shang, Bin
    Zhao, Yinliang
    Liu, Yifan
    Wang, Chenxin
    INFORMATION SCIENCES, 2024, 653