Combining Large Model Fine-Tuning and Graph Neural Networks for Knowledge Graph Question Answering

被引:0
|
作者
Chen, Junzhen [1 ]
Wang, Shuying [1 ]
Luo, Haoran [2 ]
机构
[1] School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu,611756, China
[2] School of Computer Science, Beijing University of Posts and Telecommunications, Beijing,100876, China
关键词
Semantics;
D O I
10.3778/j.issn.1002-8331.2406-0301
中图分类号
学科分类号
摘要
To address the challenges posed by inaccurate semantic parsing in traditional knowledge graph question answering systems when processing natural language queries, this paper proposes a method that integrates large model fine-tuning with graph neural networks. The approach begins with the collection of questions and the definition of their corresponding logical forms. Leveraging the robust semantic parsing capabilities of large pre-trained language models, the accuracy of question parsing is significantly enhanced through fine-tuning on question-answer pairs, where each pair includes a question and its associated logical form. Subsequently, the fuzzy set method is applied to further refine the fine-tuned logical forms, improving retrieval precision. Finally, graph neural networks are employed to perform relation projection and logical operations on these enhanced logical forms to derive the final answers. Experimental validation on standard general-domain datasets, such as WebQSP and ComplexWebQuestions, demonstrates that this method surpasses baseline models in terms of F1, Hit@1, and ACC metrics. Additionally, the method has been successfully applied and validated on domain-specific datasets, including those related to wind power equipment and high-speed trains, confirming its effectiveness in specialized domains. © 2024 Journal of Computer Engineering and Applications Beijing Co., Ltd.; Science Press. All rights reserved.
引用
收藏
页码:166 / 176
相关论文
共 50 条
  • [1] Fine-Tuning Graph Neural Networks by Preserving Graph Generative Patterns
    Sun, Yifei
    Zhu, Qi
    Yang, Yang
    Wang, Chunping
    Fan, Tianyu
    Zhu, Jiajun
    Chen, Lei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 9053 - 9061
  • [2] Knowledge Graph Fusion for Language Model Fine-Tuning
    Bhana, Nimesh
    van Zyl, Terence L.
    2022 9TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE, ISCMI, 2022, : 167 - 172
  • [3] Fine-Tuning Graph Neural Networks via Graph Topology Induced Optimal Transport
    Zhang, Jiying
    Xiao, Xi
    Huang, Long-Kai
    Rong, Yu
    Bian, Yatao
    IJCAI International Joint Conference on Artificial Intelligence, 2022, : 3730 - 3736
  • [4] Drop edges and adapt: A fairness enforcing fine-tuning for graph neural networks
    Spinelli, Indro
    Bianchini, Riccardo
    Scardapane, Simone
    NEURAL NETWORKS, 2023, 167 : 159 - 167
  • [5] Drop Edges and Adapt: A Fairness Enforcing Fine-Tuning for Graph Neural Networks
    Spinelli, Indro
    Bianchini, Riccardo
    Scardapane, Simone
    SSRN, 2023,
  • [6] Measuring Task Similarity and Its Implication in Fine-Tuning Graph Neural Networks
    Huang, Renhong
    Xu, Jiarong
    Jiang, Xin
    Pan, Chenglu
    Yang, Zhiming
    Wang, Chunping
    Yang, Yang
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12617 - 12625
  • [7] A knowledge inference model for question answering on an incomplete knowledge graph
    Guo, Qimeng
    Wang, Xue
    Zhu, Zhenfang
    Liu, Peiyu
    Xu, Liancheng
    APPLIED INTELLIGENCE, 2023, 53 (07) : 7634 - 7646
  • [8] A knowledge inference model for question answering on an incomplete knowledge graph
    Qimeng Guo
    Xue Wang
    Zhenfang Zhu
    Peiyu Liu
    Liancheng Xu
    Applied Intelligence, 2023, 53 : 7634 - 7646
  • [9] Voucher Abuse Detection with Prompt-based Fine-tuning on Graph Neural Networks
    Wen, Zhihao
    Fang, Yuan
    Liu, Yihan
    Guo, Yang
    Hao, Shuji
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 4864 - 4870
  • [10] Graph neural networks for visual question answering: a systematic review
    Abdulganiyu Abdu Yusuf
    Chong Feng
    Xianling Mao
    Ramadhani Ally Duma
    Mohammed Salah Abood
    Abdulrahman Hamman Adama Chukkol
    Multimedia Tools and Applications, 2024, 83 : 55471 - 55508