PIVOINE: Instruction Tuning for Open-world Entity Profiling

被引:0
|
作者
Lu, Keming [1 ]
Pan, Xiaoman [2 ]
Song, Kaiqiang [2 ]
Zhang, Hongming [2 ]
Yu, Dong [2 ]
Chen, Jianshu [2 ]
机构
[1] Univ Southern Calif, Los Angeles, CA 90007 USA
[2] Tencent AI Lab, Bellevue, WA USA
来源
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023) | 2023年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work considers the problem of Open-world Entity Profiling, which is a sub-domain of Open-world Information Extraction (Open-world IE). Unlike the conventional closed-world IE, Open-world IE considers a more general situation where entities and relations could be beyond a predefined ontology. We seek to develop a large language model (LLM) that can perform Open-world Entity Profiling with instruction tuning to extract desirable entity profiles characterized by (possibly fine-grained) natural language instructions. In particular, we construct INSTRUCTOPEN-WIKI, a substantial instruction-tuning dataset for Open-world Entity Profiling enriched with a comprehensive corpus, extensive annotations, and diverse instructions. We finetune pre-trained BLOOM models on INSTRUCTOPEN-WIKI and obtain PIVOINE, an LLM for Open-world Entity Profiling with strong instruction-following capabilities. Our experiments demonstrate that PIVOINE significantly outperforms traditional methods and ChatGPT-based baselines, displaying impressive generalization capabilities on both unseen instructions and out-of-ontology cases. Consequently, PIVOINE emerges as a promising solution to tackle the open-world challenge in entity profiling.
引用
收藏
页码:15108 / 15127
页数:20
相关论文
共 50 条
  • [1] OWNER - Toward Unsupervised Open-World Named Entity Recognition
    Genest, Pierre-Yves
    Portier, Pierre-Edouard
    Egyed-Zsigmond, Elod
    Lovisetto, Martino
    IEEE ACCESS, 2025, 13 : 50077 - 50105
  • [2] POWER: A Domain-Independent Algorithm for Probabilistic, Open-World Entity Resolution
    Williams, Tom
    Scheutz, Matthias
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 1230 - 1235
  • [3] Extracting Short Entity Descriptions for Open-World Extension to Knowledge Graph Completion Models
    Zhu, Wangpeng
    Zhi, Xiaoli
    Tong, Weiqin
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I, 2020, 12274 : 16 - 27
  • [4] Open-World Relationship Prediction
    Wang, Jingchao
    Wang, Xinzhi
    Luo, Xiangfeng
    Qin, Wei
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 323 - 330
  • [5] Open-World Probabilistic Databases
    Ceylan, Ismail Ilkan
    Darwiche, Adnan
    Van den Broeck, Guy
    FIFTEENTH INTERNATIONAL CONFERENCE ON THE PRINCIPLES OF KNOWLEDGE REPRESENTATION AND REASONING, 2016, : 339 - 348
  • [6] Negative Knowledge for Open-world Wikidata
    Arnaout, Hiba
    Razniewski, Simon
    Weikum, Gerhard
    Pan, Jeff Z.
    WEB CONFERENCE 2021: COMPANION OF THE WORLD WIDE WEB CONFERENCE (WWW 2021), 2021, : 544 - 551
  • [7] Towards Open-World Segmentation of Parts
    Pan, Tai-Yu
    Liu, Qing
    Chao, Wei-Lun
    Price, Brian
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15392 - 15401
  • [8] Open-World Knowledge Graph Completion
    Shi, Baoxu
    Weninger, Tim
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 1957 - 1964
  • [9] On Constrained Open-World Probabilistic Databases
    Friedman, Tal
    Van den Broeck, Guy
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 5722 - 5729
  • [10] OpenWGL: Open-World Graph Learning
    Wu, Man
    Pan, Shirui
    Zhu, Xingquan
    20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2020), 2020, : 681 - 690