Cross-Domain Named Entity Recognition of Multi-Level Structured Semantic Knowledge Enhancement

被引:0
|
作者
Zhang W. [1 ]
Liu X. [1 ,4 ]
Yang G. [1 ,2 ]
Liu J. [3 ,4 ]
机构
[1] School of Computer Science, Zhongyuan University of Technology, Zhengzhou
[2] Henan provincial Key Laboratory on Public Opinion Intelligent Analysis, Zhongyuan University of Technology, Zhengzhou
[3] School of Information Science, North China University of Technology, Beijing
[4] China Language Intelligence Research Center of the National Language Commission, Capital Normal University, Beijing
基金
中国国家自然科学基金;
关键词
cross-domain named entity recognition; cross-domain transfer; domain invariant knowledge; structured alignment; structured knowledge;
D O I
10.7544/issn1000-1239.202220413
中图分类号
学科分类号
摘要
Cross-domain named entity recognition aims to alleviate the problem of insufficient annotation data in the target domain. Most existing methods, which exploit the feature representation or model parameter sharing to achieve cross-domain transfer of entity recognition capabilities and can only partially utilize structured knowledge entailed in text sequences. To address this, we propose a multi-level structured semantic knowledge enhanced cross-domain named entity recognition MSKE-CDNER, which could facilitate the transfer of entity recognition capabilities by aligning the structured knowledge representations embedded in the source and target domains from multiple levels. First, MSKE-CDNER uses the structural feature representation layer to achieve structured semantic knowledge representations of texts from different fields’ structured alignment. And then, these structured semantic representations are aligned at the corresponding layers by a latent alignment module to obtain cross-domain invariant knowledge. Finally, this cross-domain consistent structured knowledge is fused with domain-specific knowledge to enhance the generalization capability of the model. Experiments on five datasets and a specific cross-domain named entity recognition dataset have shown that the average performance of MSKE-CDNER improved by 0.43% and 1.47% compared with the current models. All of these indicate that exploiting text sequences’ structured semantic knowledge representation could effectively enhance entity recognition in the target domain. © 2023 Science Press. All rights reserved.
引用
收藏
页码:2864 / 2876
页数:12
相关论文
共 42 条
  • [1] Liu Zihan, Xu Yan, Yu Tiezheng, Et al., CrossNER: Evaluating cross-domain named entity recognition, Proc of the 21st AAAI Conf on Artificial Intelligence, pp. 13452-13460, (2021)
  • [2] Xuesong Zhang, Ruiqiang Guo, Degen Huang, Named entity recognition based on dependency[J], Journal of Chinese Information Processing, 35, 6, (2021)
  • [3] Yiyi Deng, Changxing Wu, Yongfeng Wei, Et al., A survey on named entity recognition based on deep learing[J], Journal of Chinese Information Processing, 35, 9, (2021)
  • [4] Chen Jia, Liang Xiaobo, Zhang Yue, Cross-domain NER using cross-domain language modeling[C], Proc of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 2464-2474, (2019)
  • [5] Wang Zhenghui, Qu Yanru, Chen Liheng, Et al., Label-Aware double transfer learning for cross-specialty medical named entity recognition[C], Proc of the 2018 Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1-15, (2018)
  • [6] Jia Chen, Zhang Yue, Multi-cell compositional LSTM for NER domain adaptation, Proc of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5906-5917, (2020)
  • [7] Bill L Y, Lu Wei, Neural adaptation layers for cross-domain named entity recognition[C], Proc of the 2018 Conf on Empirical Methods in Natural Language Processing (EMNLP), pp. 2012-2022, (2018)
  • [8] Rodriguez J D, Caldwell A, Liu A., Transfer learning for entity recognition of novel classes[C], Proc of the 27th Int Conf on Computational Linguistics, pp. 1974-1985, (2018)
  • [9] Titouan V, Courty N, Tavenard R, Et al., Optimal transport for structured data with application on graphs[C], Proc of the 36th Int Conf on Machine Learning, pp. 6275-6284, (2019)
  • [10] Kriege N M, Fey M, Fisseler D, Et al., Recognizing cuneiform signs using graph based methods[C], Proc of the Int Workshop on Cost-Sensitive Learning, pp. 31-44, (2018)