A Flat-Span Contrastive Learning Method for Nested Named Entity Recognition

被引:0
|
作者
Liu, Yaodi [1 ]
Zhang, Kun [1 ]
Tong, Rong [2 ]
Cai, Chenxi [1 ]
Chen, Dianying [1 ]
Wu, Xiaohe [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp & Engn, Nanjing, Peoples R China
[2] Singapore Inst Technol, Infocomm Technol Cluster, Singapore, Singapore
关键词
nested named entity recognition; sequence labeling; span classification; contrastive learning; multi-task learning;
D O I
10.1109/IALP63756.2024.10661137
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most Named entity recognition (NER) methods can only handle flat entities and ignore nested entities. In Natural language processing (NLP), it is common to contain other entities within entities. Therefore, we propose a Flat-Span contrastive learning (Fla-SpaCL) method for nested NER. This method includes two sub-modules: a flat NER module for outer entities and a candidate span classification module based on contrastive learning. In the flat NER module, we use Star-Transformer and Conditional random field (CRF) to identify the outer entities. In the candidate span classification module, we first generate inner candidate spans based on the identified outer entities. Secondly, to better distinguish entity spans and non-entity spans, we introduce contrastive learning to maximize the similarity between entity spans and use the InfoNEC loss function to handle hard negative samples. Finally, multi-task learning is used to jointly optimize the flat NER module and the candidate span classification module to reduce error propagation and improve model performance. In the experimental analysis, we compared the proposed model with baseline models to verify its effectiveness.
引用
收藏
页码:37 / 42
页数:6
相关论文
共 50 条
  • [1] Nested Named Entity Recognition Method Based on Span Decoding
    Nian, Yongming
    Chen, Yanping
    Qin, Yongbin
    Huang, Ruizhang
    Computer Engineering and Applications, 2024, 60 (01) : 174 - 181
  • [2] Contrastive learning for nested Chinese Named Entity Recognition via template words
    Wang, Yuke
    Liu, Qiao
    Dai, Tingting
    Lang, Junjie
    Lu, Ling
    Chen, Yinong
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2025,
  • [3] Exploring Interactive and Contrastive Relations for Nested Named Entity Recognition
    Zheng, Qinghua
    Wu, Yuefei
    Wang, Guangtao
    Chen, Yanping
    Wu, Wei
    Zhang, Zai
    Shi, Bin
    Dong, Bo
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 2899 - 2909
  • [4] Nested Named Entity Recognition with Span-level Graphs
    Wan, Juncheng
    Ru, Dongyu
    Zhang, Weinan
    Yu, Yong
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 892 - 903
  • [5] Nested Named Entity Recognition Based on Span Boundary Perception
    Cai, Yu-Xiang
    Luo, Da
    Gan, Yang-Lei
    Hou, Rui
    Liu, Xue-Yi
    Liu, Qiao
    Shi, Xiao-Jun
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (11): : 5149 - 5162
  • [6] A Boundary Feature Enhanced Span-Based Nested Named Entity Recognition Method
    Song, Jiaqi
    Wang, Xingxing
    Zhang, Huihui
    Li, Bohan
    Wang, Tiexin
    WEB AND BIG DATA, APWEB-WAIM 2024, PT I, 2024, 14961 : 3 - 17
  • [7] Nested Named Entity Recognition based on Span and Efficient Global Pointer
    Liu, Fang
    Yin, Shiqun
    Li, Guang
    He, Yajun
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 735 - 741
  • [8] Boundary Enhanced Neural Span Classification for Nested Named Entity Recognition
    Tan, Chuanqi
    Qiu, Wei
    Chen, Mosha
    Wang, Rui
    Huang, Fei
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9016 - 9023
  • [9] Hierarchical Region Learning for Nested Named Entity Recognition
    Long, Xinwei
    Niu, Shuzi
    Li, Yucheng
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 4788 - 4793
  • [10] A Two-Stage Boundary-Enhanced Contrastive Learning approach for nested named entity recognition
    Liu, Yaodi
    Zhang, Kun
    Tong, Rong
    Cai, Chenxi
    Chen, Dianying
    Wu, Xiaohe
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 271