Enhancing Legal Named Entity Recognition Using RoBERTa-GCN with CRF: A Nuanced Approach for Fine-Grained Entity Recognition

被引:0
|
作者
Jain, Arihant [1 ]
Sharma, Raksha [1 ]
机构
[1] Indian Inst Technol Roorkee, Roorkee, India
关键词
Legal Domain; Pretrained Language Models; Named Entity Recognition; Conditional Random Fields;
D O I
10.1007/978-3-031-56063-7_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate identification of named entities is pivotal for the advancement of sophisticated legal Artificial Intelligence (AI) applications. However, the legal domain presents distinct challenges due to the presence of fine-grained, domain-specific entities, including lawyers, judges, courts, and precedents. This necessitates a nuanced approach to Named Entity Recognition (NER). In this paper, we introduce a novel NER approach tailored to the legal domain. Our system combines Robustly Optimized BERT (RoBERTa) with a Graph Convolutional Network (GCN) to harness two distinct types of complementary information related to words in the data. Furthermore, the application of a Conditional Random Field (CRF) at the output layer ensures global consistency in data labeling by considering the entire sequence when predicting a named entity. RoBERTa captures contextual information about individual words, while GCN allows us to exploit the mutual relationships between words, resulting in more precise named entity identification. Our results indicate that RoBERTa-GCN (CRF) outperforms other standard settings, such as, RoBERTa, textGCN, and BiLSTM, including state-of-the-art for NER in the legal domain.
引用
收藏
页码:261 / 267
页数:7
相关论文
共 50 条
  • [11] Enhancing Low-resource Fine-grained Named Entity Recognition by Leveraging Coarse-grained Datasets
    Lee, Su Ah
    Oh, Seokjin
    Jung, Woohwan
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 3269 - 3279
  • [12] Fine-Grained Mechanical Chinese Named Entity Recognition Based on ALBERT-AttBiLSTM-CRF and Transfer Learning
    Yao, Liguo
    Huang, Haisong
    Wang, Kuan-Wei
    Chen, Shih-Huan
    Xiong, Qiaoqiao
    SYMMETRY-BASEL, 2020, 12 (12): : 1 - 21
  • [13] TF-NERD: Tagalog Fine-grained Named Entity Recognition Dataset
    Ramos, Robin Kamille B.
    Vergara, John Paul C.
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND INFORMATION RETRIEVAL, NLPIR 2023, 2023, : 222 - 227
  • [14] Noun-based attention mechanism for Fine-grained Named Entity Recognition
    Rodriguez, Alejandro Jesus Castaneira
    Castro, Daniel Castro
    Herold Garcia, Silena
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 193
  • [15] Named Entity Recognition for Chinese EMR with RoBERTa-WWM-BiLSTM-CRF
    Fangcong Z.
    Qiuli Q.
    Yong J.
    Runtao Z.
    Data Analysis and Knowledge Discovery, 2022, 6 (2-3) : 251 - 262
  • [16] Exploiting Hierarchically Structured Categories in Fine-grained Chinese Named Entity Recognition
    Yang, Jiuding
    Luo, Jinwen
    Guo, Weidong
    Niu, Di
    Xu, Yu
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 3407 - 3421
  • [17] Chinese Fine-Grained Named Entity Recognition Based on BILTAR and GlobalPointer Modules
    Li, Weijun
    Liu, Jintong
    Gao, Yuxiao
    Zhang, Xinyong
    Gu, Jianlai
    APPLIED SCIENCES-BASEL, 2023, 13 (23):
  • [18] Name Translation based on Fine-grained Named Entity Recognition in a Single Language
    Sadamitsu, Kugatsu
    Saito, Itsumi
    Katayama, Taichi
    Asano, Hisako
    Matsuo, Yoshihiro
    LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2016, : 613 - 619
  • [19] Enhancing fine-grained geographic named entity recognition by Multi-scale Siamese Reconstruction Network
    Huang, Guanhua
    Gao, Bofei
    Chen, Jiaze
    Zhang, Yuchen
    Yang, Zhouwang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 148
  • [20] Fine-Grained Named Entity Recognition with Distant Supervision in COVID-19 Literature
    Wang, Xuan
    Song, Xiangchen
    Li, Bangzheng
    Zhou, Kang
    Li, Qi
    Han, Jiawei
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 491 - 494