Chinese Clinical Named Entity Recognition Using Multi-Feature Fusion and Multi-Scale Local Context Enhancement

被引:0
|
作者
Li, Meijing [1 ]
Huang, Runqing [1 ]
Qi, Xianxian [1 ]
机构
[1] Shanghai Maritime Univ, Coll Informat Engn, Shanghai 200306, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 02期
基金
中国国家自然科学基金;
关键词
CNER; multi-feature fusion; BiLSTM; CNN; MHA; MODEL;
D O I
10.32604/cmc.2024.053630
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chinese Clinical Named Entity Recognition (CNER) is a crucial step in extracting medical information and is of great significance in promoting medical informatization. However, CNER poses challenges due to the specificity of clinical terminology, the complexity of Chinese text semantics, and the uncertainty of Chinese entity boundaries. To address these issues, we propose an improved CNER model, which is based on multi-feature fusion and multi-scale local context enhancement. The model simultaneously fuses multi-feature representations of pinyin, radical, Part of Speech (POS), word boundary with BERT deep contextual representations to enhance the semantic representation of text for more effective entity recognition. Furthermore, to address the model's limitation of focusing just on global features, we incorporate Convolutional Neural Networks (CNNs) with various kernel sizes to capture multiscale local features of the text and enhance the model's comprehension of the text. Finally, we integrate the obtained global and local features, and employ multi-head attention mechanism (MHA) extraction to enhance the model's focus on characters associated with medical entities, hence boosting the model's performance. We obtained 92.74%, and 87.80% F1 scores on the two CNER benchmark datasets, CCKS2017 and CCKS2019, respectively. The results demonstrate that our model outperforms the latest models in CNER, showcasing its outstanding overall performance. It can be seen that the CNER model proposed in this study has an important application value in constructing clinical medical knowledge graph and intelligent Q&A system.
引用
收藏
页码:2283 / 2299
页数:17
相关论文
共 50 条
  • [41] Face Forgery Detection via Multi-Feature Fusion and Local Enhancement
    Zhang, Dengyong
    Chen, Jiahao
    Liao, Xin
    Li, Feng
    Chen, Jiaxin
    Yang, Gaobo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (09) : 8972 - 8977
  • [42] Multi-feature based Chinese-English Named Entity Extraction from comparable corpora
    Lu, Min
    Zhao, Jun
    PACLIC 20: PROCEEDINGS OF THE 20TH PACIFIC ASIA CONFERENCE ON LANGUAGE, INFORMATION AND COMPUTATION, 2006, : 134 - 141
  • [43] Feature fusion of multi-granularity and multi-scale for facial expression recognition
    Xia, Haiying
    Lu, Lidan
    Song, Shuxiang
    VISUAL COMPUTER, 2024, 40 (03): : 2035 - 2047
  • [44] Feature fusion of multi-granularity and multi-scale for facial expression recognition
    Haiying Xia
    Lidan Lu
    Shuxiang Song
    The Visual Computer, 2024, 40 : 2035 - 2047
  • [45] Multi-Scale Feature Fusion Enhancement for Underwater Object Detection
    Xiao, Zhanhao
    Li, Zhenpeng
    Li, Huihui
    Li, Mengting
    Liu, Xiaoyong
    Kong, Yinying
    SENSORS, 2024, 24 (22)
  • [46] Attention-based Multi-level Feature Fusion for Named Entity Recognition
    Yang, Zhiwei
    Chen, Hechang
    Zhang, Jiawei
    Ma, Jing
    Chang, Yi
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3594 - 3600
  • [47] Chinese power dispatching text entity recognition based on a double-layer BiLSTM and multi-feature fusion
    Wang, Min
    Zhou, Tao
    Wang, Haohao
    Zhai, Youchun
    Dong, Xiaobin
    ENERGY REPORTS, 2022, 8 : 980 - 987
  • [48] Biomedical named entity recognition based on multi-cross attention feature fusion
    Zheng, Dequan
    Han, Rong
    Yu, Feng
    Li, Yannan
    PLOS ONE, 2024, 19 (05):
  • [49] EEG emotion recognition approach using multi-scale convolution and feature fusion
    Zhang, Yong
    Shan, Qingguo
    Chen, Wenyun
    Liu, Wenzhe
    VISUAL COMPUTER, 2024, : 4157 - 4169
  • [50] Multi-Scale Attention Network Based on Multi-Feature Fusion for Person Re-Identification
    Li, Minghao
    Yuan, Liming
    Wen, Xianbin
    Wang, Jianchen
    Xie, Gengsheng
    Jia, Yansong
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,