Power text information extraction based on multi-task learning

被引:0
|
作者
Ji, Xin [1 ,2 ]
Wu, Tongxin [1 ]
Yu, Ting [1 ]
Dong, Linxiao [1 ]
Chen, Yiting [1 ]
Mi, Na [1 ]
Zhao, Jiakui [1 ]
机构
[1] Big Data Center of State Grid Corporation of China, Beijing,100031, China
[2] School of Computer Science and Engineering, Beihang University, Beijing,100191, China
关键词
Power distribution faults;
D O I
10.13700/j.bh.1001-5965.2022.0683
中图分类号
学科分类号
摘要
In order to improve the analysis and processing speed of power system fault text in actual business scenarios, a power fault text information extraction model based on pre-training and multi-task learning was proposed. The pre-training model was used to learn the context information of power text words. The first-order and second-order fusion features of words were mined, which enhanced the representation ability of features. The multi-task learning framework was used to combine named entity recognition and relation extraction, which realized the mutual supplement and mutual promotion of entity recognition and relationship extraction, so as to improve the performance of power fault text information extraction. The model was verified by the daily business data of a power data center. Compared with other models, the proposed model’s accuracy and recall of power fault text entity recognition and relation extraction were improved. © 2024 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.
引用
收藏
页码:2461 / 2469
相关论文
共 50 条
  • [1] Long Text Summarization and Key Information Extraction in a Multi-Task Learning Framework
    Lu M.
    Chen R.
    Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [2] Learning Implicit and Explicit Multi-task Interactions for Information Extraction
    Sun, Kai
    Zhang, Richong
    Mensah, Samuel
    Mao, Yongyi
    Liu, Xudong
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (02)
  • [3] Multi-Task Learning for Relation Extraction
    Zhou, Kai
    Luo, Xiangfeng
    Wang, Hao
    Xu, Richard
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1480 - 1487
  • [4] Adversarial Multi-task Learning for Text Classification
    Liu, Pengfei
    Qiu, Xipeng
    Huang, Xuanjing
    PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 1 - 10
  • [5] Generative Multi-Task Learning for Text Classification
    Zhao, Wei
    Gao, Hui
    Chen, Shuhui
    Wang, Nan
    IEEE ACCESS, 2020, 8 : 86380 - 86387
  • [6] Multi-Task Learning with Prior Information
    Zhang, Mengyuan
    Liu, Kai
    PROCEEDINGS OF THE 2023 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2023, : 586 - 594
  • [7] Multi-task learning for abstractive text summarization with key information guide network
    Weiran Xu
    Chenliang Li
    Minghao Lee
    Chi Zhang
    EURASIP Journal on Advances in Signal Processing, 2020
  • [8] Joint Chinese Event Extraction Based Multi-task Learning
    He R.-F.
    Duan S.-Y.
    Ruan Jian Xue Bao/Journal of Software, 2019, 30 (04): : 1015 - 1030
  • [9] Multi-task learning for abstractive text summarization with key information guide network
    Xu, Weiran
    Li, Chenliang
    Lee, Minghao
    Zhang, Chi
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2020, 2020 (01)
  • [10] TASK AWARE MULTI-TASK LEARNING FOR SPEECH TO TEXT TASKS
    Indurthi, Sathish
    Zaidi, Mohd Abbas
    Lakumarapu, Nikhil Kumar
    Lee, Beomseok
    Han, Hyojung
    Ahn, Seokchan
    Kim, Sangha
    Kim, Chanwoo
    Hwang, Inchul
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7723 - 7727