Prompt-based for Low-Resource Tibetan Text Classification

被引:4
|
作者
An, Bo [1 ]
机构
[1] Chinese Acad Social Sci, Inst Ethnol & Anthropol, South Tweenty 7 St,Bldg 6,Zhongguancun Nandajie 2, Beijing, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Tibetan text classification; prompt learning; deep learning; pre-trained language model;
D O I
10.1145/3603168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text classification is a critical and foundational task in Tibetan natural language processing, it plays a crucial role in various applications, such as sentiment analysis and information extraction. However, the limited availability of annotated data poses a significant challenge to Tibetan natural language processing. This paper proposes a prompt learning-based method for low-resource Tibetan text classification to overcome this challenge. This method utilizes pre-trained language models to learn text representation and generation capabilities on a large-scale unsupervised Tibetan corpus, enabling few-shot Tibetan text classification. Experimental results demonstrate that the proposed method significantly improves the performance of Tibetan text classification in low-resource scenarios. This work provides a new research idea and method for low-resource language processing, such as Tibetan natural language processing. Hopefully, it will inspire subsequent work on low-resource language processing.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Prompt-Based Graph Convolution Adversarial Meta-Learning for Few-Shot Text Classification
    Gong, Ruwei
    Qin, Xizhong
    Ran, Wensheng
    APPLIED SCIENCES-BASEL, 2023, 13 (16):
  • [22] The Power of Prompt Tuning for Low-Resource Semantic Parsing
    Schucher, Nathan
    Reddy, Siva
    de Vries, Harm
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022): (SHORT PAPERS), VOL 2, 2022, : 148 - 156
  • [23] Knowledge-Aware Meta-learning for Low-Resource Text Classification
    Yao, Huaxiu
    Wu, Yingxin
    Al-Shedivat, Maruan
    Xing, Eric P.
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 1814 - 1821
  • [24] Application of Quantum Recurrent Neural Network in Low-Resource Language Text Classification
    Yu, Wenbin
    Yin, Lei
    Zhang, Chengjun
    Chen, Yadang
    Liu, Alex X.
    IEEE TRANSACTIONS ON QUANTUM ENGINEERING, 2024, 5
  • [25] Domain-Aligned Data Augmentation for Low-Resource and Imbalanced Text Classification
    Stylianou, Nikolaos
    Chatzakou, Despoina
    Tsikrika, Theodora
    Vrochidis, Stefanos
    Kompatsiaris, Ioannis
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT II, 2023, 13981 : 172 - 187
  • [26] Meta-prompt based learning for low-resource false information detection
    Huang, Yinqiu
    Gao, Min
    Wang, Jia
    Yin, Junwei
    Shu, Kai
    Fan, Qilin
    Wen, Junhao
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (03)
  • [27] Meta-prompt based learning for low-resource false information detection
    Huang Y.
    Gao M.
    Wang J.
    Yin J.
    Shu K.
    Fan Q.
    Wen J.
    Information Processing and Management, 2023, 60 (03):
  • [28] Enhancing Legal Text Entailment with Prompt-Based ChatGPT: An Empirical Study
    Nguyen, Chau
    Nguyen, Le-Minh
    NEW FRONTIERS IN ARTIFICIAL INTELLIGENCE, JSAI-ISAI 2023 INTERNATIONAL WORKSHOPS- JURISIN, SCIDOCA, EMSEMI AND AI-BIZ 2023, 2024, 14644 : 184 - 196
  • [29] Concept Matching for Low-Resource Classification
    Errica, Federico
    Silvestri, Fabrizio
    Edizel, Bora
    Denoyer, Ludovic
    Petroni, Fabio
    Plachouras, Vassilis
    Riedel, Sebastian
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [30] Prompt-Based Label-Aware Framework for Few-Shot Multi-Label Text Classification
    Thaminkaew, Thanakorn
    Lertvittayakumjorn, Piyawat
    Vateekul, Peerapon
    IEEE ACCESS, 2024, 12 : 28310 - 28322