A Transformer-based Prior Legal Case Retrieval Method

被引:0
|
作者
Ozturk, Ceyhun E. [1 ]
Ozcelik, S. Baris [2 ]
Koc, Aykut [3 ]
机构
[1] Bilkent Univ, Elekt & Elekt Muhendisligi Bolumu, ASELSAN Res Ctr, Ankara, Turkiye
[2] Bilkent Univ, Hukuk Fak, Ankara, Turkiye
[3] Bilkent Univ, Elekt & Elekt Muhendisligi Bolumu, Ulusal Manyet Rezonans Arastirma Merkezi, Ankara, Turkiye
关键词
Natural language processing; legal tech; deep learning; prior legal case retrieval; legal NLP; Turkish NLP;
D O I
10.1109/SIU59756.2023.10223938
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, BERTurk-Legal, a transformer-based language model, is introduced to retrieve prior legal cases. BERTurk-Legal is pre-trained on a dataset from the Turkish legal domain. This dataset does not contain any labels related to the prior court case retrieval task. Masked language modeling is used to train BERTurk-Legal in a self-supervised manner. With zero-shot classification, BERTurk-Legal provides state-of-the-art results on the dataset consisting of legal cases of the Court of Cassation of Turkey. The results of the experiments show the necessity of developing language models specific to the Turkish law domain.
引用
收藏
页数:4
相关论文
共 50 条
  • [21] An improved transformer-based concrete crack classification method
    Guanting Ye
    Wei Dai
    Jintai Tao
    Jinsheng Qu
    Lin Zhu
    Qiang Jin
    Scientific Reports, 14
  • [22] An improved transformer-based concrete crack classification method
    Ye, Guanting
    Dai, Wei
    Tao, Jintai
    Qu, Jinsheng
    Zhu, Lin
    Jin, Qiang
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [23] AiPE: A Novel Transformer-Based Pose Estimation Method
    Lu, Kai
    Min, Dugki
    ELECTRONICS, 2024, 13 (05)
  • [24] A transformer-based method for vessel traffic flow forecasting
    Mandalis, Petros
    Chondrodima, Eva
    Kontoulis, Yannis
    Pelekis, Nikos
    Theodoridis, Yannis
    GEOINFORMATICA, 2025, 29 (01) : 149 - 173
  • [25] A TRANSFORMER-BASED CROSS-MODAL IMAGE-TEXT RETRIEVAL METHOD USING FEATURE DECOUPLING AND RECONSTRUCTION
    Zhang, Huan
    Sun, Yingzhi
    Liao, Yu
    Xu, SiYuan
    Yang, Rui
    Wang, Shuang
    Hou, Biao
    Jiao, Licheng
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1796 - 1799
  • [26] Vision Transformer-Based Video Hashing Retrieval for Tracing the Source of Fake Videos
    Pei, Pengfei
    Zhao, Xianfeng
    Li, Jinchuan
    Cao, Yun
    Lai, Xuyuan
    Security and Communication Networks, 2023, 2023
  • [27] Hybrid transformer-based model for mammogram classification by integrating prior and current images
    Jeny, Afsana Ahsan
    Hamzehei, Sahand
    Jin, Annie
    Baker, Stephen Andrew
    Van Rathe, Tucker
    Bai, Jun
    Yang, Clifford
    Nabavi, Sheida
    MEDICAL PHYSICS, 2025,
  • [28] Panini: a transformer-based grammatical error correction method for Bangla
    Nahid Hossain
    Mehedi Hasan Bijoy
    Salekul Islam
    Swakkhar Shatabda
    Neural Computing and Applications, 2024, 36 : 3463 - 3477
  • [29] MVCformer: A transformer-based multi-view clustering method
    Zhao, Mingyu
    Yang, Weidong
    Nie, Feiping
    INFORMATION SCIENCES, 2023, 649
  • [30] An efficient swin transformer-based method for underwater image enhancement
    Rong Wang
    Yonghui Zhang
    Jian Zhang
    Multimedia Tools and Applications, 2023, 82 : 18691 - 18708