A Transformer-based Prior Legal Case Retrieval Method

被引:0
|
作者
Ozturk, Ceyhun E. [1 ]
Ozcelik, S. Baris [2 ]
Koc, Aykut [3 ]
机构
[1] Bilkent Univ, Elekt & Elekt Muhendisligi Bolumu, ASELSAN Res Ctr, Ankara, Turkiye
[2] Bilkent Univ, Hukuk Fak, Ankara, Turkiye
[3] Bilkent Univ, Elekt & Elekt Muhendisligi Bolumu, Ulusal Manyet Rezonans Arastirma Merkezi, Ankara, Turkiye
关键词
Natural language processing; legal tech; deep learning; prior legal case retrieval; legal NLP; Turkish NLP;
D O I
10.1109/SIU59756.2023.10223938
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, BERTurk-Legal, a transformer-based language model, is introduced to retrieve prior legal cases. BERTurk-Legal is pre-trained on a dataset from the Turkish legal domain. This dataset does not contain any labels related to the prior court case retrieval task. Masked language modeling is used to train BERTurk-Legal in a self-supervised manner. With zero-shot classification, BERTurk-Legal provides state-of-the-art results on the dataset consisting of legal cases of the Court of Cassation of Turkey. The results of the experiments show the necessity of developing language models specific to the Turkish law domain.
引用
收藏
页数:4
相关论文
共 50 条
  • [31] HTrans: Transformer-based Method for Hardware Trojan Detection and Localization
    Li, Yilin
    Li, Shan
    Shen, Haihua
    2023 IEEE 32ND ASIAN TEST SYMPOSIUM, ATS, 2023, : 31 - 36
  • [32] Transformer-Based Deep Learning Method for the Prediction of Ventilator Pressure
    Fan, Ruizhe
    2022 IEEE 2ND INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SOFTWARE ENGINEERING (ICICSE 2022), 2022, : 25 - 28
  • [33] A transformer-based lightweight method for multiple-object tracking
    Wan, Qin
    Ge, Zhu
    Yang, Yang
    Shen, Xuejun
    Zhong, Hang
    Zhang, Hui
    Wang, Yaonan
    Wu, Di
    IET IMAGE PROCESSING, 2024, 18 (09) : 2329 - 2345
  • [34] Panini: a transformer-based grammatical error correction method for Bangla
    Hossain, Nahid
    Bijoy, Mehedi Hasan
    Islam, Salekul
    Shatabda, Swakkhar
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (07): : 3463 - 3477
  • [35] A Transformer-Based DeepFake-Detection Method for Facial Organs
    Xue, Ziyu
    Liu, Qingtong
    Shi, Haichao
    Zou, Ruoyu
    Jiang, Xiuhua
    ELECTRONICS, 2022, 11 (24)
  • [36] TRANSFORMER-BASED METHOD FOR SEMANTIC SEGMENTATION AND RECONSTRUCTION OF THE MARTIAN SURFACE
    Li, Z.
    Wu, B.
    Chen, Z.
    Ma, Y.
    GEOSPATIAL WEEK 2023, VOL. 48-1, 2023, : 1643 - 1649
  • [37] An efficient swin transformer-based method for underwater image enhancement
    Wang, Rong
    Zhang, Yonghui
    Zhang, Jian
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (12) : 18691 - 18708
  • [38] Transformer-Based Method for Unsupervised Anomaly Detection of Flight Data
    Yu, Hao
    Wu, Honglan
    Sun, Youchao
    Liu, Hao
    2023 ASIA-PACIFIC INTERNATIONAL SYMPOSIUM ON AEROSPACE TECHNOLOGY, VOL I, APISAT 2023, 2024, 1050 : 1816 - 1826
  • [39] Improving the quality of dental crown using a Transformer-based method
    Hosseinimanesh, Golriz
    Ghadiri, Farnoosh
    Alsheghri, Ammar
    Zhang, Ying
    Keren, Julia
    Cheriet, Farida
    Guibault, Francois
    arXiv, 2023,
  • [40] BERT_LF: A Similar Case Retrieval Method Based on Legal Facts
    Hu, Weifeng
    Zhao, Siwen
    Zhao, Qiang
    Sun, Hao
    Hu, Xifeng
    Guo, Rundong
    Li, Yujun
    Cui, Yan
    Ma, Long
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022