LegalReasoner: A Multi-Stage Framework for Legal Judgment Prediction via Large Language Models and Knowledge Integration

被引:0
|
作者
Wang, Xuran [1 ]
Zhang, Xinguang [2 ]
Hoo, Vanessa [3 ]
Shao, Zhouhang [4 ]
Zhang, Xuguang [5 ]
机构
[1] Univ Penn, Dept Comp & Informat Sci, Philadelphia, PA 19104 USA
[2] Univ Texas Dallas, Erik Jonsson Sch Engn & Comp Sci, Richardson, TX 75080 USA
[3] Georgia Inst Technol, Sch Math, Sch Econ, Atlanta, GA 30332 USA
[4] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
[5] Univ Gloucestershire, Sch Business Comp & Social Sci, Cheltenham GL50 2RH, England
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Law; Cognition; Artificial intelligence; Predictive models; Natural language processing; Decision making; Large language models; Transformers; Contrastive learning; Knowledge based systems; Legal judgment prediction; large language models; knowledge integration; multi-hop reasoning;
D O I
10.1109/ACCESS.2024.3496666
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Legal judgment prediction (LJP) presents a formidable challenge in artificial intelligence, demanding intricate comprehension of legal texts, nuanced interpretation of statutes, and complex reasoning over multifaceted case elements. While recent advancements in natural language processing have shown promise, existing approaches often struggle to capture the sophisticated interplay between facts, legal principles, and precedents that characterize legal decision-making. This paper introduces LegalReasoner, a novel multi-stage framework that leverages large language models (LLMs) and integrates domain-specific knowledge for enhanced legal judgment prediction. Our approach encompasses four key stages: 1) legal knowledge infusion, where we pre-train an LLM on a vast corpus of legal literature using contrastive learning techniques; 2) case-law retrieval, employing a graph neural network to identify relevant precedents and statutes; 3) multi-hop reasoning, utilizing a transformer-based architecture with a hierarchical attention mechanism to navigate complex legal arguments; and 4) judgment synthesis, where we employ a generative adversarial network to produce coherent and legally sound judgments. We evaluate LegalReasoner on two diverse datasets: the European Court of Human Rights (ECHR) cases and the Chinese AI and Law Challenge (CAIL2018). Our framework demonstrates substantial improvements over state-of-the-art baselines, achieving an average accuracy increase of 7.8% across all datasets. Furthermore, we conduct extensive ablation studies and interpretability analyses to elucidate the contributions of each component and provide insights into the model's decision-making process. Our work not only advances the field of automated legal reasoning but also offers a transparent and explainable system that could serve as a valuable tool for legal professionals. By bridging the gap between AI and legal expertise, LegalReasoner paves the way for more efficient, consistent, and fair legal decision-making processes.
引用
收藏
页码:166843 / 166854
页数:12
相关论文
共 50 条
  • [1] A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction
    Shui, Ruihao
    Cao, Yixin
    Xiang, Wang
    Chua, Tat-Seng
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 7337 - 7348
  • [2] Legal Syllogism Prompting: Teaching Large Language Models for Legal Judgment Prediction
    Jiang, Cong
    Yang, Xiaolei
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND LAW, ICAIL 2023, 2023, : 417 - 421
  • [3] Legal Judgment Prediction with Multi-Stage Case Representation Learning in the Real Court Setting
    Ma, Luyao
    Zhang, Yating
    Wang, Tianyi
    Liu, Xiaozhong
    Ye, Wei
    Sun, Changlong
    Zhang, Shikun
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 993 - 1002
  • [4] Multi-stage guided code generation for Large Language Models
    Han, Yewei
    Lyu, Chen
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 139
  • [5] Judgment Prediction via Injecting Legal Knowledge into Neural Networks
    Gan, Leilei
    Kuang, Kun
    Yang, Yi
    Wu, Fei
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 12866 - 12874
  • [6] Evaluating emotional and subjective responses in synthetic art-related dialogues: A multi-stage framework with large language models
    Luna-Jimenez, Cristina
    Gil-Martin, Manuel
    D'Haro, Luis Fernando
    Fernandez-Martinez, Fernando
    San-Segundo, Ruben
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [7] A MULTI-STAGE BAYESIAN PREDICTION FRAMEWORK FOR SUBSURFACE FLOWS
    Ginting, V.
    Pereira, F.
    Rahunanthan, A.
    INTERNATIONAL JOURNAL FOR UNCERTAINTY QUANTIFICATION, 2013, 3 (06) : 499 - 522
  • [8] Legal Judgment Prediction via Heterogeneous Graphs and Knowledge of Law Articles
    Zhao, Qihui
    Gao, Tianhan
    Zhou, Song
    Li, Dapeng
    Wen, Yingyou
    APPLIED SCIENCES-BASEL, 2022, 12 (05):
  • [9] Distinguish Confusion in Legal Judgment Prediction via Revised Relation Knowledge
    Xu, Nuo
    Wang, Pinghui
    Zhao, Junzhou
    Sun, Feiyang
    Lan, Lin
    Tao, Jing
    Pan, Li
    Guan, Xiaohong
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 43 (01)
  • [10] MuSeFFF: Multi-stage feature fusion framework for traffic prediction
    Kumar A.
    Sunitha R.
    Intelligent Systems with Applications, 2023, 18