Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization

arXiv cs.CL / 5/5/2026

📰 NewsDeveloper Stack & InfrastructureModels & Research

Key Points

  • The paper proposes Judge-R1, a unified framework to improve LLM-based judgment document generation by addressing both legal information retrieval and reasoning quality.
  • It introduces Agentic Legal Information Collection, using a dynamic planning agent to retrieve accurate statutes and precedents across multiple sources.
  • It adds Rubric-Guided Optimization, a reinforcement learning stage that applies GRPO with a legal reward function to better align outputs with judicial standards and logical reasoning.
  • Experiments on the JuDGE benchmark reportedly show Judge-R1 outperforms existing Retrieval-Augmented Generation and supervised fine-tuning baselines in legal accuracy and overall generation quality.
  • The work targets common failure modes such as missing evidence, hallucinated statutory references, and logically flawed legal reasoning.

Abstract

Automating the drafting of judgment documents is pivotal to judicial efficiency, yet it remains challenging due to the dual requirements of comprehensive retrieval of legal information and rigorous logical reasoning. Existing approaches, typically relying on standard Retrieval-Augmented Generation and Supervised Fine-Tuning, often suffer from insufficient evidence recall, hallucinated statutory references, and logically flawed legal reasoning. To bridge this gap, we propose Judge-R1, a unified framework designed to enhance LLM-based judgment document generation by jointly improving legal information collection and judgment document generation. First, we introduce Agentic Legal Information Collection, which employs a dynamic planning agent to retrieve precise statutes and precedents from multiple sources. Second, we implement Rubric-Guided Optimization, a reinforcement learning phase utilizing Group Relative Policy Optimization (GRPO) with a comprehensive legal reward function to enforce adherence to judicial standards and reasoning logic. Extensive experiments on the JuDGE benchmark demonstrate that Judge-R1 significantly outperforms state-of-the-art baselines in both legal accuracy and generation quality.