EnsemJudge: Enhancing Reliability in Chinese LLM-Generated Text Detection through Diverse Model Ensembles

arXiv cs.CL / 3/31/2026

📰 NewsIdeas & Deep AnalysisTools & Practical UsageModels & Research

Key Points

  • The paper introduces EnsemJudge, a robust framework designed to detect Chinese LLM-generated text under real-world conditions such as out-of-domain and adversarial inputs.
  • It leverages tailored strategies plus ensemble voting across diverse model components to improve detection reliability beyond single-model approaches.
  • The authors train and evaluate EnsemJudge on a Chinese dataset from the NLPCC2025 Shared Task 1, addressing a gap in prior work that largely focused on English.
  • The system outperformed baseline methods and reportedly achieved first place in the task, indicating strong effectiveness for Chinese text detection.
  • The code is released publicly, enabling other researchers and practitioners to reproduce and build upon the approach.

Abstract

Large Language Models (LLMs) are widely applied across various domains due to their powerful text generation capabilities. While LLM-generated texts often resemble human-written ones, their misuse can lead to significant societal risks. Detecting such texts is an essential technique for mitigating LLM misuse, and many detection methods have shown promising results across different datasets. However, real-world scenarios often involve out-of-domain inputs or adversarial samples, which can affect the performance of detection methods to varying degrees. Furthermore, most existing research has focused on English texts, with limited work addressing Chinese text detection. In this study, we propose EnsemJudge, a robust framework for detecting Chinese LLM-generated text by incorporating tailored strategies and ensemble voting mechanisms. We trained and evaluated our system on a carefully constructed Chinese dataset provided by NLPCC2025 Shared Task 1. Our approach outperformed all baseline methods and achieved first place in the task, demonstrating its effectiveness and reliability in Chinese LLM-generated text detection. Our code is available at https://github.com/johnsonwangzs/MGT-Mini.