ProGRank: Probe-Gradient Reranking to Defend Dense-Retriever RAG from Corpus Poisoning

arXiv cs.AI / 3/25/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • ProGRank is a training-free retriever-side defense designed to protect dense-retriever RAG systems against corpus poisoning attacks that inject targeted passages into Top-K retrieval results.
  • It stress-tests each query–passage pair using mild randomized perturbations and derives probe gradients from a small fixed subset of retriever parameters to compute two instability signals: representational consistency and dispersion risk.
  • The method uses these signals in a reranking step with a score gate, aiming to improve robustness while keeping the original passage content unchanged.
  • Experiments on multiple datasets, multiple dense retriever backbones, and several representative poisoning attacks show stronger defense performance in both retrieval-stage and end-to-end RAG settings, with a favorable robustness–utility trade-off.
  • ProGRank is also competitive under adaptive evasive attacks and offers a surrogate-based variant when the deployed retriever is not accessible.

Abstract

Retrieval-Augmented Generation (RAG) improves the reliability of large language model applications by grounding generation in retrieved evidence, but it also introduces a new attack surface: corpus poisoning. In this setting, an adversary injects or edits passages so that they are ranked into the Top-K results for target queries and then affect downstream generation. Existing defences against corpus poisoning often rely on content filtering, auxiliary models, or generator-side reasoning, which can make deployment more difficult. We propose ProGRank, a post hoc, training-free retriever-side defence for dense-retriever RAG. ProGRank stress-tests each query--passage pair under mild randomized perturbations and extracts probe gradients from a small fixed parameter subset of the retriever. From these signals, it derives two instability signals, representational consistency and dispersion risk, and combines them with a score gate in a reranking step. ProGRank preserves the original passage content, requires no retraining, and also supports a surrogate-based variant when the deployed retriever is unavailable. Extensive experiments across three datasets, three dense retriever backbones, representative corpus poisoning attacks, and both retrieval-stage and end-to-end settings show that ProGRank provides stronger defence performance and a favorable robustness--utility trade-off. It also remains competitive under adaptive evasive attacks.