GroupRAG: Cognitively Inspired Group-Aware Retrieval and Reasoning via Knowledge-Driven Problem Structuring

arXiv cs.CL / 3/31/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper argues that language-model performance is often limited not just by missing knowledge or reasoning constraints, but by insufficient awareness of the underlying problem structure.
  • It proposes GroupRAG, a cognitively inspired framework that performs knowledge-driven keypoint grouping to expose latent structural groups in a problem.
  • GroupRAG uses multiple conceptual starting points to interleave retrieval and reasoning more tightly than standard Retrieval-Augmented Generation (RAG) or linear Chain-of-Thought (CoT) methods.
  • Experiments on MedQA show GroupRAG outperforms representative RAG- and CoT-based baselines, suggesting improved robustness in real-world settings.
  • Overall, the work positions explicit problem-structure modeling—via human-cognition-inspired search over structured spaces—as a promising direction for retrieval-augmented reasoning.

Abstract

The performance of language models is commonly limited by insufficient knowledge and constrained reasoning. Prior approaches such as Retrieval-Augmented Generation (RAG) and Chain-of-Thought (CoT) address these issues by incorporating external knowledge or enforcing linear reasoning chains, but often degrade in real-world settings. Inspired by cognitive science, which characterizes human problem solving as search over structured problem spaces rather than single inference chains, we argue that inadequate awareness of problem structure is a key overlooked limitation. We propose GroupRAG, a cognitively inspired, group-aware retrieval and reasoning framework based on knowledge-driven keypoint grouping. GroupRAG identifies latent structural groups within a problem and performs retrieval and reasoning from multiple conceptual starting points, enabling fine-grained interaction between the two processes. Experiments on MedQA show that GroupRAG outperforms representative RAG- and CoT-based baselines. These results suggest that explicitly modeling problem structure, as inspired by human cognition, is a promising direction for robust retrieval-augmented reasoning.