AutoRAGTuner: A Declarative Framework for Automatic Optimization of RAG Pipelines

arXiv cs.LG / 5/6/2026

📰 NewsDeveloper Stack & InfrastructureIdeas & Deep AnalysisModels & Research

Key Points

  • AutoRAGTuner is a declarative, configuration-driven framework that automatically optimizes the full Retrieval-Augmented Generation (RAG) pipeline lifecycle, including construction, execution, evaluation, and optimization.
  • It uses a modular design with component registration to decouple pipeline stages, making it easier to swap and adjust parts of different RAG architectures.
  • To handle heterogeneous inputs, the framework introduces the Domain-Element Model (DEM), which represents objects as atomic elements connected via bidirectional pointers to support structures such as nodes, edges, and hyperedges.
  • AutoRAGTuner includes an adaptive Bayesian optimization engine for end-to-end hyper-parameter tuning, improving performance over default baselines across both vanilla and graph-based RAG pipelines.
  • The authors report up to a 95% reduction in code churn when changing RAG architectures, lowering engineering overhead and enabling more reusable, evolvable RAG systems.

Abstract

Retrieval-Augmented Generation (RAG) enhances LLMs, but performance is highly sensitive to complex architecture designs and hyper-parameter configurations, which currently rely on inefficient manual tuning. We present AutoRAGTuner, a declarative, configuration-driven framework that automates the RAG life cycle: construction, execution,evaluation, and optimization. AutoRAGTuner employs a modular architecture to decouple pipeline stages through a component registration mechanism. To unify heterogeneous data, we introduce the Domain-Element Model (DEM), representing objects as atomic elements with bidirectional pointers to support nodes, edges, and hyperedges. Furthermore, AutoRAGTuner integrates an adaptive Bayesian optimization engine for end-to-end hyper-parameter tuning. Experimental results demonstrate AutoRAGTuner's architectural generality: across diverse RAG pipelines, ranging from vanilla to graph-based, the framework consistently outperforms default baselines. Notably, AutoRAGTuner significantly mitigates engineering overhead, where its declarative configuration language enables a up to 95\% reduction in code churn for architectural adjustments. Overall, AutoRAGTuner provides a systematically optimizable foundation for building evolvable and reusable RAG systems.