PriorGuide: Test-Time Prior Adaptation for Simulation-Based Inference

arXiv stat.ML / 4/22/2026

💬 OpinionModels & Research

Key Points

  • Amortized simulator-based inference can generate posterior or posterior-predictive samples without additional simulator runs after training, often using diffusion-based generative models to map observed data to parameters or predictions.
  • A key limitation is that these trained models depend heavily on the prior distribution(s) used to generate the simulated training pairs.
  • The paper introduces PriorGuide, a method tailored for diffusion-based amortized inference that adapts the trained model to new priors at test time.
  • PriorGuide uses a guidance approximation to achieve this prior adaptation without expensive retraining, enabling users to incorporate updated information or expert knowledge after deployment.

Abstract

Amortized simulator-based inference offers a powerful framework for tackling Bayesian inference in computational fields such as engineering or neuroscience, increasingly leveraging modern generative methods like diffusion models to map observed data to model parameters or future predictions. These approaches yield posterior or posterior-predictive samples for new datasets without requiring further simulator calls after training on simulated parameter-data pairs. However, their applicability is often limited by the prior distribution(s) used to generate model parameters during this training phase. To overcome this constraint, we introduce PriorGuide, a technique specifically designed for diffusion-based amortized inference methods. PriorGuide leverages a novel guidance approximation that enables flexible adaptation of the trained diffusion model to new priors at test time, crucially without costly retraining. This allows users to readily incorporate updated information or expert knowledge post-training, enhancing the versatility of pre-trained inference models.