SPDE Methods for Nonparametric Bayesian Posterior Contraction and Laplace Approximation

arXiv stat.ML / 3/25/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper extends a diffusion-based framework to derive posterior contraction rates and finite-sample Bernstein–von Mises (BvM) results for nonparametric Bayesian models in infinite-dimensional (Hilbert space) settings.
  • It models the posterior as the invariant measure of a Langevin stochastic partial differential equation (SPDE), enabling control of posterior moments and obtaining non-asymptotic concentration rates in Hilbert norms.
  • The authors provide a quantitative Laplace approximation for the posterior, including conditions related to likelihood curvature and regularity.
  • A nonparametric linear Gaussian inverse problem is used as an application to illustrate and validate the theoretical results.

Abstract

We derive posterior contraction rates (PCRs) and finite-sample Bernstein von Mises (BvM) results for non-parametric Bayesian models by extending the diffusion-based framework of Mou et al. (2024) to the infinite-dimensional setting. The posterior is represented as the invariant measure of a Langevin stochastic partial differential equation (SPDE) on a separable Hilbert space, which allows us to control posterior moments and obtain non-asymptotic concentration rates in Hilbert norms under various likelihood curvature and regularity conditions. We also establish a quantitative Laplace approximation for the posterior. The theory is illustrated in a nonparametric linear Gaussian inverse problem.

SPDE Methods for Nonparametric Bayesian Posterior Contraction and Laplace Approximation | AI Navigate