High-dimensional Bayesian filtering through deep density approximation

arXiv stat.ML / 4/21/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper benchmarks two recent deep density approaches for nonlinear filtering by learning the filtering density via the Fokker–Planck equation with Bayesian updates at discrete observation times.
  • Both the deep splitting filter and the deep backward stochastic differential equation (BSDE) filter use Feynman–Kac representations, Euler–Maruyama discretization, and neural networks, and are further extended with logarithmic formulations for more robust, positivity-preserving density estimates.
  • In low-dimensional test cases, particle-based methods like the bootstrap particle filter perform well, but they break down at higher dimension, where the logarithmic deep BSDE filter performs best on a partially observed 100-dimensional Lorenz–96 system.
  • The deep density methods are reported to cut inference time by roughly 2–5 orders of magnitude compared with particle-based filters, improving scalability and computational efficiency.

Abstract

In this work, we systematically benchmark two recently developed deep density methods for nonlinear filtering. We model the filtering density of a discretely observed stochastic differential equation through the associated Fokker--Planck equation, coupled with Bayesian updates at discrete observation times. The two filters: the deep splitting filter and the deep backward stochastic differential equation filter, are both based on Feynman--Kac formulas, Euler--Maruyama discretizations and neural networks. The two methods are extended to logarithmic formulations providing sound, robust, and positivity-preserving density approximations in increasing state dimension. Comparing to the classical bootstrap particle filter and an ensemble Kalman filter, we benchmark the methods on numerous examples. In the low-dimensional examples the particle filters work well, but when we scale up to a partially observed 100-dimensional Lorenz-96 model, the particle-based methods fail and the logarithmic deep backward stochastic differential equation filter prevails. In terms of computational efficiency, the deep density methods reduce inference time by roughly two to five orders of magnitude relative to the particle-based filters.