Bayesian Modeling and Estimation of Linear Time-Varying Systems using Neural Networks and Gaussian Processes

arXiv stat.ML / 4/1/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes a unified Bayesian framework for identifying linear time-varying (LTV) systems from input-output data by treating the impulse response as a stochastic process and producing both posterior means and uncertainty-aware fluctuations.
  • It connects and unifies intrinsic channel variability and epistemic uncertainty within a single posterior representation, and introduces a new system class called Linear Time-Invariant in Expectation (LTIE).
  • For inference, the authors combine Bayesian neural networks and Gaussian Processes with scalable variational inference to estimate time-varying system properties.
  • Experiments show the method can infer LTI properties from a single noisy input-output pair, improves error performance versus a classical CCF stacking baseline in simulated ambient noise tomography, and can track continuously varying LTV impulse responses using a structured GP prior.
  • Overall, the work advances uncertainty-aware system identification for dynamic environments by blending probabilistic modeling with modern scalable ML techniques.

Abstract

The identification of Linear Time-Varying (LTV) systems from input-output data is a fundamental yet challenging ill-posed inverse problem. This work introduces a unified Bayesian framework that models the system's impulse response, h(t, \tau), as a stochastic process. We decompose the response into a posterior mean and a random fluctuation term, a formulation that provides a principled approach for quantifying uncertainty, unifies intrinsic channel variability and epistemic uncertainty through a common posterior representation, and naturally defines a new, useful system class we term Linear Time-Invariant in Expectation (LTIE). To perform inference, we leverage modern machine learning techniques, including Bayesian neural networks and Gaussian Processes, using scalable variational inference. We demonstrate through a series of experiments that our framework can infer the properties of an LTI system from a single noisy input-output pair, including under deliberate additive-noise misspecification, achieve a lower overall error floor than the classical CCF stacking baseline in a simulated ambient noise tomography setting, and track a continuously varying LTV impulse response by using a structured Gaussian Process prior. This work provides a flexible and robust methodology for uncertainty-aware system identification in dynamic environments.