Residual-loss Anomaly Analysis of Physics-Informed Neural Networks: An Inverse Method for Change-point Detection in Nonlinear Dynamical Systems with Regime Switching

arXiv stat.ML / 4/29/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces “residual-loss anomaly analysis” using physics-informed neural networks to jointly perform change-point detection and parameter estimation for nonlinear dynamical systems with regime switching.
  • It first analyzes local physics residuals via overlapping subinterval decomposition, where residuals show a distinct, non-zero structural elevation when a subinterval covers a true transition point.
  • It then formulates a unified physical loss that jointly optimizes transition locations and piecewise parameters, keeping them coupled within one training objective.
  • Experiments on multiple benchmark systems (e.g., Van der Pol, Lotka–Volterra, Lorenz, and growth models) show improved accuracy over traditional decoupled methods for both locating change points and estimating parameters.
  • The work frames the approach as an efficient unified solution for inverse problems whose components are structurally coupled in regime-switching dynamics.

Abstract

Nonlinear dynamical systems with regime transitions are typically described by ordinary differential equations with jumping parameters parameters. Traditional methods often treat change-point detection and parameter estimation as separate tasks, ignoring the inherent coupling between them. To address this, we propose residual-loss anomaly analysis of physics-informed neural networks, a unified framework that leverages dynamical consistency within the physics-informed learning paradigm. This approach jointly infers piecewise parameters and transition points under a single set of constraints. The method follows a two-stage strategy: First, local physical residuals are analyzed through overlapping subinterval decomposition. When a subinterval spans a true transition point, the residual exhibits a distinct structural elevation in noise-free conditions, which has a non-zero lower bound, enabling effective localization of potential transition intervals. Second, within our framework, change-point locations and piecewise parameters are integrated into a unified physical loss function for joint optimization, enabling simultaneous identification. Experiments on benchmark nonlinear dynamical systems, including Malthusian and logistic growth models, Van der Pol oscillator, Lotka-Volterra model and Lorenz system, demonstrate that the proposed method outperforms traditional decoupled approaches in both change-point localization and parameter estimation accuracy. This study provides an efficient, unified solution for structurally coupled inverse problems in nonlinear dynamical systems with regime switching.