AI Navigate

Manifold-Orthogonal Dual-spectrum Extrapolation for Parameterized Physics-Informed Neural Networks

arXiv cs.LG / 3/17/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • MODE introduces a lightweight micro-architecture called Manifold-Orthogonal Dual-spectrum Extrapolation to adapt physics operators in parameterized PINNs without the drawbacks of SVD-based fine-tuning.
  • It combines principal-spectrum dense mixing, residual-spectrum awakening, and affine Galilean unlocking to enable cross-modal energy transfer and activation of high-frequency spectral components with minimal trainable parameters.
  • The method aims to preserve the structured physical manifolds of operator representations while improving out-of-distribution generalization.
  • Experiments on 1D Convection–Diffusion–Reaction and 2D Helmholtz PDE benchmarks show MODE outperforms existing PEFT baselines and maintains near-native SVD parameter efficiency.
  • The work positions MODE as a practical approach for robust, efficient adaptation of PDE-informed neural networks under new physical conditions.

Abstract

Physics-informed neural networks (PINNs) have achieved notable success in modeling dynamical systems governed by partial differential equations (PDEs). To avoid computationally expensive retraining under new physical conditions, parameterized PINNs (P^2INNs) commonly adapt pre-trained operators using singular value decomposition (SVD) for out-of-distribution (OOD) regimes. However, SVD-based fine-tuning often suffers from rigid subspace locking and truncation of important high-frequency spectral modes, limiting its ability to capture complex physical transitions. While parameter-efficient fine-tuning (PEFT) methods appear to be promising alternatives, applying conventional adapters such as LoRA to P^2INNs introduces a severe Pareto trade-off, as additive updates increase parameter overhead and disrupt the structured physical manifolds inherent in operator representations. To address these limitations, we propose Manifold-Orthogonal Dual-spectrum Extrapolation (MODE), a lightweight micro-architecture designed for physics operator adaptation. MODE decomposes physical evolution into complementary mechanisms including principal-spectrum dense mixing that enables cross-modal energy transfer within frozen orthogonal bases, residual-spectrum awakening that activates high-frequency spectral components through a single trainable scalar, and affine Galilean unlocking that explicitly isolates spatial translation dynamics. Experiments on challenging PDE benchmarks including the 1D Convection--Diffusion--Reaction equation and the 2D Helmholtz equation demonstrate that MODE achieves strong out-of-distribution generalization while preserving the minimal parameter complexity of native SVD and outperforming existing PEFT-based baselines.