Sparse Autoencoders as a Steering Basis for Phase Synchronization in Graph-Based CFD Surrogates

arXiv cs.LG / 4/8/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper addresses a common failure in oscillatory-flow graph-based CFD surrogates: phase drift, where outputs remain qualitatively similar but lose temporal alignment with real observations over time.
  • Instead of expensive retraining, it proposes post hoc latent-space “phase steering” for frozen pretrained models by intervening in the latent representation to correct phase misalignment.
  • To achieve controllable structure, it trains sparse autoencoders on frozen MeshGraphNet embeddings to obtain a disentangled, sparse basis suitable for intervention.
  • It introduces a phase-aware, temporally coherent intervention mechanism using Hilbert analysis to find oscillatory feature pairs, SVD to express fields as low-rank temporal coefficients, and smooth time-varying rotations to advance/delay modes while preserving amplitude-phase structure.
  • Experiments compare SAE-based steering against PCA and raw embedding spaces under the same intervention pipeline, finding sparse/disentangled representations work best and that static per-feature interventions fail for this dynamical problem.

Abstract

Graph-based surrogate models provide fast alternatives to high-fidelity CFD solvers, but their opaque latent spaces and limited controllability restrict use in safety-critical settings. A key failure mode in oscillatory flows is phase drift, where predictions remain qualitatively correct but gradually lose temporal alignment with observations, limiting use in digital twins and closed-loop control. Correcting this through retraining is expensive and impractical during deployment. We ask whether phase drift can instead be corrected post hoc by manipulating the latent space of a frozen surrogate. We propose a phase-steering framework for pretrained graph-based CFD models that combines the right representation with the right intervention mechanism. To obtain disentangled representation for effective steering, we use sparse autoencoders (SAEs) on frozen MeshGraphNet embeddings. To steer dynamics, we move beyond static per-feature interventions such as scaling or clamping, and introduce a temporally coherent, phase-aware method. Specifically, we identify oscillatory feature pairs with Hilbert analysis, project spatial fields into low-rank temporal coefficients via SVD, and apply smooth time-varying rotations to advance or delay periodic modes while preserving amplitude-phase structure. Using a representation-agnostic setup, we compare SAE-based steering with PCA and raw embedding spaces under the same intervention pipeline. Results show that sparse, disentangled representations outperform dense or entangled ones, while static interventions fail in this dynamical setting. Overall, this work shows that latent-space steering can be extended from semantic domains to time-dependent physical systems when interventions respect the underlying dynamics, and that the same sparse features used for interpretability can also serve as physically meaningful control axes.