Score Shocks: The Burgers Equation Structure of Diffusion Generative Models

arXiv stat.ML / 4/10/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes a PDE interpretation of diffusion generative models by showing that the model’s score field evolves according to Burgers-type laws (viscous Burgers in 1D and an irrotational vector Burgers system in higher dimensions).
  • It characterizes “speciation transitions” as the sharpening of interfaces between modes, with the score near binary mode boundaries containing a universal tanh interfacial term derived from heat-solution log-ratios.
  • For symmetric binary Gaussian mixtures, the analysis recovers an explicit speciation criterion/time consistent with prior results (including a spectral criterion) and links interface-layer width to diffusion time via a closed-form expression.
  • The authors study stability by quantifying exponential amplification of score errors across the inter-mode layer and show that Burgers dynamics preserves irrotationality.
  • They extend the framework by transforming the VP-SDE setting to the VE case to obtain a closed-form VP speciation time, and validate formulas analytically and via numerical checks on a quartic double-well.

Abstract

We analyze the score field of a diffusion generative model through a Burgers-type evolution law. For VE diffusion, the heat-evolved data density implies that the score obeys viscous Burgers in one dimension and the corresponding irrotational vector Burgers system in \R^d, giving a PDE view of \emph{speciation transitions} as the sharpening of inter-mode interfaces. For any binary decomposition of the noised density into two positive heat solutions, the score separates into a smooth background and a universal \tanh interfacial term determined by the component log-ratio; near a regular binary mode boundary this yields a normal criterion for speciation. In symmetric binary Gaussian mixtures, the criterion recovers the critical diffusion time detected by the midpoint derivative of the score and agrees with the spectral criterion of Biroli, Bonnaire, de~Bortoli, and M\'ezard (2024). After subtracting the background drift, the inter-mode layer has a local Burgers \tanh profile, which becomes global in the symmetric Gaussian case with width \sigma_\tau^2/a. We also quantify exponential amplification of score errors across this layer, show that Burgers dynamics preserves irrotationality, and use a change of variables to reduce the VP-SDE to the VE case, yielding a closed-form VP speciation time. Gaussian-mixture formulas are verified to machine precision, and the local theorem is checked numerically on a quartic double-well.