A Comparative Investigation of Thermodynamic Structure-Informed Neural Networks

arXiv cs.LG / 3/31/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper presents a systematic comparison of thermodynamic structure-informed physics-informed neural networks (PINNs) by testing multiple thermodynamic formulations across conservative and dissipative systems.
  • It evaluates how formulation choice affects accuracy, physical/thermodynamic consistency, noise robustness, and interpretability using numerical experiments on representative ODEs and PDEs.
  • The authors find that Newtonian-residual-based PINNs can reconstruct states but often struggle to recover important physical/thermodynamic quantities reliably.
  • Structure-preserving thermodynamics formulations substantially improve parameter identification, thermodynamic consistency, and robustness to noise.
  • The work offers design guidance for building thermodynamics-consistent PINN models and aims to support future integration of broader nonequilibrium thermodynamic structures in physics-informed machine learning.

Abstract

Physics-informed neural networks (PINNs) offer a unified framework for solving both forward and inverse problems of differential equations, yet their performance and physical consistency strongly depend on how governing laws are incorporated. In this work, we present a systematic comparison of different thermodynamic structure-informed neural networks by incorporating various thermodynamics formulations, including Newtonian, Lagrangian, and Hamiltonian mechanics for conservative systems, as well as the Onsager variational principle and extended irreversible thermodynamics for dissipative systems. Through comprehensive numerical experiments on representative ordinary and partial differential equations, we quantitatively evaluate the impact of these formulations on accuracy, physical consistency, noise robustness, and interpretability. The results show that Newtonian-residual-based PINNs can reconstruct system states but fail to reliably recover key physical and thermodynamic quantities, whereas structure-preserving formulation significantly enhances parameter identification, thermodynamic consistency, and robustness. These findings provide practical guidance for principled design of thermodynamics-consistency model, and lay the groundwork for integrating more general nonequilibrium thermodynamic structures into physics-informed machine learning.