Certified and accurate computation of function space norms of deep neural networks

arXiv stat.ML / 4/17/2026

💬 OpinionDeveloper Stack & InfrastructureModels & Research

Key Points

  • The paper addresses a key limitation in using neural networks for PDEs: pointwise probing is often insufficient to guarantee tight bounds on function-space norms like Lebesgue and Sobolev norms.
  • It introduces a framework for certified and accurate computation of integral quantities of deep neural networks by using interval arithmetic on axis-aligned boxes, along with adaptive refinement/marking and quadrature-based aggregation.
  • For each spatial box, the method computes guaranteed lower and upper bounds for network outputs and derivatives (e.g., values, Jacobians, Hessians), then propagates these local certificates to global bounds for the targeted integrals.
  • The authors provide a general convergence theorem for the certified adaptive quadrature procedure and instantiate it to obtain certified computation of L^p, W^{1,p}, and W^{2,p} norms.
  • They also demonstrate how the certified machinery can produce practical guaranteed bounds for PINN (physics-informed neural network) interior residuals, supported by numerical experiments.

Abstract

Neural network methods for PDEs require reliable error control in function space norms. However, trained neural networks can typically only be probed at a finite number of point values. Without strong assumptions, point evaluations alone do not provide enough information to derive tight deterministic and guaranteed bounds on function space norms. In this work, we move beyond a purely black-box setting and exploit the neural network structure directly. We present a framework for the certified and accurate computation of integral quantities of neural networks, including Lebesgue and Sobolev norms, by combining interval arithmetic enclosures on axis-aligned boxes with adaptive marking/refinement and quadrature-based aggregation. On each box, we compute guaranteed lower and upper bounds for function values and derivatives, and propagate these local certificates to global lower and upper bounds for the target integrals. Our analysis provides a general convergence theorem for such certified adaptive quadrature procedures and instantiates it for function values, Jacobians, and Hessians, yielding certified computation of L^p, W^{1,p}, and W^{2,p} norms. We further show how these ingredients lead to practical certified bounds for PINN interior residuals. Numerical experiments illustrate the accuracy and practical behavior of the proposed methods.