An Efficient Spatial Branch-and-Bound Algorithm for Global Optimization of Gaussian Process Posterior Mean Functions

arXiv stat.ML / 5/5/2026

💬 OpinionDeveloper Stack & InfrastructureModels & Research

Key Points

  • The paper targets deterministic global optimization of trained Gaussian process (GP) posterior mean functions over hyperrectangular domains, where the objective is nonlinear and nonconvex despite having a closed-form expression.
  • It introduces PALM-Mean, a piecewise-analytic lower-bounding framework integrated into a reduced-space spatial branch-and-bound scheme to make the optimization tractable.
  • The method constructs valid lower bounds by locally replacing kernel terms with a sign-aware piecewise-linear relaxation in a scalar distance variable, while analytically bounding the remaining terms in closed form.
  • The authors prove validity of the node lower bounds and ebpsilona-global convergence of the algorithm.
  • Experiments on synthetic and real-world problems indicate improved scalability over general-purpose deterministic global solvers, especially as the number of GP training points grows.

Abstract

We study the deterministic global optimization of trained Gaussian process posterior mean functions over hyperrectangular domains. Although the posterior mean function has a compact closed-form representation, its global optimization is challenging because it remains nonlinear and nonconvex. Existing exact deterministic approaches become increasingly difficult to scale as the number of training data points grows, leading to approximation-based methods that improve tractability by optimizing a modified (inexact) objective. In this work, we propose PALM-Mean, a piecewise-analytic lower-bounding framework embedded in reduced-space spatial branch-and-bound. At each node, kernel terms that are locally important are replaced by a sign-aware piecewise-linear relaxation in an appropriate scalar distance variable, while the remaining terms are bounded analytically in closed form. We show this hybrid approach yields a valid lower bound for the posterior mean, while limiting the size of the branch-and-bound subproblems. We establish validity of the node lower bounds and \varepsilon-global convergence of the resulting algorithm. Computational results on synthetic benchmarks and real-world application problems show that PALM-Mean improves scalability relative to representative general-purpose deterministic global solvers, particularly as the number of training data points increases.