GeoPAS: Geometric Probing for Algorithm Selection in Continuous Black-Box Optimisation

arXiv cs.LG / 4/13/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces GeoPAS, a geometric probing method for automated algorithm selection in continuous black-box optimization that builds problem representations from multiple coarse 2D slices across locations, orientations, and logarithmic scales.
  • GeoPAS uses a shared validity-aware convolutional encoder to embed each slice, conditions embeddings on slice-scale and amplitude statistics, and aggregates them in a permutation-invariant way to predict log-scale solver performance.
  • The approach is risk-aware: it includes an explicit penalty targeting tail failures, aiming to reduce poor outcomes that disproportionately affect average performance.
  • On COCO/BBOB benchmarks with a 12-solver portfolio in dimensions 2–10, GeoPAS outperforms the single best solver across leave-instance-out, grouped random, and leave-problem-out evaluations.
  • The authors find that while multi-scale geometric slices transfer well as static signals for solver selection, a small number of heavy-tail regimes still dominate mean performance, indicating room for further robustness.

Abstract

Automated algorithm selection in continuous black-box optimisation typically relies on fixed landscape descriptors computed under a limited probing budget, yet such descriptors can degrade under problem-split or cross-benchmark evaluation. We propose GeoPAS, a geometric probing approach that represents a problem instance by multiple coarse two-dimensional slices sampled across locations, orientations, and logarithmic scales. A shared validity-aware convolutional encoder maps each slice to an embedding, conditions it on slice-scale and amplitude statistics, and aggregates the resulting features permutation-invariantly for risk-aware solver selection via log-scale performance prediction with an explicit penalty on tail failures. On COCO/BBOB with a 12-solver portfolio in dimensions 2--10, GeoPAS improves over the single best solver under leave-instance-out, grouped random, and leave-problem-out evaluation. These results suggest that multi-scale geometric slices provide a useful transferable static signal for algorithm selection, although a small number of heavy-tail regimes remain and continue to dominate the mean. Our code is available at \href{https://github.com/BradWangW/GeoPAS}{GitHub}.