Differentiable Initialization-Accelerated CPU-GPU Hybrid Combinatorial Scheduling

arXiv cs.AI / 4/1/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes a CPU–GPU hybrid framework for combinatorial scheduling problems expressed as Integer Linear Programming (ILP), addressing the scale challenge of NP-hard optimization.
  • It combines differentiable optimization with classical exact ILP solvers by using differentiable presolving to generate high-quality partial solutions that act as warm-starts for solvers like CPLEX, Gurobi, and HiGHS.
  • The differentiable presolving improves early pruning, leading to faster convergence than standalone ILP solving approaches.
  • Experiments on industry-scale benchmarks report up to a 10× performance improvement and reduce the optimality gap to below 0.1%.
  • The authors position this as an early proof point for integrating ML/differentiable optimization infrastructure with classical exact optimization across other optimization domains beyond scheduling.

Abstract

This paper presents a hybrid CPU-GPU framework for solving combinatorial scheduling problems formulated as Integer Linear Programming (ILP). While scheduling underpins many optimization tasks in computing systems, solving these problems optimally at scale remains a long-standing challenge due to their NP-hard nature. We introduce a novel approach that combines differentiable optimization with classical ILP solving. Specifically, we utilize differentiable presolving to rapidly generate high-quality partial solutions, which serve as warm-starts for commercial ILP solvers (CPLEX, Gurobi) and rising open-source solver HiGHS. This method enables significantly improved early pruning compared to state-of-the-art standalone solvers. Empirical results across industry-scale benchmarks demonstrate up to a 10\times performance gain over baselines, narrowing the optimality gap to <0.1\%. This work represents the first demonstration of utilizing differentiable optimization to initialize exact ILP solvers for combinatorial scheduling, opening new opportunities to integrate machine learning infrastructure with classical exact optimization methods across broader domains.