LMI-Net: Linear Matrix Inequality--Constrained Neural Networks via Differentiable Projection Layers

arXiv cs.LG / 4/8/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces LMI-Net, a differentiable projection layer designed to enforce linear matrix inequality (LMI) constraints in neural networks by construction rather than via soft penalties.
  • It reformulates the feasible LMI set as an intersection of an affine equality constraint with the positive semidefinite cone, then computes the forward pass using Douglas–Rachford splitting and enables training via implicit differentiation.
  • The authors provide theoretical convergence guarantees that the projection layer reaches a feasible point, turning a generic neural network into a model that satisfies LMI requirements with formal certification.
  • Experiments on tasks such as invariant ellipsoid synthesis and joint controller-and-certificate design for disturbed linear systems show improved feasibility under distribution shift compared with soft-constrained approaches while keeping fast inference speed.

Abstract

Linear matrix inequalities (LMIs) have played a central role in certifying stability, robustness, and forward invariance of dynamical systems. Despite rapid development in learning-based methods for control design and certificate synthesis, existing approaches often fail to preserve the hard matrix inequality constraints required for formal guarantees. We propose LMI-Net, an efficient and modular differentiable projection layer that enforces LMI constraints by construction. Our approach lifts the set defined by LMI constraints into the intersection of an affine equality constraint and the positive semidefinite cone, performs the forward pass via Douglas-Rachford splitting, and supports efficient backward propagation through implicit differentiation. We establish theoretical guarantees that the projection layer converges to a feasible point, certifying that LMI-Net transforms a generic neural network into a reliable model satisfying LMI constraints. Evaluated on experiments including invariant ellipsoid synthesis and joint controller-and-certificate design for a family of disturbed linear systems, LMI-Net substantially improves feasibility over soft-constrained models under distribution shift while retaining fast inference speed, bridging semidefinite-program-based certification and modern learning techniques.