ReLU Networks for Exact Generation of Similar Graphs

arXiv cs.LG / 4/8/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper studies constrained graph generation, focusing on producing graphs that stay within a specified graph edit distance from a given source graph.
  • It provides a theoretical characterization showing that ReLU neural networks can deterministically generate such graphs with constant depth and polynomial size (O(n^2 d)) guarantees.
  • The proposed approach removes dependence on training data, addressing a key limitation of many data-driven graph generators that may violate edit-distance constraints.
  • Experiments indicate the method can generate valid graphs for up to 1,400 vertices and edit-distance bounds up to 140, outperforming baseline generative models on constraint satisfaction.
  • The work establishes a theoretical foundation for building compact constrained generative models with provable validity rather than probabilistic correctness.

Abstract

Generation of graphs constrained by a specified graph edit distance from a source graph is important in applications such as cheminformatics, network anomaly synthesis, and structured data augmentation. Despite the growing demand for such constrained generative models in areas including molecule design and network perturbation analysis, the neural architectures required to provably generate graphs within a bounded graph edit distance remain largely unexplored. In addition, existing graph generative models are predominantly data-driven and depend heavily on the availability and quality of training data, which may result in generated graphs that do not satisfy the desired edit distance constraints. In this paper, we address these challenges by theoretically characterizing ReLU neural networks capable of generating graphs within a prescribed graph edit distance from a given graph. In particular, we show the existence of constant depth and O(n^2 d) size ReLU networks that deterministically generate graphs within edit distance d from a given input graph with n vertices, eliminating reliance on training data while guaranteeing validity of the generated graphs. Experimental evaluations demonstrate that the proposed network successfully generates valid graphs for instances with up to 1400 vertices and edit distance bounds up to 140, whereas baseline generative models fail to generate graphs with the desired edit distance. These results provide a theoretical foundation for constructing compact generative models with guaranteed validity.