The Logical Expressiveness of Topological Neural Networks

arXiv cs.LG / 4/22/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • Graph neural networks are widely used for learning on graphs but are known to have limited expressive power, often characterized via the Weisfeiler–Leman (WL) hierarchy and first-order logic.
  • Topological neural networks (TNNs) improve expressiveness by adding higher-order relational structures to message passing, but their exact logical expressiveness was previously unclear.
  • The paper studies the logical power of TNNs using isomorphism tests tied to general TNN mechanisms and proposes higher-order WL-based tests for combinatorial complexes called k-CCWL.
  • It also introduces topological counting logic (TC_k) with a new pairwise counting quantifier, and proves a precise equivalence: k-CCWL ≡ TC_{k+2} ≡ Topological (k+2)-pebble game.
  • These formal results provide an expressiveness “theory” for TNNs, clarifying which binary graph classifiers they can represent.

Abstract

Graph neural networks (GNNs) are the standard for learning on graphs, yet they have limited expressive power, often expressed in terms of the Weisfeiler-Leman (WL) hierarchy or within the framework of first-order logic. In this context, topological neural networks (TNNs) have recently emerged as a promising alternative for graph representation learning. By incorporating higher-order relational structures into message-passing schemes, TNNs offer higher representational power than traditional GNNs. However, a fundamental question remains open: what is the logical expressiveness of TNNs? Answering this allows us to characterize precisely which binary classifiers TNNs can represent. In this paper, we address this question by analyzing isomorphism tests derived from the underlying mechanisms of general TNNs. We introduce and investigate the power of higher-order variants of WL-based tests for combinatorial complexes, called k-CCWL test. In addition, we introduce the topological counting logic (TC_k), an extension of standard counting logic featuring a novel pairwise counting quantifier \exists^{N}(x_i,x_j)\, \varphi(x_i,x_j), which explicitly quantifies pairs (x_i, x_j) satisfying property \varphi. We rigorously prove the exact equivalence: \text{k-CCWL} \equiv \text{TC}_{k{+}2} \equiv \text{Topological }(k{+}2)\text{-pebble game}. These results establish a logical expressiveness theory for TNNs.