Robust Graph Representation Learning via Adaptive Spectral Contrast

arXiv cs.LG / 4/3/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper analyzes spectral graph contrastive learning and identifies a “spectral dilemma” where high-frequency components needed for heterophily also have higher variance under spectrally concentrated perturbations.
  • It derives a regret lower bound proving that existing global (node-agnostic) spectral fusion strategies are provably sub-optimal on mixed graphs with different node-wise frequency preferences.
  • To overcome this, the authors propose ASPECT, a reliability-aware spectral gating framework that uses node-wise gates to dynamically re-weight frequency channels.
  • ASPECT is formulated as a minimax game with an adversary that targets spectral energy distributions using a Rayleigh quotient penalty to enforce spectrally robust, structurally discriminative representations.
  • Experiments indicate ASPECT achieves new state-of-the-art results on 8 of 9 benchmarks while decoupling structural heterophily from incidental noise.

Abstract

Spectral graph contrastive learning has emerged as a unified paradigm for handling both homophilic and heterophilic graphs by leveraging high-frequency components. However, we identify a fundamental spectral dilemma: while high-frequency signals are indispensable for encoding heterophily, our theoretical analysis proves they exhibit significantly higher variance under spectrally concentrated perturbations. We derive a regret lower bound showing that existing global (node-agnostic) spectral fusion is provably sub-optimal: on mixed graphs with separated node-wise frequency preferences, any global fusion strategy incurs non-vanishing regret relative to a node-wise oracle. To escape this bound, we propose ASPECT, a framework that resolves this dilemma through a reliability-aware spectral gating mechanism. Formulated as a minimax game, ASPECT employs a node-wise gate that dynamically re-weights frequency channels based on their stability against a purpose-built adversary, which explicitly targets spectral energy distributions via a Rayleigh quotient penalty. This design forces the encoder to learn representations that are both structurally discriminative and spectrally robust. Empirical results show that ASPECT achieves new state-of-the-art performance on 8 out of 9 benchmarks, effectively decoupling meaningful structural heterophily from incidental noise.