CGRL: Causal-Guided Representation Learning for Graph Out-of-Distribution Generalization

arXiv stat.ML / 3/26/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper addresses a key limitation of Graph Neural Networks (GNNs): unreliable out-of-distribution (OOD) generalization caused by learning spurious correlations instead of causal signals.
  • It proposes Causal-Guided Representation Learning by constructing a causal graph and using backdoor adjustment to block non-causal paths during training.
  • The authors theoretically derive a lower bound intended to explain how the causal formulation can improve OOD generalization for node classification tasks.
  • A new method is introduced that combines causal representation learning (capturing node-level causal invariance and reconstructing a graph posterior distribution) with a loss replacement strategy using asymptotic losses.
  • Experiments on OOD benchmarks show improved performance and reduced instability in mutual information learning between representations and ground-truth labels under distribution shift.

Abstract

Graph Neural Networks (GNNs) have achieved impressive performance in graph-related tasks. However, they suffer from poor generalization on out-of-distribution (OOD) data, as they tend to learn spurious correlations. Such correlations present a phenomenon that GNNs fail to stably learn the mutual information between prediction representations and ground-truth labels under OOD settings. To address these challenges, we formulate a causal graph starting from the essence of node classification, adopt backdoor adjustment to block non-causal paths, and theoretically derive a lower bound for improving OOD generalization of GNNs. To materialize these insights, we further propose a novel approach integrating causal representation learning and a loss replacement strategy. The former captures node-level causal invariance and reconstructs graph posterior distribution. The latter introduces asymptotic losses of the same order to replace the original losses. Extensive experiments demonstrate the superiority of our method in OOD generalization and effectively alleviating the phenomenon of unstable mutual information learning.

CGRL: Causal-Guided Representation Learning for Graph Out-of-Distribution Generalization | AI Navigate