AI Navigate

Node Role-Guided LLMs for Dynamic Graph Clustering

arXiv cs.LG / 3/17/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces DyG-RoLLM, an end-to-end interpretable framework for dynamic graph clustering that uses learnable prototypes to map continuous graph embeddings to discrete semantic concepts for better interpretability.
  • It decomposes node representations into orthogonal role and clustering subspaces and defines five semantic prototypes (Leader, Contributor, Wanderer, Connector, Newcomer) to distinguish roles within communities.
  • A hierarchical LLM reasoning mechanism is designed to generate clustering results and natural language explanations, with consistency feedback serving as weak supervision to refine representations.
  • Experiments on four synthetic and six real-world benchmarks demonstrate improved interpretability, robustness, and effectiveness, and the authors release the code on GitHub.

Abstract

Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing how complex real-world systems evolve over time. However, existing methods are predominantly black-box models. They lack interpretability in their clustering decisions and fail to provide semantic explanations of why clusters form or how they evolve, severely limiting their use in safety-critical domains such as healthcare or transportation. To address these limitations, we propose an end-to-end interpretable framework that maps continuous graph embeddings into discrete semantic concepts through learnable prototypes. Specifically, we first decompose node representations into orthogonal role and clustering subspaces, so that nodes with similar roles (e.g., hubs, bridges) but different cluster affiliations can be properly distinguished. We then introduce five node role prototypes (Leader, Contributor, Wanderer, Connector, Newcomer) in the role subspace as semantic anchors, transforming continuous embeddings into discrete concepts to facilitate LLM understanding of node roles within communities. Finally, we design a hierarchical LLM reasoning mechanism to generate both clustering results and natural language explanations, while providing consistency feedback as weak supervision to refine node representations. Experimental results on four synthetic and six real-world benchmarks demonstrate the effectiveness, interpretability, and robustness of DyG-RoLLM. Code is available at https://github.com/Clearloveyuan/DyG-RoLLM.