When Edge Independence Fails: Joint Graph Diffusion with Latent Sociability Priors
Adarsh Jamadandi, Nicolas Keriven, Aline Roumy
Abstract
Discrete graph diffusion models corrupt graph structure through independent edge updates with a Markovian noise model. Combined with the exchangeability requirement on the output distribution, the terminal prior is necessarily an Erdős--Rényi (E-R) random graph. This has a fundamental consequence for unconditional graph generation without node features: in the large graph limit, any GNN denoiser applied to an E-R graph approximately outputs an E-R graph, making effective denoising difficult. In practice, generated graphs fail to recover meaningful node heterogeneity and higher-order structure. Previous models introduced specialized node features to compensate, framing this as an expressivity problem, while the role of the prior remained unexamined. We instead address the root cause by introducing the Latent Sociability Prior (LSP) and a join diffusion process that co-evolves latent node sociability variables and graph structure, removing edge independence while preserving exchangeability. Unlike existing latent graph diffusion methods, the sociability mechanism requires no complex encoder: its sole role is to guide edge updates and preserve node heterogeneity throughout the trajectory. We validate our approach on multiple graph generation datasets and show that the proposed framework more accurately captures graph distributions than baseline methods without node features.
Create a lesson
Related papers
To Defer or Not to Defer? Online Learning with LLMs and Congested Experts
Vasileios Saketos, William Reveillard, Alexandre Proutiere et al.
ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter Transfer
Can Jin, Yan Kang, Yifan Gong et al.
scHFBiMamba: a bidirectional Mamba autoencoder for cardiac disease-state classification from single-nucleus RNA-seq data
Ugo Lomoio, Pietro Hiram Guzzi, Pierangelo Veltri
RELAGRAM: Recursive Latent Graph Model for the Capacitated Vehicle Routing Problem
Vladimir Kirill Bickov, Neil Yorke-Smith
Random Feature Pruning for Multi-Class Classification
Mohammad Amin Omidi, Babak Seyfe, Shahrokh Valaee
Anchors Enhance Controllability and Reasoning of Diffusion Language Models
Feiyu Qu, Zheng Huang, Andrea Zanette