Papers › Adaptive Graph Diffusion Networks

Adaptive Graph Diffusion Networks

30 Dec 2020arXiv:2012.15024archive 2025-07-28

Chuxiong Sun, Jie Hu, Hongming Gu, Jinpeng Chen, MingChuan Yang

Graph Neural Networks (GNNs) have received much attention in the graph deep learning domain. However, recent research empirically and theoretically shows that deep GNNs suffer from over-fitting and over-smoothing problems. The usual solutions either cannot solve extensive runtime of deep GNNs or restrict graph convolution in the same feature space. We propose the Adaptive Graph Diffusion Networks (AGDNs) which perform multi-layer generalized graph diffusion in different feature spaces with moderate complexity and runtime. Standard graph diffusion methods combine large and dense powers of the transition matrix with predefined weighting coefficients. Instead, AGDNs combine smaller multi-hop node representations with learnable and generalized weighting coefficients. We propose two scalable mechanisms of weighting coefficients to capture multi-hop information: Hop-wise Attention (HA) and Hop-wise Convolution (HC). We evaluate AGDNs on diverse, challenging Open Graph Benchmark (OGB) datasets with semi-supervised node classification and link prediction tasks. Until the date of submission (Aug 26, 2022), AGDNs achieve top-1 performance on the ogbn-arxiv, ogbn-proteins and ogbl-ddi datasets and top-3 performance on the ogbl-citation2 dataset. On the similar Tesla V100 GPU cards, AGDNs outperform Reversible GNNs (RevGNNs) with 13% complexity and 1% training runtime of RevGNNs on the ogbn-proteins dataset. AGDNs also achieve comparable performance to SEAL with 36% training and 0.2% inference runtime of SEAL on the ogbl-citation2 dataset.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

skepsun/SAGN_with_SLE mentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Link PredictionNode ClassificationNode Property Prediction

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Link Property Prediction ogbl-citation2 AGDN w/GraphSAINT Ext. data No #12 of 23 Archive leaderboard report
Link Property Prediction ogbl-citation2 AGDN w/GraphSAINT Number of params 306716 #12 of 23 Archive leaderboard report
Link Property Prediction ogbl-citation2 AGDN w/GraphSAINT Test MRR 0.8549 ± 0.0029 #12 of 23 Archive leaderboard report
Link Property Prediction ogbl-citation2 AGDN w/GraphSAINT Validation MRR 0.8556 ± 0.0033 #12 of 23 Archive leaderboard report
Link Property Prediction ogbl-ddi AGDN (AUC loss) Ext. data No #5 of 31 Archive leaderboard report
Link Property Prediction ogbl-ddi AGDN (AUC loss) Number of params 3506691 #5 of 31 Archive leaderboard report
Link Property Prediction ogbl-ddi AGDN (AUC loss) Test Hits@20 0.9538 ± 0.0094 #5 of 31 Archive leaderboard report
Link Property Prediction ogbl-ddi AGDN (AUC loss) Validation Hits@20 0.8943 ± 0.0281 #5 of 31 Archive leaderboard report
Link Property Prediction ogbl-ppa AGDN Ext. data No #17 of 26 Archive leaderboard report
Link Property Prediction ogbl-ppa AGDN Number of params 36904259 #17 of 26 Archive leaderboard report
Link Property Prediction ogbl-ppa AGDN Test Hits@100 0.4123 ± 0.0159 #17 of 26 Archive leaderboard report
Link Property Prediction ogbl-ppa AGDN Validation Hits@100 0.4332 ± 0.0092 #17 of 26 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT+self-KD Ext. data Yes #8 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT+self-KD Number of params 1309760 #8 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT+self-KD Test Accuracy 0.7637 ± 0.0011 #8 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT+self-KD Validation Accuracy 0.7719 ± 0.0008 #8 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT Ext. data Yes #12 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT Number of params 1309760 #12 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT Test Accuracy 0.7618 ± 0.0016 #12 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv GIANT-XRT+AGDN+BoT Validation Accuracy 0.7724 ± 0.0006 #12 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD+C&S Ext. data No #20 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD+C&S Number of params 1513294 #20 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD+C&S Test Accuracy 0.7431 ± 0.0014 #20 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD+C&S Validation Accuracy 0.7518 ± 0.0009 #20 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD Ext. data No #21 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD Number of params 1513294 #21 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD Test Accuracy 0.7428 ± 0.0017 #21 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT+self-KD Validation Accuracy 0.7526 ± 0.0001 #21 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT Ext. data No #27 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT Number of params 1513294 #27 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT Test Accuracy 0.7410 ± 0.0015 #27 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN+BoT Validation Accuracy 0.7522 ± 0.0007 #27 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads+labels) Ext. data No #31 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads+labels) Number of params 1508555 #31 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads+labels) Test Accuracy 0.7398 ± 0.0009 #31 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads+labels) Validation Accuracy 0.7519 ± 0.0009 #31 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads) Ext. data No #37 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads) Number of params 1447115 #37 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads) Test Accuracy 0.7375 ± 0.0021 #37 of 86 Archive leaderboard report
Node Property Prediction ogbn-arxiv AGDN (GAT-HA+3_heads) Validation Accuracy 0.7483 ± 0.0009 #37 of 86 Archive leaderboard report
Node Property Prediction ogbn-products AGDN Ext. data No #29 of 64 Archive leaderboard report
Node Property Prediction ogbn-products AGDN Number of params 1544047 #29 of 64 Archive leaderboard report
Node Property Prediction ogbn-products AGDN Test Accuracy 0.8334 ± 0.0027 #29 of 64 Archive leaderboard report
Node Property Prediction ogbn-products AGDN Validation Accuracy 0.9229 ± 0.0010 #29 of 64 Archive leaderboard report
Node Property Prediction ogbn-proteins AGDN Ext. data No #3 of 26 Archive leaderboard report
Node Property Prediction ogbn-proteins AGDN Number of params 8605486 #3 of 26 Archive leaderboard report
Node Property Prediction ogbn-proteins AGDN Test ROC-AUC 0.8865 ± 0.0013 #3 of 26 Archive leaderboard report
Node Property Prediction ogbn-proteins AGDN Validation ROC-AUC 0.9418 ± 0.0005 #3 of 26 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Diffusion

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections