Papers › Optimization of Graph Neural Networks with Natural Gradient Descent
Optimization of Graph Neural Networks with Natural Gradient Descent
Mohammad Rasool Izadi, Yihao Fang, Robert Stevenson, Lizhen Lin
In this work, we propose to employ information-geometric tools to optimize a graph neural network architecture such as the graph convolutional networks. More specifically, we develop optimization algorithms for the graph-based semi-supervised learning by employing the natural gradient information in the optimization process. This allows us to efficiently exploit the geometry of the underlying statistical model or parameter space for optimization and inference. To the best of our knowledge, this is the first work that has utilized the natural gradient for the optimization of graph neural networks that can be extended to other semi-supervised problems. Efficient computations algorithms are developed and extensive numerical studies are conducted to demonstrate the superior performance of our algorithms over existing algorithms such as ADAM and SGD.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Node Classification | CiteSeer with Public Split: fixed 20 nodes per class | SSP | Accuracy | 74.28 ± 0.67% | #8 of 40 | Archive leaderboard | report |
| Node Classification | Citeseer | SSP | Accuracy | 80.52 ± 0.14 | #5 of 71 | Archive leaderboard | report |
| Node Classification | Cora | SSP | Accuracy | 90.16% ± 0.59% | #1 of 73 | Archive leaderboard | report |
| Node Classification | Cora with Public Split: fixed 20 nodes per class | SSP | Accuracy | 82.84 ± 0.87% | #25 of 36 | Archive leaderboard | report |
| Node Classification | PubMed with Public Split: fixed 20 nodes per class | SSP | Accuracy | 80.06 ± 0.34% | #16 of 37 | Archive leaderboard | report |
| Node Classification | Pubmed | SSP | Accuracy | 89.36 ± 0.57 | #11 of 70 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections