Papers › Adaptive Sampling Towards Fast Graph Representation Learning

Adaptive Sampling Towards Fast Graph Representation Learning

14 Sep 2018NeurIPS 2018 12arXiv:1809.05343archive 2025-07-28

Wenbing Huang, Tong Zhang, Yu Rong, Junzhou Huang

Graph Convolutional Networks (GCNs) have become a crucial tool on learning representations of graph vertices. The main challenge of adapting GCNs on large-scale graphs is the scalability issue that it incurs heavy cost both in computation and memory due to the uncontrollable neighborhood expansion across layers. In this paper, we accelerate the training of GCNs through developing an adaptive layer-wise sampling method. By constructing the network layer by layer in a top-down passway, we sample the lower layer conditioned on the top one, where the sampled neighborhoods are shared by different parent nodes and the over expansion is avoided owing to the fixed-size sampling. More importantly, the proposed sampler is adaptive and applicable for explicit variance reduction, which in turn enhances the training of our method. Furthermore, we propose a novel and economical approach to promote the message passing over distant nodes by applying skip connections. Intensive experiments on several benchmarks verify the effectiveness of our method regarding the classification accuracy while enjoying faster convergence speed.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

dmlc/dgl pytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Graph Representation LearningNode ClassificationRepresentation Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Node Classification Citeseer Full-supervised ASGCN Accuracy 79.66% #2 of 7 Archive leaderboard report
Node Classification Cora AS-GCN Accuracy 87.44% ± 0.0034% #16 of 73 Archive leaderboard report
Node Classification Cora Full-supervised ASGCN Accuracy 87.44±0.0034% #4 of 9 Archive leaderboard report
Node Classification Pubmed Full-supervised ASGCN Accuracy 90.6% #2 of 7 Archive leaderboard report
Node Classification Reddit ASGCN Accuracy 96.27% #9 of 16 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections