Papers › Model-Agnostic Graph Regularization for Few-Shot Learning

Model-Agnostic Graph Regularization for Few-Shot Learning

14 Feb 2021arXiv:2102.07077archive 2025-07-28

Ethan Shen, Maria Brbic, Nicholas Monath, Jiaqi Zhai, Manzil Zaheer, Jure Leskovec

In many domains, relationships between categories are encoded in the knowledge graph. Recently, promising results have been achieved by incorporating knowledge graph as side information in hard classification tasks with severely limited data. However, prior models consist of highly complex architectures with many sub-components that all seem to impact performance. In this paper, we present a comprehensive empirical study on graph embedded few-shot learning. We introduce a graph regularization approach that allows a deeper understanding of the impact of incorporating graph information between labels. Our proposed regularization is widely applicable and model-agnostic, and boosts the performance of any few-shot learning model, including fine-tuning, metric-based, and optimization-based meta-learning. Our approach improves the performance of strong base learners by up to 2% on Mini-ImageNet and 6.7% on ImageNet-FS, outperforming state-of-the-art graph embedded methods. Additional analyses reveal that graph regularizing models result in a lower loss for more difficult tasks, such as those with fewer shots and less informative support examples.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-Shot Image ClassificationFew-Shot LearningMeta-Learningmodel

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Few-Shot Image Classification ImageNet-FS (1-shot, novel) SGM + Graph (ResNet-50) Top-5 Accuracy (%) 61.1 #3 of 7 Archive leaderboard report
Few-Shot Image Classification ImageNet-FS (2-shot, novel) SGM + Graph (ResNet-50) Top-5 Accuracy (%) 70.3 #3 of 8 Archive leaderboard report
Few-Shot Image Classification ImageNet-FS (5-shot, all) SGM + graph Top-5 Accuracy (%) 78.6 #3 of 8 Archive leaderboard report
Few-Shot Image Classification ImageNet-FS (5-shot, novel) SGM + Graph (ResNet-50) Top-5 Accuracy (%) 78.6 #2 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections