Papers › Shot in the Dark: Few-Shot Learning with No Base-Class Labels

Shot in the Dark: Few-Shot Learning with No Base-Class Labels

6 Oct 2020arXiv:2010.02430archive 2025-07-28

Zitian Chen, Subhransu Maji, Erik Learned-Miller

Few-shot learning aims to build classifiers for new classes from a small number of labeled examples and is commonly facilitated by access to examples from a distinct set of 'base classes'. The difference in data distribution between the test set (novel classes) and the base classes used to learn an inductive bias often results in poor generalization on the novel classes. To alleviate problems caused by the distribution shift, previous research has explored the use of unlabeled examples from the novel classes, in addition to labeled examples of the base classes, which is known as the transductive setting. In this work, we show that, surprisingly, off-the-shelf self-supervised learning outperforms transductive few-shot methods by 3.9% for 5-shot accuracy on miniImageNet without using any base class labels. This motivates us to examine more carefully the role of features learned through self-supervision in few-shot learning. Comprehensive experiments are conducted to compare the transferability, robustness, efficiency, and the complementarity of supervised and self-supervised features.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Few-Shot LearningInductive BiasSelf-Supervised LearningUnsupervised Few-Shot Image ClassificationUnsupervised Few-Shot Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) UBC-FSL Accuracy 57.1 #9 of 28 Archive leaderboard report
Unsupervised Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) UBC-FSL Accuracy 77.2 #6 of 28 Archive leaderboard report
Unsupervised Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) UBC-FSL Accuracy 68.0 #4 of 12 Archive leaderboard report
Unsupervised Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) UBC-FSL Accuracy 84.3 #3 of 12 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections