Papers › Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classification

Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classification

18 Sep 2022arXiv:2209.08527archive 2025-07-28

Yuqing Hu, Stéphane Pateux, Vincent Gripon

Transductive Few-Shot learning has gained increased attention nowadays considering the cost of data annotations along with the increased accuracy provided by unlabelled samples in the domain of few shot. Especially in Few-Shot Classification (FSC), recent works explore the feature distributions aiming at maximizing likelihoods or posteriors with respect to the unknown parameters. Following this vein, and considering the parallel between FSC and clustering, we seek for better taking into account the uncertainty in estimation due to lack of data, as well as better statistical properties of the clusters associated with each class. Therefore in this paper we propose a new clustering method based on Variational Bayesian inference, further improved by Adaptive Dimension Reduction based on Probabilistic Linear Discriminant Analysis. Our proposed method significantly improves accuracy in the realistic unbalanced transductive setting on various Few-Shot benchmarks when applied to features used in previous studies, with a gain of up to 6% in accuracy. In addition, when applied to balanced setting, we obtain very competitive results without making use of the class-balance artefact which is disputable for practical use cases. We also provide the performance of our method on a high performing pretrained backbone, with the reported results further surpassing the current state-of-the-art accuracy, suggesting the genericity of the proposed method.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Bayesian InferenceClusteringDimensionality ReductionFew-Shot Image ClassificationFew-Shot LearningVariational Inference

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Few-Shot Image Classification CIFAR-FS 5-way (1-shot) BAVARDAGE Accuracy 87.35 #7 of 38 Archive leaderboard report
Few-Shot Image Classification CIFAR-FS 5-way (5-shot) BAVARDAGE Accuracy 90.63 #9 of 39 Archive leaderboard report
Few-Shot Image Classification CUB 200 5-way 1-shot BAVARDAGE Accuracy 90.42 #11 of 36 Archive leaderboard report
Few-Shot Image Classification CUB 200 5-way 5-shot BAVARDAGE Accuracy 93.50 #10 of 32 Archive leaderboard report
Few-Shot Image Classification Dirichlet CUB-200 (5-way, 1-shot) BAVARDAGE 1:1 Accuracy 82.0 #1 of 8 Archive leaderboard report
Few-Shot Image Classification Dirichlet CUB-200 (5-way, 5-shot) BAVARDAGE 1:1 Accuracy 90.7 #1 of 8 Archive leaderboard report
Few-Shot Image Classification Dirichlet Mini-Imagenet (5-way, 1-shot) BAVARDAGE 1:1 Accuracy 71.0 #1 of 12 Archive leaderboard report
Few-Shot Image Classification Dirichlet Mini-Imagenet (5-way, 5-shot) BAVARDAGE 1:1 Accuracy 83.6 #1 of 12 Archive leaderboard report
Few-Shot Image Classification Dirichlet Tiered-Imagenet (5-way, 1-shot) BAVARDAGE 1:1 Accuracy 76.6 #1 of 9 Archive leaderboard report
Few-Shot Image Classification Dirichlet Tiered-Imagenet (5-way, 5-shot) BAVARDAGE 1:1 Accuracy 86.5 #2 of 9 Archive leaderboard report
Few-Shot Image Classification FC100 5-way (1-shot) BAVARDAGE Accuracy 57.27 #1 of 22 Archive leaderboard report
Few-Shot Image Classification FC100 5-way (5-shot) BAVARDAGE Accuracy 70.60 #1 of 22 Archive leaderboard report
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) BAVARDAGE Accuracy 84.80 #9 of 105 Archive leaderboard report
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) BAVARDAGE Accuracy 91.65 #5 of 95 Archive leaderboard report
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) BAVARDAGE Accuracy 85.20 #5 of 49 Archive leaderboard report
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) BAVARDAGE Accuracy 90.41 #6 of 51 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections