Papers › SHOT-VAE: Semi-supervised Deep Generative Models With Label-aware ELBO Approximations

SHOT-VAE: Semi-supervised Deep Generative Models With Label-aware ELBO Approximations

21 Nov 2020arXiv:2011.10684archive 2025-07-28

Hao-Zhe Feng, Kezhi Kong, Minghao Chen, Tianye Zhang, Minfeng Zhu, Wei Chen

Semi-supervised variational autoencoders (VAEs) have obtained strong results, but have also encountered the challenge that good ELBO values do not always imply accurate inference results. In this paper, we investigate and propose two causes of this problem: (1) The ELBO objective cannot utilize the label information directly. (2) A bottleneck value exists and continuing to optimize ELBO after this value will not improve inference accuracy. On the basis of the experiment results, we propose SHOT-VAE to address these problems without introducing additional prior knowledge. The SHOT-VAE offers two contributions: (1) A new ELBO approximation named smooth-ELBO that integrates the label predictive loss into ELBO. (2) An approximation based on optimal interpolation that breaks the ELBO value bottleneck by reducing the margin between ELBO and the data likelihood. The SHOT-VAE achieves good performance with a 25.30% error rate on CIFAR-100 with 10k labels and reduces the error rate to 6.11% on CIFAR-10 with 4k labels.

PaperPDFCode

Code

PaperCodeSubmission/AAAI2021-260 officialmentioned in papermentioned on GitHubpytorch report
FengHZ/AAAI2021-260 mentioned on GitHubpytorch report
PaperCodeSubmission/OSPOT-VAE mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

4kSemi-Supervised Image ClassificationVariational Inference

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Semi-Supervised Image Classification CIFAR-10, 4000 Labels SHOT-VAE Percentage error 6.11 #29 of 49 Archive leaderboard report
Semi-Supervised Image Classification cifar-100, 10000 Labels SHOT-VAE Percentage error 25.3 #22 of 29 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

MixupStochastic Gradient Variational Bayes

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections