Papers › Uncertainty Estimations by Softplus normalization in Bayesian Convolutional Neural...

Uncertainty Estimations by Softplus normalization in Bayesian Convolutional Neural Networks with Variational Inference

15 Jun 2018arXiv:1806.05978archive 2025-07-28

Kumar Shridhar, Felix Laumann, Marcus Liwicki

We introduce a novel uncertainty estimation for classification tasks for Bayesian convolutional neural networks with variational inference. By normalizing the output of a Softplus function in the final layer, we estimate aleatoric and epistemic uncertainty in a coherent manner. The intractable posterior probability distributions over weights are inferred by Bayes by Backprop. Firstly, we demonstrate how this reliable variational inference method can serve as a fundamental construct for various network architectures. On multiple datasets in supervised learning settings (MNIST, CIFAR-10, CIFAR-100), this variational inference method achieves performances equivalent to frequentist inference in identical architectures, while the two desiderata, a measure for uncertainty and regularization are incorporated naturally. Secondly, we examine how our proposed measure for aleatoric and epistemic uncertainties is derived and validate it on the aforementioned datasets.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Anou9531/Bayesian-CNN mentioned on GitHubpytorchMIT report
kumar-shridhar/BayesianConvNet mentioned on GitHubpytorchMIT report
kumar-shridhar/PyTorch-BayesianCNN mentioned on GitHubpytorchMIT report
liqichen6688/baycnn mentioned on GitHubpytorch report
nomercy77/Implementing-Bayesian-CNN mentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Bayesian InferenceGeneral ClassificationVariational Inference

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections