Papers › Uncertainty Estimations by Softplus normalization in Bayesian Convolutional Neural...

Uncertainty Estimations by Softplus normalization in Bayesian Convolutional Neural Networks with Variational Inference

15 Jun 2018arXiv:1806.05978archive 2025-07-28

Kumar Shridhar, Felix Laumann, Marcus Liwicki

We introduce a novel uncertainty estimation for classification tasks for Bayesian convolutional neural networks with variational inference. By normalizing the output of a Softplus function in the final layer, we estimate aleatoric and epistemic uncertainty in a coherent manner. The intractable posterior probability distributions over weights are inferred by Bayes by Backprop. Firstly, we demonstrate how this reliable variational inference method can serve as a fundamental construct for various network architectures. On multiple datasets in supervised learning settings (MNIST, CIFAR-10, CIFAR-100), this variational inference method achieves performances equivalent to frequentist inference in identical architectures, while the two desiderata, a measure for uncertainty and regularization are incorporated naturally. Secondly, we examine how our proposed measure for aleatoric and epistemic uncertainties is derived and validate it on the aforementioned datasets.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Anou9531/Bayesian-CNN mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to A Comprehensive guide to Bayesian Convolutional Neural Network with Variational Inference (arXiv:1901.02731; that paper's own run record: 14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
kumar-shridhar/BayesianConvNet mentioned on GitHubpytorchMITSyntology: not harvested report
kumar-shridhar/PyTorch-BayesianCNN mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to A Comprehensive guide to Bayesian Convolutional Neural Network with Variational Inference (arXiv:1901.02731; that paper's own run record: 14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
liqichen6688/baycnn mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Weight Uncertainty in Neural Networks (arXiv:1505.05424; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 4 honoured, 1 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
nomercy77/Implementing-Bayesian-CNN mentioned on GitHubpytorchSyntology: not harvested report
MindSpore-scientific-2/code-1 mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Pareto Invariant Risk Minimization: Towards Mitigating the Optimization Dilemma in... (arXiv:2206.07766; that paper's own run record: 6 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified); nothing checks that they implement this paper's method. report
MindSpore-scientific-2/code-11 mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddings (arXiv:2408.14512; that paper's own run record: 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
MindSpore-scientific-2/code-2 mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddings (arXiv:2408.14512; that paper's own run record: 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
MindSpore-scientific-2/code-8 mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to LP-MusicCaps: LLM-Based Pseudo Music Captioning (arXiv:2307.16372; that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Bayesian InferenceGeneral ClassificationVariational Inference

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections