Papers › Masksembles for Uncertainty Estimation

Masksembles for Uncertainty Estimation

15 Dec 2020CVPR 2021 1arXiv:2012.08334archive 2025-07-28

Nikita Durasov, Timur Bagautdinov, Pierre Baque, Pascal Fua

Deep neural networks have amply demonstrated their prowess but estimating the reliability of their predictions remains challenging. Deep Ensembles are widely considered as being one of the best methods for generating uncertainty estimates but are very expensive to train and evaluate. MC-Dropout is another popular alternative, which is less expensive, but also less reliable. Our central intuition is that there is a continuous spectrum of ensemble-like models of which MC-Dropout and Deep Ensembles are extreme examples. The first uses an effectively infinite number of highly correlated models while the second relies on a finite number of independent models. To combine the benefits of both, we introduce Masksembles. Instead of randomly dropping parts of the network as in MC-dropout, Masksemble relies on a fixed number of binary masks, which are parameterized in a way that allows to change correlations between individual models. Namely, by controlling the overlap between the masks and their density one can choose the optimal configuration for the task at hand. This leads to a simple and easy to implement method with performance on par with Ensembles at a fraction of the cost. We experimentally validate Masksembles on two widely used datasets, CIFAR10 and ImageNet.

PaperPDFConference PDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

nikitadurasov/masksembles officialmentioned on GitHubpytorchSyntology: not harvested report
weizheliu/cross-domain-crowd-counting mentioned on GitHubpytorchSyntology: not harvested report
ensta-u2is/torch-uncertainty pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Training independent subnetworks for robust prediction (arXiv:2010.06610; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified), On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networks (arXiv:2203.09168; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified) and Tailoring Mixup to Data for Calibration (arXiv:2311.01434; that paper's own run record: 6 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
lightning-uq-box/lightning-uq-box pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Uncertainty Sets for Image Classifiers using Conformal Prediction (arXiv:2009.14193; that paper's own run record: 26 ran (of which 1 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 0 violated, 9 with no contract checked; 13 where Syntology's instrument failed) · 37 unverified), ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inference (arXiv:2211.11435; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified) and Variational Bayesian Last Layers (arXiv:2404.11599; that paper's own run record: 11 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 3 honoured, 1 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Classifier calibrationEnsemble LearningOut-of-Distribution DetectionRobust classificationUncertainty Quantification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Deep EnsemblesMonte Carlo Dropout

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections