Papers › MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space

5 May 2021CVPR 2021 1arXiv:2105.01879archive 2025-07-28

Rui Huang, Yixuan Li

Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world. Existing solutions are mainly driven by small datasets, with low resolution and very few class labels (e.g., CIFAR). As a result, OOD detection for large-scale image classification tasks remains largely unexplored. In this paper, we bridge this critical gap by proposing a group-based OOD detection framework, along with a novel OOD scoring function termed MOS. Our key idea is to decompose the large semantic space into smaller groups with similar concepts, which allows simplifying the decision boundaries between in- vs. out-of-distribution data for effective OOD detection. Our method scales substantially better for high-dimensional class space than previous approaches. We evaluate models trained on ImageNet against four carefully curated OOD datasets, spanning diverse semantics. MOS establishes state-of-the-art performance, reducing the average FPR95 by 14.33% while achieving 6x speedup in inference compared to the previous best method.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2105.01879")

Code

Syntology Ran 3 of 4 code samples harvested from 4 repositories linked to this paper; 1 has no recorded run. Of those that ran: 2 ran · our draft was wrong; 1 ran · fixture could not drive it.

By repository: official repository: 1 sample from 1 repository, 1 ran; community (archive-listed): 3 samples from 3 repositories, 2 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

deeplearning-wisc/large_scale_ood officialmentioned in papermentioned on GitHubpytorch report
deeplearning-wisc/gradnorm_ood mentioned on GitHubpytorch report
ma-kjh/CMA-OoDD mentioned on GitHubpytorch report
tmlr-group/class_prior mentioned on GitHubpytorch report
tmlr-group/neglabel mentioned on GitHubpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

4 samples harvested; 3 ran; 0 honoured the contract we drafted; 1 has no recorded run. Read from Syntology's graph 2026-09-25; that is when this build read the record, not when the samples ran.

2ran · our draft was wrong
1ran · fixture could not drive it
1unverified

Licence: 1 of the 4 samples is pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 4 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

calc_group_softmax_loss deeplearning-wisc/large_scale_ood/finetune.py official repository ran · our draft was wrong Apache-2.0 (permissive) · 1caff2f8b8fc899d · report
get_Mahalanobis_score deeplearning-wisc/gradnorm_ood/utils/mahalanobis_lib.py community (archive-listed) ran · our draft was wrong Apache-2.0 (permissive) · ae64ecb508b5b2bb · report
iterate_data_mahalanobis tmlr-group/class_prior/funcs.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · 12fc2270fe050752 · report
CLIP ma-kjh/CMA-OoDD/clip/model.py community (archive-listed) unverified no licence file found · pointer only · ef2d645ece6b584c · report

Tasks

Image ClassificationOut-of-Distribution Detectionimage-classification

Datasets

Introduced by this paper, per the archive.

ImageNet-1k vs PlacesImageNet-1k vs SUNImageNet-1k vs TexturesImageNet-1k vs iNaturalist

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Out-of-Distribution Detection ImageNet-1k vs Curated OODs (avg.) MOS (BiT-S-R101x1) AUROC 90.11 #11 of 16 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Curated OODs (avg.) MOS (BiT-S-R101x1) FPR95 39.97 #11 of 16 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Places MOS (BiT-S-R101x1) AUROC 89.06 #14 of 25 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Places MOS (BiT-S-R101x1) FPR95 49.54 #14 of 25 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs SUN MOS (BiT-S-R101x1) AUROC 92.01 #11 of 22 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs SUN MOS (BiT-S-R101x1) FPR95 40.63 #11 of 22 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Textures MOS (BiT-S-R101x1) AUROC 81.23 #27 of 34 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs Textures MOS (BiT-S-R101x1) FPR95 60.43 #27 of 34 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs iNaturalist MOS (BiT-S-R101x1) AUROC 98.15 #7 of 28 Archive leaderboard report
Out-of-Distribution Detection ImageNet-1k vs iNaturalist MOS (BiT-S-R101x1) FPR95 9.28 #7 of 28 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections