Datasets › OmniBenchmark
OmniBenchmark
Omni-Realm Benchmark (OmniBenchmark) is a diverse (21 semantic realm-wise datasets) and concise (realm-wise datasets have no concepts overlapping) benchmark for evaluating pre-trained model generalization across semantic super-concepts/realms, e.g. across mammals to aircraft.
[ECCV2022]
Benchmarks archive 2025-07-28
All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.
| First row (archive order) | Paper | Code | ||||
|---|---|---|---|---|---|---|
| Image Classification | OmniBenchmark | NOAH-ViTB/16 Average Top-1 Accuracy 47.6 | Neural Prompt Search | ZhangYuanhan-AI/NOAH | 22 | Compare |
Papers archive 2025-07-28
21 shown of 21 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 29. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.
| Date | Samples run Syntology | |||
|---|---|---|---|---|
| Neural Prompt Search | 1 | 1 | 9 Jun 2022 | ran 6 of 9 samples (3 unverified) |
| Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy | 2 | 1 | 15 Mar 2022 | ran 3 of 3 samples (0 unverified; 3 pointer-only for licence) |
| Masked Autoencoders Are Scalable Vision Learners | 58 | 1 | 11 Nov 2021 | ran 71 of 137 samples (66 unverified; 73 pointer-only for licence) |
| BEiT: BERT Pre-Training of Image Transformers | 14 | 1 | 15 Jun 2021 | ran 6 of 11 samples (5 unverified) |
| MLP-Mixer: An all-MLP Architecture for Vision | 49 | 1 | 4 May 2021 | ran 106 of 134 samples (28 unverified; 36 pointer-only for licence) |
| Emerging Properties in Self-Supervised Vision Transformers | 32 | 1 | 29 Apr 2021 | ran 5 of 20 samples (15 unverified; 2 pointer-only for licence) |
| Swin Transformer: Hierarchical Vision Transformer using Shifted Windows | 80 | 1 | 25 Mar 2021 | ran 108 of 207 samples (99 unverified; 43 pointer-only for licence) |
| Learning Transferable Visual Models From Natural Language Supervision | 82 | 1 | 26 Feb 2021 | ran 16 of 20 samples (4 unverified; 16 pointer-only for licence) |
| Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels | 2 | 1 | 13 Jan 2021 | not harvested |
| MoPro: Webly Supervised Learning with Momentum Prototypes | 2 | 1 | 17 Sep 2020 | ran 0 of 1 samples (1 unverified; 1 pointer-only for licence) |
| MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks | 1 | 1 | 17 Sep 2020 | not harvested |
| Unsupervised Learning of Visual Features by Contrasting Cluster Assignments | 18 | 1 | 17 Jun 2020 | ran 13 of 17 samples (4 unverified; 6 pointer-only for licence) |
| Big Transfer (BiT): General Visual Representation Learning | 9 | 1 | 24 Dec 2019 | ran 3 of 10 samples (7 unverified) |
| Momentum Contrast for Unsupervised Visual Representation Learning | 44 | 1 | 13 Nov 2019 | ran 26 of 42 samples (16 unverified; 16 pointer-only for licence) |
| EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks | 144 | 1 | 28 May 2019 | ran 171 of 302 samples (131 unverified; 112 pointer-only for licence) |
| CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features | 30 | 1 | 13 May 2019 | ran 17 of 24 samples (7 unverified; 5 pointer-only for licence) |
| Billion-scale semi-supervised learning for image classification | 4 | 1 | 2 May 2019 | not harvested |
| Parameter-Efficient Transfer Learning for NLP | 17 | 1 | 2 Feb 2019 | ran 8 of 22 samples (14 unverified; 3 pointer-only for licence) |
| Manifold Mixup: Better Representations by Interpolating Hidden States | 12 | 1 | 13 Jun 2018 | ran 2 of 11 samples (9 unverified; 5 pointer-only for licence) |
| Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning | 87 | 1 | 23 Feb 2016 | ran 1 of 1 samples (0 unverified) |
| Deep Residual Learning for Image Recognition | 484 | 2 | 10 Dec 2015 | ran 230 of 377 samples (147 unverified; 187 pointer-only for licence) |
Dataset loaders archive 2025-07-28
1 loader as listed in the archive; links are outbound and not re-checked here.
Tasks archive 2025-07-28
License archive 2025-07-28
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
Modalities archive 2025-07-28
Languages archive 2025-07-28
Variants archive 2025-07-28
- OmniBenchmark
1 variant name, as the archive lists them.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections