Datasets › NATS-Bench

NATS-Bench

Introduced by Xuanyi Dong et al. in NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size archive 2025-07-28

A unified benchmark on searching for both topology and size, for (almost) any up-to-date NAS algorithm. NATS-Bench includes the search space of 15,625 neural cell candidates for architecture topology and 32,768 for architecture size on three datasets.

Source: NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size

Benchmarks archive 2025-07-28

All 5 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Neural Architecture Search NATS-Bench Topology, ImageNet16-120 LayerNAS Test Accuracy 46.58±0.59 LayerNAS: Neural Architecture Search in Polynomial Complexity — 11 Compare
Neural Architecture Search NATS-Bench Topology, CIFAR-10 LayerNAS Test Accuracy 94.34±0.12 LayerNAS: Neural Architecture Search in Polynomial Complexity — 11 Compare
Neural Architecture Search NATS-Bench Topology, CIFAR-100 LayerNAS Test Accuracy 73.01±0.63 LayerNAS: Neural Architecture Search in Polynomial Complexity — 11 Compare
Neural Architecture Search NATS-Bench Size, CIFAR-100 GreenMachine-2 Kendall's Tau 0.769 GreenMachine: Automatic Design of Zero-Cost Proxies for... RodriguesGabriel/greenmachine 5 Compare
Neural Architecture Search NATS-Bench Size, ImageNet16-120 GreenMachine-2 Kendall's Tau 0.856 GreenMachine: Automatic Design of Zero-Cost Proxies for... RodriguesGabriel/greenmachine 4 Compare

Papers archive 2025-07-28

10 shown of 10 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 43. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
GreenMachine: Automatic Design of Zero-Cost Proxies for Energy-Efficient NAS 1 15 22 Nov 2024 not harvested
LayerNAS: Neural Architecture Search in Polynomial Complexity 0 5 23 Apr 2023 not harvested
Generalization Properties of NAS under Activation and Skip Connection Search 0 3 15 Sep 2022 not harvested
KNAS: Green Neural Architecture Search 1 3 26 Nov 2021 ran 6 of 7 samples (1 unverified)
NASI: Label- and Data-agnostic Neural Architecture Search at Initialization 0 3 2 Sep 2021 not harvested
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search 1 1 23 Mar 2021 not harvested
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective 4 3 23 Feb 2021 ran 2 of 4 samples (2 unverified; 2 pointer-only for licence)
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search 2 3 3 Jul 2019 not harvested
Regularized Evolution for Image Classifier Architecture Search 5 3 5 Feb 2018 not harvested
Proximal Policy Optimization Algorithms 188 3 20 Jul 2017 ran 99 of 176 samples (77 unverified; 94 pointer-only for licence)

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • NATS-Bench Topology, ImageNet16-120
  • NATS-Bench Topology, CIFAR-100
  • NATS-Bench Topology, CIFAR-10
  • NATS-Bench Size, ImageNet16-120
  • NATS-Bench Size
  • NATS-Bench Size, CIFAR-100
  • NATS-Bench Size, CIFAR-10
  • NATS-Bench

8 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections