Papers › Designing Network Design Spaces

Designing Network Design Spaces

30 Mar 2020CVPR 2020 6arXiv:2003.13678archive 2025-07-28

Ilija Radosavovic, Raj Prateek Kosaraju, Ross Girshick, Kaiming He, Piotr Dollár

In this work, we present a new network design paradigm. Our goal is to help advance the understanding of network design and discover design principles that generalize across settings. Instead of focusing on designing individual network instances, we design network design spaces that parametrize populations of networks. The overall process is analogous to classic manual design of networks, but elevated to the design space level. Using our methodology we explore the structure aspect of network design and arrive at a low-dimensional design space consisting of simple, regular networks that we call RegNet. The core insight of the RegNet parametrization is surprisingly simple: widths and depths of good networks can be explained by a quantized linear function. We analyze the RegNet design space and arrive at interesting findings that do not match the current practice of network design. The RegNet design space provides simple and fast networks that work well across a wide range of flop regimes. Under comparable training settings and flops, the RegNet models outperform the popular EfficientNet models while being up to 5x faster on GPUs.

PaperPDFConference PDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2003.13678")

Code

Syntology Ran 11 of 53 code samples harvested from 5 repositories linked to this paper; 42 have no recorded run. Of those that ran: 4 ran · honoured contract; 5 ran · our draft was wrong; 2 ran · fixture could not drive it.

By repository: community (archive-listed): 53 samples from 5 repositories, 11 ran. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

26 repositories listed; official and paper-mentioned ones first.

facebookresearch/pycls officialmentioned in papermentioned on GitHubpytorch report
Alessiacosmos/Basic-RegNet-pytorch mentioned on GitHubpytorchMIT report
Alessiacosmos/RegNet-pytorch mentioned on GitHubpytorchMIT report
Deci-AI/super-gradients mentioned on GitHubpytorch report
PaperCodeReview/RegNet-TF mentioned on GitHubtfMIT report
ZHANGHeng19931123/MutualGuide mentioned on GitHubpytorchMIT report
edificewang/imageclassification mentioned on GitHubpytorch report
facebookresearch/vissl mentioned on GitHubpytorch report
hsd1503/resnet1d mentioned on GitHubpytorch report
j3soon/arxiv-utils mentioned on GitHubMIT report
james77777778/keras-image-models mentioned on GitHubpytorchApache-2.0 report
osmr/imgclsmob mentioned on GitHubmxnetMIT report
rwightman/pytorch-image-models mentioned on GitHubpytorch report
tuggeluk/pycls mentioned on GitHubpytorch report
wilile26811249/RegNet mentioned on GitHubpytorchMIT report
yhhhli/regnet-pytorch mentioned on GitHubpytorchMIT report
PaddlePaddle/PaddleClas paddleApache-2.0 report
open-mmlab/mmdetection pytorchApache-2.0 report
open-mmlab/mmdetection3d pytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

53 samples harvested; 11 ran; 4 honoured the contract we drafted; 42 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

4ran · honoured contract
5ran · our draft was wrong
2ran · fixture could not drive it
42unverified

Licence: 0 of the 53 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 5 repositories linked to this paper, official or community; each sample names its own and says which. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

channel_shuffle ZHANGHeng19931123/MutualGuide/models/backbone/shufflenet_backbone.py community (archive-listed) ran · our draft was wrong fingerprinted MIT (permissive) · b9da06d4f527dd6c · report
conv1x1 ZHANGHeng19931123/MutualGuide/models/backbone/resnet_backbone.py community (archive-listed) ran · our draft was wrong MIT (permissive) · d9def42110729a85 · report
conv3x3 ZHANGHeng19931123/MutualGuide/models/backbone/resnet_backbone.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 160bb14bd76201b4 · report
conv_bn ZHANGHeng19931123/MutualGuide/models/backbone/repvgg_backbone.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 7186655759897af6 · report
get_lr wilile26811249/RegNet/utils.py community (archive-listed) ran · honoured contract MIT (permissive) · 7337f1f5ff01dcd0 · report
get_padding ZHANGHeng19931123/MutualGuide/models/backbone/gpunet_backbone.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 73876e077d3acdf5 · report
get_same_padding ZHANGHeng19931123/MutualGuide/models/backbone/gpunet_backbone.py community (archive-listed) ran · honoured contract fingerprinted MIT (permissive) · 54e11386110ff042 · report
round_repeats ZHANGHeng19931123/MutualGuide/models/backbone/efficientnet_backbone.py community (archive-listed) ran · honoured contract MIT (permissive) · f93cb693ac8bb537 · report
trunc_normal_ ZHANGHeng19931123/MutualGuide/models/backbone/swin_backbone.py community (archive-listed) ran · fixture could not drive it MIT (permissive) · af8aefa30bd76920 · report
window_partition ZHANGHeng19931123/MutualGuide/models/backbone/swin_backbone.py community (archive-listed) ran · fixture could not drive it fingerprinted MIT (permissive) · f6b2d702fc756d64 · report
window_reverse ZHANGHeng19931123/MutualGuide/models/backbone/swin_backbone.py community (archive-listed) ran · our draft was wrong MIT (permissive) · 7b0d02f75bf6b439 · report
BasicBlock PaperCodeReview/RegNet-TF/model/anynet.py community (archive-listed) unverified MIT (permissive) · 2f49808e608b8c96 · report
ResBlock PaperCodeReview/RegNet-TF/model/anynet.py community (archive-listed) unverified MIT (permissive) · 2fc21a3ff370f732 · report
ResBottleneckBlock PaperCodeReview/RegNet-TF/model/anynet.py community (archive-listed) unverified MIT (permissive) · e4fa2e354a4ccd53 · report
accuracy Alessiacosmos/Basic-RegNet-pytorch/utils/evalutator.py community (archive-listed) unverified MIT (permissive) · 26219ca9c20a331d · report
accuracy wilile26811249/RegNet/utils.py community (archive-listed) unverified MIT (permissive) · f04c9abd65570251 · report
adjust_ws_gs_comp yhhhli/regnet-pytorch/CIFAR10/models/regnet.py community (archive-listed) unverified MIT (permissive) · 776c7e0f77f8b8e1 · report
build_training_folder Alessiacosmos/Basic-RegNet-pytorch/utils/log_output.py community (archive-listed) unverified MIT (permissive) · c804dfc430391ebb · report
callback_checkpoint PaperCodeReview/RegNet-TF/callback.py community (archive-listed) unverified MIT (permissive) · f3b3cc6d74abcfcb · report
callback_epochlogger PaperCodeReview/RegNet-TF/callback.py community (archive-listed) unverified MIT (permissive) · 300864db1e3cdd90 · report
callback_tensorboard PaperCodeReview/RegNet-TF/callback.py community (archive-listed) unverified MIT (permissive) · a937bb237ee86019 · report
check_arguments PaperCodeReview/RegNet-TF/common.py community (archive-listed) unverified MIT (permissive) · 129adedbc3f353c4 · report
check_overlap PaperCodeReview/RegNet-TF/search_space.py community (archive-listed) unverified MIT (permissive) · 733d2079c07e80b7 · report
color_norm Alessiacosmos/Basic-RegNet-pytorch/utils/transform.py community (archive-listed) unverified MIT (permissive) · 4f00c5e336d1fab1 · report
complexity_batchnorm2d PaperCodeReview/RegNet-TF/model/complexity.py community (archive-listed) unverified MIT (permissive) · 3b4634faa337b07b · report
complexity_conv2d PaperCodeReview/RegNet-TF/model/complexity.py community (archive-listed) unverified MIT (permissive) · a2c61cf1be6f496a · report
complexity_maxpool2d PaperCodeReview/RegNet-TF/model/complexity.py community (archive-listed) unverified MIT (permissive) · a7c0f04b031c05be · report
create_act_layer ZHANGHeng19931123/MutualGuide/models/backbone/gpunet_backbone.py community (archive-listed) unverified MIT (permissive) · c0ebab789418c9e4 · report
drop_connect ZHANGHeng19931123/MutualGuide/models/backbone/efficientnet_backbone.py community (archive-listed) unverified MIT (permissive) · 45eada2b88e70500 · report
generate_regenet_arch wilile26811249/RegNet/models/Regnet.py community (archive-listed) unverified MIT (permissive) · 9ae24bb873bceeb8 · report
get_cifar10_dataset wilile26811249/RegNet/utils.py community (archive-listed) unverified MIT (permissive) · ba1d6e8ebcd04bd9 · report
get_log_filename Alessiacosmos/Basic-RegNet-pytorch/utils/log_output.py community (archive-listed) unverified MIT (permissive) · 984a028631f19887 · report
get_logger PaperCodeReview/RegNet-TF/common.py community (archive-listed) unverified MIT (permissive) · e9cdcc13fe49820c · report
get_mean_and_std Alessiacosmos/Basic-RegNet-pytorch/utils/dataset.py community (archive-listed) unverified MIT (permissive) · d2c4ab4309330f86 · report
get_stages_from_blocks yhhhli/regnet-pytorch/CIFAR10/models/regnet.py community (archive-listed) unverified MIT (permissive) · cf37365adf0e1e42 · report
get_test_log_filename Alessiacosmos/Basic-RegNet-pytorch/utils/log_output.py community (archive-listed) unverified MIT (permissive) · 71ed90ac72db0a23 · report
horizontal_flip Alessiacosmos/Basic-RegNet-pytorch/utils/transform.py community (archive-listed) unverified MIT (permissive) · d401541fae28c8df · report
load_cfg Alessiacosmos/Basic-RegNet-pytorch/utils/parse_cfg.py community (archive-listed) unverified MIT (permissive) · de7df4cd7f7cb239 · report
load_checkpoint Alessiacosmos/Basic-RegNet-pytorch/utils/checkpoint.py community (archive-listed) unverified MIT (permissive) · 0fe8c6f466ab4c72 · report
load_image Alessiacosmos/Basic-RegNet-pytorch/utils/dataset.py community (archive-listed) unverified MIT (permissive) · 086239779f8ee4d5 · report
lr_policy_cos Alessiacosmos/Basic-RegNet-pytorch/utils/lr_policy.py community (archive-listed) unverified MIT (permissive) · 4cc9b1db1b0d55b6 · report
lr_policy_exp Alessiacosmos/Basic-RegNet-pytorch/utils/lr_policy.py community (archive-listed) unverified MIT (permissive) · d37a1ce2bc6180e6 · report
lr_policy_steps Alessiacosmos/Basic-RegNet-pytorch/utils/lr_policy.py community (archive-listed) unverified MIT (permissive) · cb66896e95a24c22 · report
multibox ZHANGHeng19931123/MutualGuide/models/detector.py community (archive-listed) unverified MIT (permissive) · 11d3877a0ccf3ee3 · report
quantize_float yhhhli/regnet-pytorch/CIFAR10/models/regnet.py community (archive-listed) unverified MIT (permissive) · a7f56f01db1812a0 · report
round_filters ZHANGHeng19931123/MutualGuide/models/backbone/efficientnet_backbone.py community (archive-listed) unverified MIT (permissive) · fea14f1f6c2644bf · report
save_checkpoint Alessiacosmos/Basic-RegNet-pytorch/utils/checkpoint.py community (archive-listed) unverified MIT (permissive) · a0cc9cf5cccaf75a · report
search_same PaperCodeReview/RegNet-TF/common.py community (archive-listed) unverified MIT (permissive) · 4d3ce1e2a3d645cb · report
select_config PaperCodeReview/RegNet-TF/search_space.py community (archive-listed) unverified MIT (permissive) · 113ee8ba2c42d3b4 · report
set_dataset PaperCodeReview/RegNet-TF/dataloader.py community (archive-listed) unverified MIT (permissive) · efceaef7f38bd7b9 · report
topk_correct Alessiacosmos/Basic-RegNet-pytorch/utils/evalutator.py community (archive-listed) unverified MIT (permissive) · 524aef024eb6924a · report
topk_error Alessiacosmos/Basic-RegNet-pytorch/utils/evalutator.py community (archive-listed) unverified MIT (permissive) · 58f32cb0086a5fbf · report
zero_pad Alessiacosmos/Basic-RegNet-pytorch/utils/transform.py community (archive-listed) unverified MIT (permissive) · 94d1acf6801b9a00 · report

Tasks

Image ClassificationOut-of-Distribution Generalization

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification ImageNet RegNetY-8.0GF GFLOPs 8 #730 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-8.0GF Number of params 39.2M #730 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-8.0GF Top 1 Accuracy 79.9% #730 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-4.0GF GFLOPs 4 #761 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-4.0GF Number of params 20.6M #761 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-4.0GF Top 1 Accuracy 79.4% #761 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-1.6GF GFLOPs 1.6 #856 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-1.6GF Number of params 11.2M #856 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-1.6GF Top 1 Accuracy 78% #856 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-800MF GFLOPs 0.8 #918 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-800MF Number of params 6.3M #918 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-800MF Top 1 Accuracy 76.3% #918 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-600MF GFLOPs 0.6 #947 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-600MF Number of params 6.1M #947 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-600MF Top 1 Accuracy 75.5% #947 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-400MF GFLOPs 0.4 #979 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-400MF Number of params 4.3M #979 of 1060 Archive leaderboard report
Image Classification ImageNet RegNetY-400MF Top 1 Accuracy 74.1% #979 of 1060 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: RegNetX, RegNetY

1x1 ConvolutionBatch NormalizationConvolutionCosine AnnealingDense ConnectionsGlobal Average PoolingGrouped ConvolutionReLURegNetXRegNetYSGD with MomentumSigmoid ActivationSqueeze-and-Excitation BlockWeight Decay

1 archive method tag without a method page not shown.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections