Papers › ResNeSt: Split-Attention Networks

ResNeSt: Split-Attention Networks

19 Apr 2020arXiv:2004.08955archive 2025-07-28

Hang Zhang, Chongruo wu, Zhongyue Zhang, Yi Zhu, Haibin Lin, Zhi Zhang, Yue Sun, Tong He, Jonas Mueller, R. Manmatha, Mu Li, Alexander Smola

It is well known that featuremap attention and multi-path representation are important for visual recognition. In this paper, we present a modularized architecture, which applies the channel-wise attention on different network branches to leverage their success in capturing cross-feature interactions and learning diverse representations. Our design results in a simple and unified computation block, which can be parameterized using only a few variables. Our model, named ResNeSt, outperforms EfficientNet in accuracy and latency trade-off on image classification. In addition, ResNeSt has achieved superior transfer learning results on several public benchmarks serving as the backbone, and has been adopted by the winning entries of COCO-LVIS challenge. The source code for complete system and pretrained models are publicly available.

PaperPDFCodeCode Syntology ran

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, Syntology's MCP tool lists every function and class Syntology harvested from this paper and whether it ran (how to connect): get_harvested_code_for_paper(arxiv_id="2004.08955")

Code

Syntology Ran 8 of 48 code samples harvested from 9 repositories linked to this paper; 40 have no recorded run. Of those that ran: 2 ran · our draft was wrong; 1 ran · fixture could not drive it; 5 ran with no contract checked.

By repository: official repository: 6 samples from 1 repository, 0 ran; community (archive-listed): 41 samples from 8 repositories, 8 ran; 1 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

36 repositories listed; official and paper-mentioned ones first.

zhanghang1989/ResNeSt officialmentioned in papermentioned on GitHubpytorchApache-2.0 report
AnudeepKonda/MIMII_anamoly_detection mentioned on GitHubpytorch report
Burf/ResNeSt-Tensorflow2 mentioned on GitHubtfMIT report
ChengWeiGu/ResNeSt-Pytorch mentioned on GitHubpytorch report
He-jerry/DSSNet mentioned on GitHubpytorch report
RobertHong1992/Resnest mentioned on GitHubpytorch report
STomoya/ResNeSt mentioned on GitHubpytorchApache-2.0 report
YeongHyeon/ResNeSt-TF2 mentioned on GitHubtfMIT report
Yuxiang1995/ICDAR2021_MFD mentioned on GitHubpytorchApache-2.0 report
ZJCV/ZCls mentioned on GitHubpytorch report
chongruo/detectron2-resnest mentioned on GitHubpytorchApache-2.0 report
ferna11i/detectron2_ResNeST mentioned on GitHubpytorchApache-2.0 report
mohitktanwr/Deep-Stem-ResNeSt-ISPRS mentioned on GitHubpytorchApache-2.0 report
mohitktanwr/ResNeSt_Inverse mentioned on GitHubpytorchApache-2.0 report
osmr/imgclsmob mentioned on GitHubmxnetMIT report
rwightman/pytorch-image-models mentioned on GitHubpytorch report
sailfish009/detectron2-ResNeSt mentioned on GitHubpytorchApache-2.0 report
shellhue/detectron2-ResNeSt mentioned on GitHubpytorchApache-2.0 report
thepooons/melanoma-comp-2020 mentioned on GitHubpytorch report
zhanghang1989/PyTorch-Encoding mentioned on GitHubpytorch report
zhanghang1989/detectron2-ResNeSt mentioned on GitHubpytorchApache-2.0 report
PaddlePaddle/PaddleClas paddleApache-2.0 report
dmlc/gluon-cv tfApache-2.0 report
open-mmlab/mmdetection pytorchApache-2.0 report
open-mmlab/mmpose pytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

48 samples harvested; 8 ran; 0 honoured the contract we drafted; 40 have no recorded run. Read from Syntology's graph 2026-09-24; that is when this build read the record, not when the samples ran.

2ran · our draft was wrong
1ran · fixture could not drive it
5ran
40unverified

Licence: 23 of the 48 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 9 repositories linked to this paper, official or community; each sample names its own and says which. Some samples are identical code Syntology first harvested from another repository; for those, this paper's copy is not located and its licence is not recorded. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “fixture could not drive it” are failures of Syntology's instrument, not of the code.

Each sample ends with its code_sha256, Syntology's identity for that exact code. An agent fetches the stored sample with Syntology's MCP tool get_code(code_sha256="…") (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples from a repository marked official are listed first. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of four reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; or the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar). Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

check_sha1 zhanghang1989/ResNeSt/resnest/utils.py official repository unverified Apache-2.0 (permissive) · 3ee0c4bb32b3b945 · report
download zhanghang1989/ResNeSt/resnest/utils.py official repository unverified Apache-2.0 (permissive) · eb12eb65d87b258c · report
get_model_file zhanghang1989/ResNeSt/resnest/gluon/model_store.py official repository unverified Apache-2.0 (permissive) · 1ef6246b268a5705 · report
make_stage zhanghang1989/ResNeSt/resnest/d2/resnest.py official repository unverified Apache-2.0 (permissive) · 7e206a38c0ece70d · report
short_hash zhanghang1989/ResNeSt/resnest/gluon/model_store.py official repository unverified Apache-2.0 (permissive) · b06092cd4eb27a10 · report
unzip zhanghang1989/ResNeSt/resnest/utils.py official repository unverified Apache-2.0 (permissive) · 79a96a9c7fd65ce5 · report
load_pkl_data ChengWeiGu/ResNeSt-Pytorch/train_resneSt.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 116a44af0a09b23d · report
batched_nms chongruo/detectron2-resnest/detectron2/layers/nms.py community (archive-listed) ran Apache-2.0 recorded; this copy not marked cleared · pointer only · 0df9d3b583fbc6cb · report
cat chongruo/detectron2-resnest/detectron2/layers/wrappers.py community (archive-listed) ran · fixture could not drive it Apache-2.0 recorded; this copy not marked cleared · pointer only · 6cbf46794989b731 · report
convert_basic_c2_names chongruo/detectron2-resnest/detectron2/checkpoint/c2_model_loading.py community (archive-listed) ran Apache-2.0 recorded; this copy not marked cleared · pointer only · e8526a516b4f9206 · report
convert_c2_detectron_names chongruo/detectron2-resnest/detectron2/checkpoint/c2_model_loading.py community (archive-listed) ran Apache-2.0 recorded; this copy not marked cleared · pointer only · 52810b504f0d1066 · report
pad_masks chongruo/detectron2-resnest/detectron2/layers/mask_ops.py community (archive-listed) ran fingerprinted Apache-2.0 recorded; this copy not marked cleared · pointer only · 406f84cf799ed34d · report
paste_mask_in_image_old chongruo/detectron2-resnest/detectron2/layers/mask_ops.py community (archive-listed) ran Apache-2.0 recorded; this copy not marked cleared · pointer only · d03592674030077f · report
short_hash RobertHong1992/Resnest/core/resnest.py community (archive-listed) ran · our draft was wrong no licence file found · pointer only · 979123ace229d553 · report
ResNet Burf/ResNeSt-Tensorflow2/resnest/resnet.py community (archive-listed) unverified MIT (permissive) · 8209cb3497010910 · report
batched_nms ferna11i/detectron2_ResNeST/detectron2/layers/nms.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · a608182a325f07f7 · report
batched_nms_rotated ferna11i/detectron2_ResNeST/detectron2/layers/nms.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 65735d51d64903a4 · report
batched_nms_rotated chongruo/detectron2-resnest/detectron2/layers/nms.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 4845964b76bba6c5 · report
calc_block_num_params osmr/imgclsmob/gluon/model_stats.py community (archive-listed) unverified MIT (permissive) · 1e94f0e5aae421b2 · report
calc_block_num_params2 osmr/imgclsmob/gluon/model_stats.py community (archive-listed) unverified MIT (permissive) · 45160e9713d39dfa · report
calc_sha1 osmr/imgclsmob/prep_model.py community (archive-listed) unverified MIT (permissive) · 413e0014f62a9efc · report
cat ferna11i/detectron2_ResNeST/detectron2/layers/wrappers.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 7664e656f28eeecc · report
change_output_layers ChengWeiGu/ResNeSt-Pytorch/train_resneSt.py community (archive-listed) unverified no licence file found · pointer only · b74fa21880286e7a · report
convert_pt2pt osmr/imgclsmob/convert_models.py community (archive-listed) unverified MIT (permissive) · cce15073ab760551 · report
get_checkpoint_url chongruo/detectron2-resnest/detectron2/model_zoo/model_zoo.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 22f71a6d1391bbe3 · report
get_config_file chongruo/detectron2-resnest/detectron2/model_zoo/model_zoo.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 10d4b4b249a78f42 · report
get_model_file mohitktanwr/Deep-Stem-ResNeSt-ISPRS/resnest/gluon/model_store.py community (archive-listed) unverified Apache-2.0 (permissive) · 2cd24f5ed4aae254 · report
group_conv Burf/ResNeSt-Tensorflow2/resnest/splat.py community (archive-listed) unverified MIT (permissive) · 21a473c9ae1aa4ca · report
interpolate chongruo/detectron2-resnest/detectron2/layers/wrappers.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · e3055ddd5ac36b0b · report
load_weight Burf/ResNeSt-Tensorflow2/resnest/resnest.py community (archive-listed) unverified MIT (permissive) · aea5d02e03df9b82 · report
nms_rotated chongruo/detectron2-resnest/detectron2/layers/nms.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · d3fa37a000ad294d · report
nonzero_tuple ferna11i/detectron2_ResNeST/detectron2/layers/wrappers.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · eb03e701fa2c3245 · report
paste_masks_in_image ferna11i/detectron2_ResNeST/detectron2/layers/mask_ops.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 5837267fa2aed31c · report
paste_masks_in_image chongruo/detectron2-resnest/detectron2/layers/mask_ops.py community (archive-listed) unverified Apache-2.0 recorded; this copy not marked cleared · pointer only · 13b3f33534eea02a · report
post_process osmr/imgclsmob/prep_model.py community (archive-listed) unverified MIT (permissive) · 8f535a7e6722bc55 · report
prepare_dst_model osmr/imgclsmob/convert_models.py community (archive-listed) unverified MIT (permissive) · 16e0587d2f35fcdf · report
prepare_src_model osmr/imgclsmob/convert_models.py community (archive-listed) unverified MIT (permissive) · df0046e7135787f9 · report
resnest101 RobertHong1992/Resnest/core/resnest.py community (archive-listed) unverified no licence file found · pointer only · ab6e7a32f07c96d1 · report
resnest101 zhanghang1989/PyTorch-Encoding/encoding/models/backbone/resnest.py community (archive-listed) unverified MIT (permissive) · 7b2de4494236346e · report
resnest200 zhanghang1989/PyTorch-Encoding/encoding/models/backbone/resnest.py community (archive-listed) unverified MIT (permissive) · e9769d275b2aeaab · report
resnest50 RobertHong1992/Resnest/core/resnest.py community (archive-listed) unverified no licence file found · pointer only · d78c4213925c9d95 · report
resnest50 zhanghang1989/PyTorch-Encoding/encoding/models/backbone/resnest.py community (archive-listed) unverified MIT (permissive) · 6b650e26ef7115fd · report
resnest50 Burf/ResNeSt-Tensorflow2/resnest/resnest.py community (archive-listed) unverified MIT (permissive) · b55f89f2f2fe736d · report
resnest_block Burf/ResNeSt-Tensorflow2/resnest/resnet.py community (archive-listed) unverified MIT (permissive) · 2196103dc7afecbd · report
resnest_module Burf/ResNeSt-Tensorflow2/resnest/resnet.py community (archive-listed) unverified MIT (permissive) · 4d6569a50c288057 · report
rsoftmax Burf/ResNeSt-Tensorflow2/resnest/splat.py community (archive-listed) unverified MIT (permissive) · afc4cda18f695c8a · report
split_attention_block Burf/ResNeSt-Tensorflow2/resnest/splat.py community (archive-listed) unverified MIT (permissive) · 8fc30ed2b4a12eb8 · report
accuracy identical code first harvested elsewhere unverified licence of this copy not recorded · 913d82af53065418 · report

Tasks

Image ClassificationInstance SegmentationObject DetectionPanoptic SegmentationSemantic SegmentationTransfer Learningimage-classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification ImageNet ResNeSt-269 Number of params 111M #313 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-269 Top 1 Accuracy 84.5% #313 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-200 Number of params 70M #381 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-200 Top 1 Accuracy 83.9% #381 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-101 Number of params 48M #480 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-101 Top 1 Accuracy 83.0% #480 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-50 GFLOPs 5.39 #658 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-50 Number of params 27.5M #658 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-50 Top 1 Accuracy 81.13% #658 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-50-fast GFLOPs 4.34 #689 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-50-fast Number of params 27.5M #689 of 1060 Archive leaderboard report
Image Classification ImageNet ResNeSt-50-fast Top 1 Accuracy 80.64% #689 of 1060 Archive leaderboard report
Instance Segmentation COCO minival ResNeSt-200 (multi-scale) mask AP 46.25 #43 of 93 Archive leaderboard report
Instance Segmentation COCO minival ResNeSt-200-DCN (single-scale) mask AP 44.5 #53 of 93 Archive leaderboard report
Instance Segmentation COCO minival ResNeSt-200 (single-scale) mask AP 44.21 #57 of 93 Archive leaderboard report
Instance Segmentation COCO minival ResNeSt-101 (single-scale) mask AP 41.56 #65 of 93 Archive leaderboard report
Instance Segmentation COCO test-dev ResNeSt101 mask AP 43% #51 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ResNeSt-200 (multi-scale) AP50 70.2 #108 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ResNeSt-200 (multi-scale) AP75 51.5 #108 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ResNeSt-200 (multi-scale) APL 60.6 #108 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ResNeSt-200 (multi-scale) APM 49.6 #108 of 112 Archive leaderboard report
Instance Segmentation COCO test-dev ResNeSt-200 (multi-scale) APS 30.0 #108 of 112 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (multi-scale) AP50 71.00 #65 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (multi-scale) AP75 57.07 #65 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (multi-scale) APL 66.29 #65 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (multi-scale) APM 56.36 #65 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (multi-scale) APS 36.80 #65 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (multi-scale) box AP 52.47 #65 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200-DCN (single-scale) AP50 69.53 #75 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200-DCN (single-scale) AP75 55.40 #75 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200-DCN (single-scale) APL 65.83 #75 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200-DCN (single-scale) APM 54.66 #75 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200-DCN (single-scale) APS 32.67 #75 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200-DCN (single-scale) box AP 50.91 #75 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (single-scale) AP50 68.78 #77 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (single-scale) AP75 55.17 #77 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (single-scale) APL 63.9 #77 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (single-scale) APM 54.2 #77 of 220 Archive leaderboard report
Object Detection COCO minival ResNeSt-200 (single-scale) box AP 50.54 #77 of 220 Archive leaderboard report
Object Detection COCO test-dev ResNeSt-200 (multi-scale) AP50 72.0 #63 of 225 Archive leaderboard report
Object Detection COCO test-dev ResNeSt-200 (multi-scale) AP75 58.0 #63 of 225 Archive leaderboard report
Object Detection COCO test-dev ResNeSt-200 (multi-scale) APL 66.8 #63 of 225 Archive leaderboard report
Object Detection COCO test-dev ResNeSt-200 (multi-scale) APM 56.2 #63 of 225 Archive leaderboard report
Object Detection COCO test-dev ResNeSt-200 (multi-scale) APS 35.1 #63 of 225 Archive leaderboard report
Object Detection COCO test-dev ResNeSt-200 (multi-scale) box mAP 53.3 #63 of 225 Archive leaderboard report
Panoptic Segmentation COCO minival PanopticFPN+ResNeSt(single-scale) PQ 47.9 #24 of 31 Archive leaderboard report
Panoptic Segmentation COCO minival PanopticFPN+ResNeSt(single-scale) PQst 37.0 #24 of 31 Archive leaderboard report
Panoptic Segmentation COCO minival PanopticFPN+ResNeSt(single-scale) PQth 55.1 #24 of 31 Archive leaderboard report
Semantic Segmentation ADE20K ResNeSt-200 Validation mIoU 48.36 #147 of 235 Archive leaderboard report
Semantic Segmentation ADE20K ResNeSt-269 Validation mIoU 47.60 #160 of 235 Archive leaderboard report
Semantic Segmentation ADE20K ResNeSt-101 Validation mIoU 46.91 #168 of 235 Archive leaderboard report
Semantic Segmentation ADE20K val ResNeSt-200 mIoU 48.36 #62 of 95 Archive leaderboard report
Semantic Segmentation ADE20K val ResNeSt-269 mIoU 47.60 #65 of 95 Archive leaderboard report
Semantic Segmentation ADE20K val ResNeSt-101 mIoU 46.91 #68 of 95 Archive leaderboard report
Semantic Segmentation Cityscapes test ResNeSt200 (Mapillary) Mean IoU (class) 83.3% #16 of 105 Archive leaderboard report
Semantic Segmentation Cityscapes val ResNeSt-200 mIoU 82.7 #32 of 99 Archive leaderboard report
Semantic Segmentation DADA-seg ResNeSt (ResNeSt-101) mIoU 19.99 #21 of 28 Archive leaderboard report
Semantic Segmentation PASCAL Context ResNeSt-269 mIoU 58.9 #17 of 66 Archive leaderboard report
Semantic Segmentation PASCAL Context ResNeSt-200 mIoU 58.4 #19 of 66 Archive leaderboard report
Semantic Segmentation PASCAL Context ResNeSt-101 mIoU 56.5 #23 of 66 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: ResNeSt

1x1 ConvolutionASPPAutoAugmentAverage PoolingBatch NormalizationColorJitterConvolutionCosine AnnealingCutoutDeepLabv3Deformable ConvolutionDense ConnectionsDepthwise ConvolutionDepthwise Separable ConvolutionDilated ConvolutionDropBlockDropoutEfficientNetFPNGlobal Average PoolingImage Scale AugmentationInverted Residual BlockKaiming InitializationLSTMLabel SmoothingLinear Warmup With Cosine AnnealingMixupPointwise ConvolutionRMSPropRandom Horizontal FlipRandom Resized CropReLUResNeStResidual ConnectionRoIAlignSGD with MomentumSigmoid ActivationSoftmaxSpatial Pyramid PoolingSplit AttentionSqueeze-and-Excitation BlockTanh ActivationWeight Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections