Papers › USB: Universal-Scale Object Detection Benchmark

USB: Universal-Scale Object Detection Benchmark

25 Mar 2021arXiv:2103.14027archive 2025-07-28

Yosuke Shinya

Benchmarks, such as COCO, play a crucial role in object detection. However, existing benchmarks are insufficient in scale variation, and their protocols are inadequate for fair comparison. In this paper, we introduce the Universal-Scale object detection Benchmark (USB). USB has variations in object scales and image domains by incorporating COCO with the recently proposed Waymo Open Dataset and Manga109-s dataset. To enable fair comparison and inclusive research, we propose training and evaluation protocols. They have multiple divisions for training epochs and evaluation image resolutions, like weight classes in sports, and compatibility across training protocols, like the backward compatibility of the Universal Serial Bus. Specifically, we request participants to report results with not only higher protocols (longer training) but also lower protocols (shorter training). Using the proposed benchmark and protocols, we conducted extensive experiments using 15 methods and found weaknesses of existing COCO-biased methods. The code is available at https://github.com/shinya7y/UniverseNet .

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

shinya7y/UniverseNet officialmentioned in papermentioned on GitHubpytorchApache-2.0 report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ObjectObject DetectionReal-Time Object Detectionobject-detection

Datasets

Introduced by this paper, per the archive.

USB

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) AP50 70.8 #60 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) AP75 58.9 #60 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) APL 68.1 #60 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) APM 57.5 #60 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) APS 36.9 #60 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) box AP 53.5 #60 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, single-scale) AP50 69.5 #76 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, single-scale) AP75 55.4 #76 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, single-scale) APL 65.8 #76 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, single-scale) APM 55.5 #76 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, single-scale) APS 33.5 #76 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08d (Res2Net-101, DCN, single-scale) box AP 50.9 #76 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08 (Res2Net-50, DCN, single-scale) AP50 67.0 #89 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08 (Res2Net-50, DCN, single-scale) AP75 52.6 #89 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08 (Res2Net-50, DCN, single-scale) APL 62.7 #89 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08 (Res2Net-50, DCN, single-scale) APM 52.7 #89 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08 (Res2Net-50, DCN, single-scale) APS 30.6 #89 of 220 Archive leaderboard report
Object Detection COCO minival UniverseNet-20.08 (Res2Net-50, DCN, single-scale) box AP 48.5 #89 of 220 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) AP50 71.6 #57 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) AP75 59.9 #57 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) APL 67.4 #57 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) APM 57.2 #57 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) APS 35.8 #57 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, multi-scale) box mAP 54.1 #57 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, single-scale) AP50 70.0 #81 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, single-scale) AP75 55.8 #81 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, single-scale) APL 64.9 #81 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, single-scale) APM 55.3 #81 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, single-scale) APS 31.7 #81 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08d (Res2Net-101, DCN, single-scale) box mAP 51.3 #81 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08 (Res2Net-50, DCN, single-scale) AP50 67.5 #102 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08 (Res2Net-50, DCN, single-scale) AP75 53.0 #102 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08 (Res2Net-50, DCN, single-scale) APL 61.1 #102 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08 (Res2Net-50, DCN, single-scale) APM 52.3 #102 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08 (Res2Net-50, DCN, single-scale) APS 30.1 #102 of 225 Archive leaderboard report
Object Detection COCO test-dev UniverseNet-20.08 (Res2Net-50, DCN, single-scale) box mAP 48.8 #102 of 225 Archive leaderboard report
Object Detection COCO-O UniverseNet (R2-101-DCN) Average mAP 24.8 #28 of 45 Archive leaderboard report
Object Detection COCO-O UniverseNet (R2-101-DCN) Effective Robustness 1.86 #44 of 45 Archive leaderboard report
Object Detection Manga109-s 15test YOLOX-L COCO-style AP 70.2 #1 of 15 Archive leaderboard report
Object Detection Manga109-s 15test UniverseNet-20.08 COCO-style AP 69.9 #2 of 15 Archive leaderboard report
Object Detection Manga109-s 15test UniverseNet COCO-style AP 68.9 #3 of 15 Archive leaderboard report
Object Detection Manga109-s 15test ATSS+DyHead COCO-style AP 67.9 #4 of 15 Archive leaderboard report
Object Detection Manga109-s 15test Cascade R-CNN COCO-style AP 67.6 #5 of 15 Archive leaderboard report
Object Detection Manga109-s 15test ATSS (ConvNeXt-T) COCO-style AP 67.4 #6 of 15 Archive leaderboard report
Object Detection Manga109-s 15test GFL COCO-style AP 67.3 #7 of 15 Archive leaderboard report
Object Detection Manga109-s 15test ATSS+SEPC COCO-style AP 67.1 #8 of 15 Archive leaderboard report
Object Detection Manga109-s 15test ATSS COCO-style AP 66.5 #9 of 15 Archive leaderboard report
Object Detection Manga109-s 15test ATSS (Swin-T) COCO-style AP 66.2 #10 of 15 Archive leaderboard report
Object Detection Manga109-s 15test Faster R-CNN COCO-style AP 65.8 #11 of 15 Archive leaderboard report
Object Detection Manga109-s 15test RetinaNet COCO-style AP 65.3 #12 of 15 Archive leaderboard report
Object Detection Manga109-s 15test Deformable DETR COCO-style AP 64.1 #13 of 15 Archive leaderboard report
Object Detection Manga109-s 15test Sparse R-CNN COCO-style AP 63.1 #14 of 15 Archive leaderboard report
Object Detection Manga109-s 15test DETR COCO-style AP 31.2 #15 of 15 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) UniverseNet-20.08 mCAP 52.1 #1 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) UniverseNet mCAP 51.4 #2 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) ATSS (ConvNeXt-T) mCAP 50.4 #3 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) YOLOX-L mCAP 49.6 #4 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) ATSS+DyHead mCAP 49.4 #5 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) ATSS (Swin-T) mCAP 49.0 #6 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) Cascade R-CNN mCAP 48.1 #7 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) GFL mCAP 47.7 #8 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) ATSS mCAP 47.1 #9 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) Faster R-CNN mCAP 45.9 #10 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) RetinaNet mCAP 44.8 #11 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) Sparse R-CNN mCAP 44.6 #12 of 13 Archive leaderboard report
Object Detection USB (Standard USB 1.0 protocol) DETR mCAP 23.7 #13 of 13 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val YOLOX-L COCO-style AP 41.6 #1 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val UniverseNet-20.08 COCO-style AP 39.0 #2 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val UniverseNet COCO-style AP 38.6 #3 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val ATSS (ConvNeXt-T) COCO-style AP 38.3 #4 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val ATSS (Swin-T) COCO-style AP 37.2 #5 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val ATSS+DyHead COCO-style AP 37.1 #6 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val Cascade R-CNN COCO-style AP 36.4 #7 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val GFL COCO-style AP 35.7 #8 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val ATSS COCO-style AP 35.4 #9 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val ATSS+SEPC COCO-style AP 35.0 #10 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val Faster R-CNN COCO-style AP 34.5 #11 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val Sparse R-CNN COCO-style AP 32.8 #12 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val Deformable DETR COCO-style AP 32.7 #13 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val RetinaNet COCO-style AP 32.5 #14 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns f0val DETR COCO-style AP 17.8 #15 of 15 Archive leaderboard report
Object Detection Waymo 2D detection all_ns test UniverseNet AP/L2 67.42 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationCSPDarknet53ConvolutionGlobal Average PoolingResidual ConnectionSoftmaxYOLOX

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections