Papers › GPUNet: Searching the Deployable Convolution Neural Networks for GPUs

GPUNet: Searching the Deployable Convolution Neural Networks for GPUs

26 Apr 2022arXiv:2205.00841archive 2025-07-28

Linnan Wang, Chenhan Yu, Satish Salian, Slawomir Kierat, Szymon Migacz, Alex Fit Florea

Customizing Convolution Neural Networks (CNN) for production use has been a challenging task for DL practitioners. This paper intends to expedite the model customization with a model hub that contains the optimized models tiered by their inference latency using Neural Architecture Search (NAS). To achieve this goal, we build a distributed NAS system to search on a novel search space that consists of prominent factors to impact latency and accuracy. Since we target GPU, we name the NAS optimized models as GPUNet, which establishes a new SOTA Pareto frontier in inference latency and accuracy. Within 1ms, GPUNet is 2x faster than EfficientNet-X and FBNetV3 with even better accuracy. We also validate GPUNet on detection tasks, and GPUNet consistently outperforms EfficientNet-X and FBNetV3 on COCO detection tasks in both latency and accuracy. All of these data validate that our NAS system is effective and generic to handle different design tasks. With this NAS system, we expand GPUNet to cover a wide range of latency targets such that DL practitioners can deploy our models directly in different scenarios.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

NVIDIA/DeepLearningExamples tfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context (arXiv:1901.02860; that paper's own run record: 67 ran (of which 37 constructed an object rather than computing a result; 49 with no instrument failure: 4 honoured, 1 violated, 44 with no contract checked; 18 where Syntology's instrument failed) · 76 unverified) and HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis (arXiv:2010.05646; that paper's own run record: 17 ran (of which 11 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Neural Architecture Search

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Neural Architecture Search ImageNet GPUNet-D3 FLOPs 15.6G #3 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D3 Params 19M #3 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D3 Top-1 Error Rate 16.4 #3 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D1 FLOPs 3.66G #4 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D1 Params 10.6M #4 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D1 Top-1 Error Rate 17.5 #4 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D0 FLOPs 720M #28 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D0 Params 6.2M #28 of 135 Archive leaderboard report
Neural Architecture Search ImageNet GPUNet-D0 Top-1 Error Rate 20.3 #28 of 135 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections