Papers › FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions

FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions

12 Apr 2020CVPR 2020 6arXiv:2004.05565archive 2025-07-28

Alvin Wan, Xiaoliang Dai, Peizhao Zhang, Zijian He, Yuandong Tian, Saining Xie, Bichen Wu, Matthew Yu, Tao Xu, Kan Chen, Peter Vajda, Joseph E. Gonzalez

Differentiable Neural Architecture Search (DNAS) has demonstrated great success in designing state-of-the-art, efficient neural networks. However, DARTS-based DNAS's search space is small when compared to other search methods', since all candidate network layers must be explicitly instantiated in memory. To address this bottleneck, we propose a memory and computationally efficient DNAS variant: DMaskingNAS. This algorithm expands the search space by up to 10¹⁴× over conventional DNAS, supporting searches over spatial and channel dimensions that are otherwise prohibitively expensive: input resolution and number of filters. We propose a masking mechanism for feature map reuse, so that memory and computational costs stay nearly constant as the search space expands. Furthermore, we employ effective shape propagation to maximize per-FLOP or per-parameter accuracy. The searched FBNetV2s yield state-of-the-art performance when compared with all previous architectures. With up to 421× less search cost, DMaskingNAS finds models with 0.9% higher accuracy, 15% fewer FLOPs than MobileNetV3-Small; and with similar accuracy but 20% fewer FLOPs than Efficient-B0. Furthermore, our FBNetV2 outperforms MobileNetV3 by 2.6% in accuracy, with equivalent model size. FBNetV2 models are open-sourced at https://github.com/facebookresearch/mobile-vision.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

facebookresearch/mobile-vision officialmentioned in papercaffe2NOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Neural Architecture Search

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Neural Architecture Search ImageNet FBNetV2-L1 Accuracy 77.2 #70 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-L1 MACs 325M #70 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-L1 Top-1 Error Rate 22.8 #70 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F4 Accuracy 76.0 #96 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F4 MACs 238M #96 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F4 Top-1 Error Rate 24.0 #96 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F3 Accuracy 73.2 #125 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F3 MACs 126M #125 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F3 Top-1 Error Rate 26.8 #125 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F1 Accuracy 68.3 #130 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F1 MACs 56M #130 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV2-F1 Top-1 Error Rate 31.7 #130 of 135 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

DNASGumbel Softmax

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections