Papers › FBNetV5: Neural Architecture Search for Multiple Tasks in One Run

FBNetV5: Neural Architecture Search for Multiple Tasks in One Run

19 Nov 2021arXiv:2111.10007archive 2025-07-28

Bichen Wu, Chaojian Li, Hang Zhang, Xiaoliang Dai, Peizhao Zhang, Matthew Yu, Jialiang Wang, Yingyan Celine Lin, Peter Vajda

Neural Architecture Search (NAS) has been widely adopted to design accurate and efficient image classification models. However, applying NAS to a new computer vision task still requires a huge amount of effort. This is because 1) previous NAS research has been over-prioritized on image classification while largely ignoring other tasks; 2) many NAS works focus on optimizing task-specific components that cannot be favorably transferred to other tasks; and 3) existing NAS methods are typically designed to be "proxyless" and require significant effort to be integrated with each new task's training pipelines. To tackle these challenges, we propose FBNetV5, a NAS framework that can search for neural architectures for a variety of vision tasks with much reduced computational cost and human effort. Specifically, we design 1) a search space that is simple yet inclusive and transferable; 2) a multitask search process that is disentangled with target tasks' training pipeline; and 3) an algorithm to simultaneously search for architectures for multiple tasks with a computational cost agnostic to the number of tasks. We evaluate the proposed FBNetV5 targeting three fundamental vision tasks -- image classification, object detection, and semantic segmentation. Models searched by FBNetV5 in a single run of search have outperformed the previous stateof-the-art in all the three tasks: image classification (e.g., +1.3% ImageNet top-1 accuracy under the same FLOPs as compared to FBNetV3), semantic segmentation (e.g., +1.8% higher ADE20K val. mIoU than SegFormer with 3.6x fewer FLOPs), and object detection (e.g., +1.1% COCO val. mAP with 1.2x fewer FLOPs as compared to YOLOX).

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ClassificationImage ClassificationNeural Architecture SearchObject DetectionSemantic Segmentationimage-classificationobject-detection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification ImageNet FBNetV5-F-CLS GFLOPs 2.1 #346 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-F-CLS Top 1 Accuracy 84.1% #346 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-C-CLS GFLOPs 1 #518 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-C-CLS Top 1 Accuracy 82.6% #518 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5 GFLOPs 0.726 #603 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5 Top 1 Accuracy 81.8% #603 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-A-CLS GFLOPs 0.685 #614 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-A-CLS Top 1 Accuracy 81.7% #614 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-AC-CLS GFLOPs 0.280 #834 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-AC-CLS Top 1 Accuracy 78.4% #834 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-AR-CLS GFLOPs 0.215 #879 of 1060 Archive leaderboard report
Image Classification ImageNet FBNetV5-AR-CLS Top 1 Accuracy 77.2% #879 of 1060 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5 FLOPs 726M #8 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5 Top-1 Error Rate 18.2 #8 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5-A-CLS Accuracy 81.7 #9 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5-A-CLS FLOPs 685M #9 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5-A-CLS Top-1 Error Rate 18.3 #9 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5-AR-CLS Accuracy 77.2 #69 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5-AR-CLS FLOPs 215M #69 of 135 Archive leaderboard report
Neural Architecture Search ImageNet FBNetV5-AR-CLS Top-1 Error Rate 22.8 #69 of 135 Archive leaderboard report
Semantic Segmentation ADE20K FBNetV5 Validation mIoU 40.4 #218 of 235 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

ConvolutionDense ConnectionsLinear LayerMix-FFNResidual ConnectionSegFormer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections