Papers › AsymmNet: Towards ultralight convolution neural networks using asymmetrical bottlenecks

AsymmNet: Towards ultralight convolution neural networks using asymmetrical bottlenecks

15 Apr 2021arXiv:2104.07770archive 2025-07-28

Haojin Yang, Zhen Shen, Yucheng Zhao

Deep convolutional neural networks (CNN) have achieved astonishing results in a large variety of applications. However, using these models on mobile or embedded devices is difficult due to the limited memory and computation resources. Recently, the inverted residual block becomes the dominating solution for the architecture design of compact CNNs. In this work, we comprehensively investigated the existing design concepts, rethink the functional characteristics of two pointwise convolutions in the inverted residuals. We propose a novel design, called asymmetrical bottlenecks. Precisely, we adjust the first pointwise convolution dimension, enrich the information flow by feature reuse, and migrate saved computations to the second pointwise convolution. By doing so we can further improve the accuracy without increasing the computation overhead. The asymmetrical bottlenecks can be adopted as a drop-in replacement for the existing CNN blocks. We can thus create AsymmNet by easily stack those blocks according to proper depth and width conditions. Extensive experiments demonstrate that our proposed block design is more beneficial than the original inverted residual bottlenecks for mobile networks, especially useful for those ultralight CNNs within the regime of <220M MAdds. Code is available at https://github.com/Spark001/AsymmNet

PaperPDFCode

Code

Spark001/AsymmNet officialmentioned in papermentioned on GitHubmxnet report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Classification

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Image Classification ImageNet AsymmNet-Large ×1.0 GFLOPs 0.4338 #950 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Large ×1.0 Number of params 5.99M #950 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Large ×1.0 Top 1 Accuracy 75.4% #950 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Large ×0.5 GFLOPs 0.1344 #1029 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Large ×0.5 Number of params 2.8M #1029 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Large ×0.5 Top 1 Accuracy 69.2% #1029 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Small ×1.0 GFLOPs 0.1154 #1032 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Small ×1.0 Number of params 3.1M #1032 of 1060 Archive leaderboard report
Image Classification ImageNet AsymmNet-Small ×1.0 Top 1 Accuracy 68.4% #1032 of 1060 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionBatch NormalizationConvolutionDepthwise ConvolutionDepthwise Separable ConvolutionInverted Residual BlockPointwise ConvolutionReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections