Papers › RecConv: Efficient Recursive Convolutions for Multi-Frequency Representations

RecConv: Efficient Recursive Convolutions for Multi-Frequency Representations

27 Dec 2024arXiv:2412.19628archive 2025-07-28

Mingshu Zhao, Yi Luo, Yong Ouyang

Recent advances in vision transformers (ViTs) have demonstrated the advantage of global modeling capabilities, prompting widespread integration of large-kernel convolutions for enlarging the effective receptive field (ERF). However, the quadratic scaling of parameter count and computational complexity (FLOPs) with respect to kernel size poses significant efficiency and optimization challenges. This paper introduces RecConv, a recursive decomposition strategy that efficiently constructs multi-frequency representations using small-kernel convolutions. RecConv establishes a linear relationship between parameter growth and decomposing levels which determines the effective kernel size k×2^ℓ for a base kernel k and ℓ levels of decomposition, while maintaining constant FLOPs regardless of the ERF expansion. Specifically, RecConv achieves a parameter expansion of only ℓ+2 times and a maximum FLOPs increase of 5/3 times, compared to the exponential growth (4^ℓ) of standard and depthwise convolutions. RecNeXt-M3 outperforms RepViT-M1.1 by 1.9 APᵇᵒˣ on COCO with similar FLOPs. This innovation provides a promising avenue towards designing efficient and compact networks across various modalities. Codes and models can be found at \url{https://github.com/suous/RecNeXt}.

PaperPDFCode

Code

suous/recnext officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

BASE

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections