Papers › Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN

Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN

27 May 2022arXiv:2205.13943archive 2025-07-28

Siyuan Li, Di wu, Fang Wu, Zelin Zang, Stan. Z. Li

Masked image modeling, an emerging self-supervised pre-training method, has shown impressive success across numerous downstream vision tasks with Vision transformers. Its underlying idea is simple: a portion of the input image is masked out and then reconstructed via a pre-text task. However, the working principle behind MIM is not well explained, and previous studies insist that MIM primarily works for the Transformer family but is incompatible with CNNs. In this work, we observe that MIM essentially teaches the model to learn better middle-order interactions among patches for more generalized feature extraction. We then propose an Architecture-Agnostic Masked Image Modeling framework (A²MIM), which is compatible with both Transformers and CNNs in a unified way. Extensive experiments on popular benchmarks show that A²MIM learns better representations without explicit design and endows the backbone model with the stronger capability to transfer to various downstream tasks.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Results from the paper archive 2025-07-28

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections