Methods › Computer Vision › Image Models › MLP-Mixer
MLP-Mixer
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
The MLP-Mixer architecture (or “Mixer” for short) is an image architecture that doesn't use convolutions or self-attention. Instead, Mixer’s architecture is based entirely on multi-layer perceptrons (MLPs) that are repeatedly applied across either spatial locations or feature channels. Mixer relies only on basic matrix multiplication routines, changes to data layout (reshapes and transpositions), and scalar nonlinearities.
It accepts a sequence of linearly projected image patches (also referred to as tokens) shaped as a “patches × channels” table as an input, and maintains this dimensionality. Mixer makes use of two types of MLP layers: channel-mixing MLPs and token-mixing MLPs. The channel-mixing MLPs allow communication between different channels; they operate on each token independently and take individual rows of the table as inputs. The token-mixing MLPs allow communication between different spatial locations (tokens); they operate on each channel independently and take individual columns of the table as inputs. These two types of layers are interleaved to enable interaction of both input dimensions.
Papers archive 2025-07-28
30 shown of 96, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
Knowledge Distillation for Reservoir-based Classifier: Human Activity Recognition 29 May 2025 · 0 repositories · arXiv:2505.22985
-
Structured Initialization for Vision Transformers 26 May 2025 · 0 repositories · arXiv:2505.19985
-
Unified Cross-Modal Attention-Mixer Based Structural-Functional Connectomics Fusion for Neuropsychiatric Disorder Diagnosis 21 May 2025 · 0 repositories · arXiv:2505.15139
-
Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis 25 Mar 2025 · 1 repository · arXiv:2503.20047Syntology ran 2 of 12 samples · 10 unverified
-
Lightweight Models for Emotional Analysis in Video 13 Mar 2025 · 1 repository · arXiv:2503.10530
-
KAN-Mixers: a new deep learning architecture for image classification 11 Mar 2025 · 0 repositories · arXiv:2503.08939
-
Fast Jet Tagging with MLP-Mixers on FPGAs 5 Mar 2025 · 0 repositories · arXiv:2503.03103
-
Temporal Graph MLP Mixer for Spatio-Temporal Forecasting 17 Jan 2025 · 1 repository · arXiv:2501.10214
-
Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hours 28 Dec 2024 · 0 repositories · arXiv:2412.20256
-
WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting 22 Dec 2024 · 1 repository · arXiv:2412.17176Syntology ran 3 of 5 samples · 2 unverified
-
LibraGrad: Balancing Gradient Flow for Universally Better Vision Transformer Attributions 24 Nov 2024 · 1 repository · arXiv:2411.16760
-
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement 22 Nov 2024 · 0 repositories · arXiv:2411.14961
-
Improving 3D Medical Image Segmentation at Boundary Regions using Local Self-attention and Global Volume Mixing 20 Oct 2024 · 1 repository · arXiv:2410.15360
-
Interpolated-MLPs: Controllable Inductive Bias 12 Oct 2024 · 0 repositories · arXiv:2410.09655
-
Towards Foundation Models for the Industrial Forecasting of Chemical Kinetics 20 Aug 2024 · 0 repositories · arXiv:2408.10720
-
Benchmarking tree species classification from proximally-sensed laser scanning data: introducing the FOR-species20K dataset 12 Aug 2024 · 2 repositories · arXiv:2408.06507
-
HyperAggregation: Aggregating over Graph Edges with Hypernetworks 16 Jul 2024 · 1 repository · arXiv:2407.11596
-
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network 1 Jul 2024 · 1 repository · arXiv:2407.01645Syntology ran 12 of 13 samples · 1 unverified
-
Demonstrating the Efficacy of Kolmogorov-Arnold Networks in Vision Tasks 21 Jun 2024 · 1 repository · arXiv:2406.14916
-
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breaking 18 Jun 2024 · 1 repository · arXiv:2406.12220Syntology ran 1 of 1 samples · 0 unverified
-
Exploring the Enigma of Neural Dynamics Through A Scattering-Transform Mixer Landscape for Riemannian Manifold 25 May 2024 · 1 repository · arXiv:2405.16357Syntology ran 11 of 14 samples · 3 unverified · 14 pointer-only (licence)
-
MLPs Learn In-Context on Regression and Classification Tasks 24 May 2024 · 2 repositories · arXiv:2405.15618Syntology ran 2 of 16 samples · 14 unverified
-
Transformer-based Federated Learning for Multi-Label Remote Sensing Image Classification 24 May 2024 · 0 repositories · arXiv:2405.15405
-
Node Centrality Approximation For Large Networks Based On Inductive Graph Neural Networks 8 Mar 2024 · 0 repositories · arXiv:2403.04977
-
NiNformer: A Network in Network Transformer with Token Mixing Generated Gating Function 4 Mar 2024 · 1 repository · arXiv:2403.02411
-
Mixer is more than just a model 28 Feb 2024 · 0 repositories · arXiv:2402.18007
-
PaCKD: Pattern-Clustered Knowledge Distillation for Compressing Memory Access Prediction Models 21 Feb 2024 · 1 repository · arXiv:2402.13441
-
Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization 19 Feb 2024 · 2 repositories · arXiv:2402.12550Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
-
M2-Mixer: A Multimodal Mixer with Multi-head Loss for Classification from Multimodal Data 22 Jan 2024 · 1 repository
-
PatchAD: A Lightweight Patch-based MLP-Mixer for Time Series Anomaly Detection 18 Jan 2024 · 1 repository · arXiv:2401.09793Syntology ran 3 of 3 samples · 0 unverified
Tasks archive 2025-07-28
20 shown of 138 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections