{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/strip-mlp-efficient-token-interaction-for","title":"Strip-MLP: Efficient Token Interaction for Vision MLP","arxiv_id":"2307.11458","date":"2023-07-21","proceeding":"ICCV 2023 1","authors":["Guiping Cao","Shengda Luo","Wenjian Huang","Xiangyuan Lan","Dongmei Jiang","YaoWei Wang","JianGuo Zhang"],"abstract":"Token interaction operation is one of the core modules in MLP-based models to exchange and aggregate information between different spatial locations. However, the power of token interaction on the spatial dimension is highly dependent on the spatial resolution of the feature maps, which limits the model's expressive ability, especially in deep layers where the feature are down-sampled to a small spatial size. To address this issue, we present a novel method called \\textbf{Strip-MLP} to enrich the token interaction power in three ways. Firstly, we introduce a new MLP paradigm called Strip MLP layer that allows the token to interact with other tokens in a cross-strip manner, enabling the tokens in a row (or column) to contribute to the information aggregations in adjacent but different strips of rows (or columns). Secondly, a \\textbf{C}ascade \\textbf{G}roup \\textbf{S}trip \\textbf{M}ixing \\textbf{M}odule (CGSMM) is proposed to overcome the performance degradation caused by small spatial feature size. The module allows tokens to interact more effectively in the manners of within-patch and cross-patch, which is independent to the feature spatial size. Finally, based on the Strip MLP layer, we propose a novel \\textbf{L}ocal \\textbf{S}trip \\textbf{M}ixing \\textbf{M}odule (LSMM) to boost the token interaction power in the local region. Extensive experiments demonstrate that Strip-MLP significantly improves the performance of MLP-based models on small datasets and obtains comparable or even better results on ImageNet. In particular, Strip-MLP models achieve higher average Top-1 accuracy than existing MLP-based models by +2.44\\% on Caltech-101 and +2.16\\% on CIFAR-100. The source codes will be available at~\\href{https://github.com/Med-Process/Strip_MLP{https://github.com/Med-Process/Strip\\_MLP}.","url_abs":"https://arxiv.org/abs/2307.11458v1","url_pdf":"https://arxiv.org/pdf/2307.11458v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"strip-mlp-efficient-token-interaction-for","repo_url":"https://github.com/med-process/strip_mlp","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2307.11458","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.11458"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/med-process/strip_mlp","reach":null},{"provenance":"deterministic:regex_extraction","url":"https://github.com/Med-Process/Strip","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}}],"summary":{"ran":3},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"031e0b19f8c99de7","entry":"Mlp","repo":"med-process/strip_mlp","repo_kind":"official","path":"models/strip_mlp.py","file_url":"https://github.com/med-process/strip_mlp/blob/HEAD/models/strip_mlp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"031e0b19f8c99de7"}},{"code_sha256_prefix":"5c9a99daca927cab","entry":"RelativePosition","repo":"med-process/strip_mlp","repo_kind":"official","path":"models/strip_mlp.py","file_url":"https://github.com/med-process/strip_mlp/blob/HEAD/models/strip_mlp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5c9a99daca927cab"}},{"code_sha256_prefix":"fa13cb8914d9a3be","entry":"StripMLP_Block","repo":"med-process/strip_mlp","repo_kind":"official","path":"models/strip_mlp.py","file_url":"https://github.com/med-process/strip_mlp/blob/HEAD/models/strip_mlp.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fa13cb8914d9a3be"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}