{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/simba-simplified-mamba-based-architecture-for","title":"SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series","arxiv_id":"2403.15360","date":"2024-03-22","proceeding":null,"authors":["Badri N. Patro","Vijay S. Agneeswaran"],"abstract":"Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks, including low inductive bias and quadratic complexity concerning input sequence length. State Space Models (SSMs) like S4 and others (Hippo, Global Convolutions, liquid S4, LRU, Mega, and Mamba), have emerged to address the above issues to help handle longer sequence lengths. Mamba, while being the state-of-the-art SSM, has a stability issue when scaled to large networks for computer vision datasets. We propose SiMBA, a new architecture that introduces Einstein FFT (EinFFT) for channel modeling by specific eigenvalue computations and uses the Mamba block for sequence modeling. Extensive performance studies across image and time-series benchmarks demonstrate that SiMBA outperforms existing SSMs, bridging the performance gap with state-of-the-art transformers. Notably, SiMBA establishes itself as the new state-of-the-art SSM on ImageNet and transfer learning benchmarks such as Stanford Car and Flower as well as task learning benchmarks as well as seven time series benchmark datasets. The project page is available on this website ~\\url{https://github.com/badripatro/Simba}.","url_abs":"https://arxiv.org/abs/2403.15360v2","url_pdf":"https://arxiv.org/pdf/2403.15360v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"simba-simplified-mamba-based-architecture-for","repo_url":"https://github.com/badripatro/simba","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"simba-simplified-mamba-based-architecture-for","repo_url":"https://github.com/MindSpore-scientific-2/code-10/tree/main/Simba","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"simba-simplified-mamba-based-architecture-for","repo_url":"https://github.com/MindSpore-scientific-2/code-11/tree/main/Simba","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"inductive-bias","task_name":"Inductive Bias"},{"task_slug":"mamba","task_name":"Mamba"},{"task_slug":"state-space-models","task_name":"State Space Models"},{"task_slug":"time-series-1","task_name":"Time Series"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2403.15360","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.15360"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindSpore-scientific-2/code-11/tree/main/Simba","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/badripatro/simba","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/MindSpore-scientific-2/code-10/tree/main/Simba","reach":null}],"summary":{"ran":4},"by_repo_kind":{"official":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"bbff8d1aecb5fc69","entry":"build_transform","repo":"badripatro/simba","repo_kind":"official","path":"classification/datasets.py","file_url":"https://github.com/badripatro/simba/blob/HEAD/classification/datasets.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bbff8d1aecb5fc69"}},{"code_sha256_prefix":"6cc5ed3b37c68d9d","entry":"pil_loader","repo":"badripatro/simba","repo_kind":"official","path":"classification/mcloader/mcloader.py","file_url":"https://github.com/badripatro/simba/blob/HEAD/classification/mcloader/mcloader.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6cc5ed3b37c68d9d"}},{"code_sha256_prefix":"d84653ce829572b8","entry":"rand_bbox","repo":"badripatro/simba","repo_kind":"official","path":"classification/simba.py","file_url":"https://github.com/badripatro/simba/blob/HEAD/classification/simba.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d84653ce829572b8"}},{"code_sha256_prefix":"63dfd023b306bac7","entry":"setup_logger","repo":"badripatro/simba","repo_kind":"official","path":"classification/utils.py","file_url":"https://github.com/badripatro/simba/blob/HEAD/classification/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"63dfd023b306bac7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}