Mamba

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 552 papers with code (1,058 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
  1 Dec 2023 35 repositories listed Syntology ran 18 of 62 samples · 44 unverified · 28 pointer-only (licence)
  Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.
• Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
  17 Jan 2024 15 repositories listed Syntology ran 2 of 13 samples · 11 unverified · 1 pointer-only (licence)
  The results demonstrate that Vim is capable of overcoming the computation & memory constraints on performing Transformer-style understanding for high-resolution images and it has great potential to be the…
• VMamba: Visual State Space Model
  18 Jan 2024 13 repositories listed Syntology ran 20 of 46 samples · 26 unverified
  At the core of VMamba is a stack of Visual State-Space (VSS) blocks with the 2D Selective Scan (SS2D) module.
• Gated Linear Attention Transformers with Hardware-Efficient Training
  11 Dec 2023 6 repositories listed Syntology ran 2 of 2 samples · 0 unverified
  When used as a replacement for the standard attention layer in Transformers, the resulting gated linear attention (GLA) Transformer is found to perform competitively against the LLaMA-architecture Transformer (Touvron…
• Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
  31 May 2024 5 repositories listed Syntology ran 6 of 13 samples · 7 unverified · 1 pointer-only (licence)
  While Transformers have been the main architecture behind deep learning's success in language modeling, state-space models (SSMs) such as Mamba have recently been shown to match or outperform Transformers at small to…
• Speech Slytherin: Examining the Performance and Efficiency of Mamba for Speech Separation, Recognition, and Synthesis
  13 Jul 2024 4 repositories listed
  It is too early to conclude that Mamba is a better alternative to transformers for speech before comparing Mamba with transformers in terms of both performance and efficiency in multiple speech-related tasks.
• MambaOut: Do We Really Need Mamba for Vision?
  13 May 2024 4 repositories listed
  For vision tasks, as image classification does not align with either characteristic, we hypothesize that Mamba is not necessary for this task; Detection and segmentation tasks are also not autoregressive, yet they…
• Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling
  5 Mar 2024 4 repositories listed Syntology ran 6 of 16 samples · 10 unverified
  Large-scale sequence modeling has sparked rapid advances that now extend into biology and genomics.
• Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
  29 Feb 2024 4 repositories listed Syntology ran 0 of 10 samples · 10 unverified
  Recurrent neural networks (RNNs) have fast inference and scale efficiently on long sequences, but they are difficult to train and hard to scale.
• VM-UNet: Vision Mamba UNet for Medical Image Segmentation
  4 Feb 2024 4 repositories listed Syntology ran 11 of 17 samples · 6 unverified · 2 pointer-only (licence)
  To our best knowledge, this is the first medical image segmentation model constructed based on the pure SSM-based model.
• xLSTM 7B: A Recurrent LLM for Fast and Efficient Inference
  17 Mar 2025 3 repositories listed Syntology ran 1 of 5 samples · 4 unverified
  Recent breakthroughs in solving reasoning, math and coding problems with Large Language Models (LLMs) have been enabled by investing substantial computation budgets at inference time.
• Were RNNs All We Needed?
  2 Oct 2024 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 2 pointer-only (licence)
  The introduction of Transformers in 2017 reshaped the landscape of deep learning.
• MambaVision: A Hybrid Mamba-Transformer Vision Backbone
  10 Jul 2024 3 repositories listed Syntology ran 2 of 8 samples · 6 unverified · 6 pointer-only (licence)
  We propose a novel hybrid Mamba-Transformer backbone, MambaVision, specifically tailored for vision applications.
• Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  5 Jul 2024 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 1 pointer-only (licence)
  We evaluate our instantiations at the scale of 125M to 1.
• Parallelizing Linear Transformers with the Delta Rule over Sequence Length
  10 Jun 2024 3 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 2 pointer-only (licence)
  Transformers with linear attention (i.
• CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detection
  6 Jun 2024 3 repositories listed
  Specifically, the Scaled Residual ConvMamba (SRCM) block is proposed to utilize the ability of Mamba to extract global features and convolution to enhance the local details to alleviate the issue that current…
• nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentation
  15 Apr 2024 3 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  The release of nnU-Net marked a paradigm shift in 3D medical image segmentation, demonstrating that a properly configured U-Net architecture could still achieve state-of-the-art results.
• Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos
  11 Apr 2024 3 repositories listed
  These spatial features then undergo intermediate temporal modeling facilitated by the Mamba block before progressing to the encoder section, which comprises vanilla upsampling Shift S-GCN blocks.
• MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection
  9 Apr 2024 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches.
• RSMamba: Remote Sensing Image Classification with State Space Model
  28 Mar 2024 3 repositories listed Syntology ran 8 of 10 samples · 2 unverified
  Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation.
• Jamba: A Hybrid Transformer-Mamba Language Model
  28 Mar 2024 3 repositories listed
  We present Jamba, a new base large language model based on a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture.
• SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series
  22 Mar 2024 3 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains.
• Simple linear attention language models balance the recall-throughput tradeoff
  28 Feb 2024 3 repositories listed Syntology ran 10 of 10 samples · 0 unverified · 1 pointer-only (licence)
  In this work, we explore whether we can improve language model efficiency (e.
• MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement
  1 Jul 2025 2 repositories listed
  Nevertheless, neither the concept of hybrid Mamba and time-frequency attention models nor their generalization performance have been explored for speech enhancement.
• AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation
  1 Jun 2025 2 repositories listed
  Video Frame Interpolation (VFI) is a fundamental Low-Level Vision (LLV) task that synthesizes intermediate frames between existing ones while maintaining spatial and temporal coherence.
• Structured Linear CDEs: Maximally Expressive and Parallel-in-Time Sequence Models
  23 May 2025 2 repositories listed Syntology ran 3 of 3 samples · 0 unverified
  Structured Linear Controlled Differential Equations (SLiCEs) provide a unifying framework for sequence models with structured, input-dependent state-transition matrices that retain the maximal expressivity of dense…
• DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer Based One-Stage Object Detection
  16 Feb 2025 2 repositories listed
  Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes.
• DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction
  14 Jan 2025 2 repositories listed
  To address these, we propose a dual-domain hierarchical Mamba for MRI reconstruction from the following perspectives: (1) We pioneer vision Mamba in k-space learning.
• BrainMAP: Learning Multiple Activation Pathways in Brain Networks
  23 Dec 2024 2 repositories listed
  As such, conventional GNNs struggle to learn from these pathways due to the long-range dependencies of multiple pathways.
• Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRs
  9 Dec 2024 2 repositories listed Syntology ran 0 of 13 samples · 13 unverified
  We find that longer context models improve predictive performance -- our Mamba-based model surpasses the prior state-of-the-art on 9/14 tasks on the EHRSHOT prediction benchmark.

Syntology lines on 20 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.