State Space Models

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 394 papers with code (923 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
  1 Dec 2023 35 repositories listed Syntology ran 18 of 62 samples · 44 unverified · 28 pointer-only (licence)
  Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.
• Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
  17 Jan 2024 15 repositories listed Syntology ran 2 of 13 samples · 11 unverified · 1 pointer-only (licence)
  The results demonstrate that Vim is capable of overcoming the computation & memory constraints on performing Transformer-style understanding for high-resolution images and it has great potential to be the…
• Resurrecting Recurrent Neural Networks for Long Sequences
  11 Mar 2023 11 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train.
• Mega: Moving Average Equipped Gated Attention
  21 Sep 2022 7 repositories listed Syntology ran 12 of 13 samples · 1 unverified · 8 pointer-only (licence)
  The design choices in the Transformer attention mechanism, including weak inductive bias and quadratic computational complexity, have limited its application for modeling long sequences.
• Simplified State Space Layers for Sequence Modeling
  9 Aug 2022 6 repositories listed Syntology ran 4 of 19 samples · 15 unverified · 3 pointer-only (licence)
  Models using structured state space sequence (S4) layers have achieved state-of-the-art performance on long-range sequence modeling tasks.
• It's Raw! Audio Generation with State-Space Models
  20 Feb 2022 6 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 4 pointer-only (licence)
  SaShiMi yields state-of-the-art performance for unconditional waveform generation in the autoregressive setting.
• Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
  31 May 2024 5 repositories listed Syntology ran 6 of 13 samples · 7 unverified · 1 pointer-only (licence)
  While Transformers have been the main architecture behind deep learning's success in language modeling, state-space models (SSMs) such as Mamba have recently been shown to match or outperform Transformers at small to…
• Awesome Multi-modal Object Tracking
  23 May 2024 5 repositories listed
  To leverage more modalities, some recent efforts have been made to learn a unified visual object tracking model for any modality.
• xLSTM: Extended Long Short-Term Memory
  7 May 2024 5 repositories listed Syntology ran 0 of 9 samples · 9 unverified
  In the 1990s, the constant error carousel and gating were introduced as the central ideas of the Long Short-Term Memory (LSTM).
• Learning neural state-space models: do we need a state estimator?
  26 Jun 2022 5 repositories listed
  In recent years, several algorithms for system identification with neural state-space models have been introduced.
• Probabilistic Recurrent State-Space Models
  31 Jan 2018 4 repositories listed
  State-space models (SSMs) are a highly expressive model class for learning patterns in time series data and for system identification.
• Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data
  20 May 2016 4 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models.
• Parallelizing Linear Transformers with the Delta Rule over Sequence Length
  10 Jun 2024 3 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 2 pointer-only (licence)
  Transformers with linear attention (i.
• CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detection
  6 Jun 2024 3 repositories listed
  Specifically, the Scaled Residual ConvMamba (SRCM) block is proposed to utilize the ability of Mamba to extract global features and convolution to enhance the local details to alleviate the issue that current…
• MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection
  9 Apr 2024 3 repositories listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches.
• SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series
  22 Mar 2024 3 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains.
• Hungry Hungry Hippos: Towards Language Modeling with State Space Models
  28 Dec 2022 3 repositories listed Syntology ran 7 of 15 samples · 8 unverified
  First, we use synthetic language modeling tasks to understand the gap between SSMs and attention.
• Structured Inference Networks for Nonlinear State Space Models
  30 Sep 2016 3 repositories listed Syntology ran 2 of 13 samples · 11 unverified
  We introduce a unified algorithm to efficiently learn a broad class of linear and non-linear state space models, including variants where the emission and transition distributions are modeled by deep neural networks.
• DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer Based One-Stage Object Detection
  16 Feb 2025 2 repositories listed
  Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes.
• DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction
  14 Jan 2025 2 repositories listed
  To address these, we propose a dual-domain hierarchical Mamba for MRI reconstruction from the following perspectives: (1) We pioneer vision Mamba in k-space learning.
• NLLG Quarterly arXiv Report 09/24: What are the most influential current AI Papers?
  2 Dec 2024 2 repositories listed
  The NLLG (Natural Language Learning & Generation) arXiv reports assist in navigating the rapidly evolving landscape of NLP and AI research across cs.
• Recursive Gaussian Process State Space Model
  22 Nov 2024 2 repositories listed
  Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design.
• EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality
  22 Nov 2024 2 repositories listed
  In this paper, we introduce Efficient Vision Mamba (EfficientViM), a novel architecture built on hidden state mixer-based state space duality (HSM-SSD) that efficiently captures global dependencies with further reduced…
• SSD4Rec: A Structured State Space Duality Model for Efficient Sequential Recommendation
  2 Sep 2024 2 repositories listed
  Sequential recommendation methods are crucial in modern recommender systems for their remarkable capability to understand a user's changing interests based on past interactions.
• MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentation
  15 Aug 2024 2 repositories listed
  We pre-train MambaMIM on a large-scale dataset of 6.
• VSSD: Vision Mamba with Non-Causal State Space Duality
  26 Jul 2024 2 repositories listed Syntology ran 4 of 11 samples · 7 unverified · 1 pointer-only (licence)
  Recently, State Space Duality (SSD), an improved variant of SSMs, was introduced in Mamba2 to enhance model performance and efficiency.
• Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  11 Jun 2024 2 repositories listed Syntology ran 1 of 1 samples · 0 unverified
  When finetuned on 4K-length sequences, Samba efficiently extrapolates to a 256K context length with perfect memory recall on the Passkey Retrieval task, and exhibits superior retrieval extrapolation on the challenging…
• Mamba YOLO: A Simple Baseline for Object Detection with State Space Model
  9 Jun 2024 2 repositories listed
  Our contributions are as follows: 1) We propose that the ODMamba backbone introduce a \textbf{S}tate \textbf{S}pace \textbf{M}odel (\textbf{SSM}) with linear complexity to address the quadratic complexity of…
• GrootVL: Tree Topology is All You Need in State Space Model
  4 Jun 2024 2 repositories listed Syntology ran 9 of 14 samples · 5 unverified · 14 pointer-only (licence)
  The state space models, employing recursively propagated features, demonstrate strong representation capabilities comparable to Transformer models and superior efficiency.
• Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis
  26 Mar 2024 2 repositories listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Heracles leverages a Hartely kernel-based state space model for global image information, a localized convolutional network for local details, and attention mechanisms in deeper layers for token interactions.

Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.