Video Segmentation

Benchmarks archive 2025-07-28

1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

12 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

3 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 160 papers with code (388 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• SAM 2: Segment Anything in Images and Videos
  1 Aug 2024 11 repositories listed Syntology ran 28 of 49 samples · 21 unverified
  We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos.
• One-Shot Video Object Segmentation
  16 Nov 2016 8 repositories listed
  This paper tackles the task of semi-supervised video object segmentation, i.
• Mask2Former for Video Instance Segmentation
  20 Dec 2021 6 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  We find Mask2Former also achieves state-of-the-art performance on video instance segmentation without modifying the architecture, the loss or even the training pipeline.
• GraphEcho: Graph-Driven Unsupervised Domain Adaptation for Echocardiogram Video Segmentation
  20 Sep 2023 4 repositories listed
  This paper studies the unsupervised domain adaption (UDA) for echocardiogram video segmentation, where the goal is to generalize the model trained on the source domain to other unlabelled target domains.
• CCNet: Criss-Cross Attention for Semantic Segmentation
  28 Nov 2018 4 repositories listed Syntology ran 9 of 14 samples · 5 unverified
  Compared with the non-local block, the proposed recurrent criss-cross attention module requires 11x less GPU memory usage.
• YouTube-VOS: Sequence-to-Sequence Video Object Segmentation
  3 Sep 2018 4 repositories listed
  End-to-end sequential learning to explore spatial-temporal features for video segmentation is largely limited by the scale of available video segmentation datasets, i.
• DVIS-DAQ: Improving Video Segmentation via Dynamic Anchor Queries
  29 Mar 2024 3 repositories listed Syntology ran 1 of 5 samples · 4 unverified · 3 pointer-only (licence)
  Modern video segmentation methods adopt object queries to perform inter-frame association and demonstrate satisfactory performance in tracking continuously appearing objects despite large-scale motion and transient…
• EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relations
  26 Sep 2022 3 repositories listed Syntology ran 7 of 7 samples · 0 unverified · 7 pointer-only (licence)
  VISOR annotates videos from EPIC-KITCHENS, which comes with a new set of challenges not encountered in current video segmentation datasets.
• Physarum Powered Differentiable Linear Programming Layers and Applications
  30 Apr 2020 3 repositories listed
  We describe our development and show the use of our solver in a video segmentation task and meta-learning for few-shot learning.
• Video Object Segmentation with Re-identification
  1 Aug 2017 3 repositories listed
  Specifically, our Video Object Segmentation with Re-identification (VS-ReID) model includes a mask propagation module and a ReID module.
• Underwater Camouflaged Object Tracking Meets Vision-Language SAM2
  25 Sep 2024 2 repositories listed
  To bridge this gap, we take a step forward by proposing the first large-scale multi-modal underwater camouflaged object tracking dataset, namely UW-COT220.
• VISA: Reasoning Video Object Segmentation via Large Language Models
  16 Jul 2024 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  In this paper, we introduce a new task, Reasoning Video Object Segmentation (ReasonVOS).
• PVUW 2024 Challenge on Complex Video Understanding: Methods and Results
  24 Jun 2024 2 repositories listed
  Moreover, we provide a new motion expression guided video segmentation dataset MeViS to study the natural language-guided video understanding in complex environments.
• A Simple Video Segmenter by Tracking Objects Along Axial Trajectories
  30 Nov 2023 2 repositories listed
  In this work, we present Axial-VS, a general and simple framework that enhances video segmenters by tracking objects along axial trajectories.
• XMem++: Production-level Video Segmentation From Few Annotated Frames
  29 Jul 2023 2 repositories listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  Despite advancements in user-guided video segmentation, extracting complex objects consistently for highly complex scenes is still a labor-intensive task, especially for production.
• Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance Segmentation
  22 Feb 2023 2 repositories listed
  This paper presents a deep learning framework for medical video segmentation.
• RankSeg: Adaptive Pixel Classification with Image Category Ranking for Segmentation
  8 Mar 2022 2 repositories listed Syntology ran 2 of 11 samples · 9 unverified
  Given an input image or video, our framework first conducts multi-label classification over the complete label, then sorts the complete label and selects a small subset according to their class confidence scores.
• D2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videos
  15 Nov 2021 2 repositories listed
  We further show that D2Conv3D out-performs trivial extensions of existing dilated and deformable convolutions to 3D.
• AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic Segmentation
  24 Oct 2021 2 repositories listed
  Since inconsistency mainly arises from the model's uncertainty in its output, we propose an adaptation scheme where the model learns from its own segmentation decisions as it streams a video, which allows producing more…
• Generic Event Boundary Detection: A Benchmark for Event Segmentation
  26 Jan 2021 2 repositories listed
  This paper presents a novel task together with a new benchmark for detecting generic, taxonomy-free event boundaries that segment a whole video into chunks.
• TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation
  12 Oct 2020 2 repositories listed Syntology ran 6 of 6 samples · 0 unverified · 3 pointer-only (licence)
  Sign language translation (SLT) aims to interpret sign video sequences into text-based natural language sentences.
• Temporal Aggregate Representations for Long-Range Video Understanding
  1 Jun 2020 2 repositories listed
  Future prediction, especially in long-range videos, requires reasoning from current and past observations.
• Rethinking the Evaluation of Video Summaries
  27 Mar 2019 2 repositories listed Syntology ran 0 of 1 samples · 1 unverified
  Video summarization is a technique to create a short skim of the original video while preserving the main stories/content.
• Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and Grounder
  28 Jun 2025 1 repository listed
  Existing video segmenter and grounder approaches, exemplified by Sa2VA, directly fuse features within segmentation models.
• SAM-I2V: Upgrading SAM to Support Promptable Video Segmentation with Less than 0.2% Training Cost
  2 Jun 2025 1 repository listed Syntology ran 0 of 2 samples · 2 unverified
  In this paper, we introduce SAM-I2V, an effective image-to-video upgradation method for cultivating a promptable video segmentation (PVS) model.
• OmniFall: A Unified Staged-to-Wild Benchmark for Human Fall Detection
  26 May 2025 1 repository listed
  Current video-based fall detection research mostly relies on small, staged datasets with significant domain biases concerning background, lighting, and camera setup resulting in unknown real-world performance.
• ThinkVideo: High-Quality Reasoning Video Segmentation with Chain of Thoughts
  24 May 2025 1 repository listed
  Reasoning Video Object Segmentation is a challenging task, which generates a mask sequence from an input video and an implicit, complex text query.
• Unlocking the Power of SAM 2 for Few-Shot Segmentation
  20 May 2025 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  A simple idea is to encode support foreground (FG) features as memory, with which query FG features are matched and fused.
• TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action
  2 May 2025 1 repository listed
  We propose TEMPURA (Temporal Event Masked Prediction and Understanding for Reasoning in Action), a two-stage training framework that enhances video temporal understanding.
• DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistency
  16 Apr 2025 1 repository listed
  In this work, we propose the Dual Consistency SAM (DC-SAM) method based on prompt-tuning to adapt SAM and SAM2 for in-context segmentation of both images and videos.

Syntology lines on 12 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.