Reasoning Segmentation

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Most implemented papers archive 2025-07-28

25 shown of 25 papers with code (52 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• VisionReasoner: Unified Visual Perception and Reasoning via Reinforcement Learning
  17 May 2025 3 repositories listed Syntology ran 1 of 15 samples · 14 unverified
  Large vision-language models exhibit inherent capabilities to handle diverse visual perception tasks.
• Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement
  9 Mar 2025 3 repositories listed
  Traditional methods for reasoning segmentation rely on supervised fine-tuning with categorical labels and simple descriptions, limiting its out-of-domain generalization and lacking explicit reasoning processes.
• Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning
  27 Jun 2025 2 repositories listed Syntology ran 15 of 23 samples · 8 unverified
  We present Seg-R1, a preliminary exploration of using reinforcement learning (RL) to enhance the pixel-level understanding and reasoning capabilities of large multimodal models (LMMs).
• VISA: Reasoning Video Object Segmentation via Large Language Models
  16 Jul 2024 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  In this paper, we introduce a new task, Reasoning Video Object Segmentation (ReasonVOS).
• LISA: Reasoning Segmentation via Large Language Model
  1 Aug 2023 2 repositories listed
  In this work, we propose a new segmentation task -- reasoning segmentation.
• OpenMaskDINO3D : Reasoning 3D Segmentation via Large Language Model
  5 Jun 2025 1 repository listed
  Although perception systems have made remarkable advancements in recent years, particularly in 2D reasoning segmentation, these systems still rely on explicit human instruction or pre-defined categories to identify…
• RVTBench: A Benchmark for Visual Reasoning Tasks
  17 May 2025 1 repository listed
  Visual reasoning, the capability to interpret visual input in response to implicit text query through multi-step reasoning, remains a challenge for deep learning models due to the lack of relevant benchmarks.
• SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding
  17 Apr 2025 1 repository listed
  The key innovations of SmartFreeEdit include:(1)the introduction of region aware tokens and a mask embedding paradigm that enhance the spatial understanding of complex scenes;(2) a reasoning segmentation pipeline…
• MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation
  18 Mar 2025 1 repository listed Syntology ran 0 of 1 samples · 1 unverified
  To address this gap, we construct a large-scale dataset called Multi-target and Multi-granularity Reasoning (MMR).
• UFO: A Unified Approach to Fine-grained Visual Perception via Open-ended Language Interface
  3 Mar 2025 1 repository listed
  Generalist models have achieved remarkable success in both language and vision-language tasks, showcasing the potential of unified modeling.
• Pixel-Level Reasoning Segmentation via Multi-turn Conversations
  13 Feb 2025 1 repository listed
  To establish a benchmark for this novel task, we build a Pixel-level ReasonIng Segmentation Dataset Based on Multi-Turn Conversations (PRIST), comprising 24k utterances from 8.
• The Devil is in Temporal Token: High Quality Video Reasoning Segmentation
  15 Jan 2025 1 repository listed
  Existing methods for Video Reasoning Segmentation rely heavily on a single special token to represent the object in the keyframe or the entire video, inadequately capturing spatial complexity and inter-frame motion.
• HyperSeg: Hybrid Segmentation Assistant with Fine-grained Visual Perceiver
  1 Jan 2025 1 repository listed
  This paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs).
• InstructSeg: Unifying Instructed Visual Segmentation with Multi-modal Large Language Models
  18 Dec 2024 1 repository listed Syntology ran 6 of 14 samples · 8 unverified
  Boosted by Multi-modal Large Language Models (MLLMs), text-guided universal segmentation models for the image and video domains have made rapid progress recently.
• HyperSeg: Towards Universal Visual Segmentation with Large Language Model
  26 Nov 2024 1 repository listed Syntology ran 7 of 17 samples · 10 unverified
  This paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs).
• One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos
  29 Sep 2024 1 repository listed Syntology ran 7 of 16 samples · 9 unverified
  We introduce VideoLISA, a video-based multimodal large language model designed to tackle the problem of language-instructed reasoning segmentation in videos.
• Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Model
  20 Sep 2024 1 repository listed
  Observing the lack of a benchmark for model training and evaluation over the MGSC task, we establish a benchmark with aligned masks and captions in multi-granularity using our customized automated annotation pipeline.
• Visual Agents as Fast and Slow Thinkers
  16 Aug 2024 1 repository listed Syntology ran 3 of 3 samples · 0 unverified
  With this novel design, we advocate a flexible system, hierarchical reasoning capabilities, and a transparent decision-making pipeline, all of which contribute to its ability to emulate human-like cognitive processes in…
• An Efficient and Effective Transformer Decoder-Based Framework for Multi-Task Visual Grounding
  2 Aug 2024 1 repository listed Syntology ran 11 of 15 samples · 4 unverified · 15 pointer-only (licence)
  In this paper, we propose an efficient and effective multi-task visual grounding (EEVG) framework based on Transformer Decoder to address this issue, which reduces the cost in both language and visual aspects.
• ViLLa: Video Reasoning Segmentation with Large Language Model
  18 Jul 2024 1 repository listed
  To bridge the gap between image and video, in this work, we propose a new video segmentation task - video reasoning segmentation.
• Reason3D: Searching and Reasoning 3D Segmentation via Large Language Model
  27 May 2024 1 repository listed Syntology ran 5 of 7 samples · 2 unverified · 7 pointer-only (licence)
  This foundational estimation facilitates a detailed, coarse-to-fine segmentation strategy that significantly enhances the precision of object identification and segmentation.
• LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning
  12 Apr 2024 1 repository listed Syntology ran 0 of 1 samples · 1 unverified · 1 pointer-only (licence)
  In this work, we delve into reasoning segmentation, a novel task that enables segmentation system to reason and interpret implicit user intention via large language model reasoning and then segment the corresponding…
• CoReS: Orchestrating the Dance of Reasoning and Segmentation
  8 Apr 2024 1 repository listed Syntology ran 5 of 13 samples · 8 unverified · 13 pointer-only (licence)
  We believe that the act of reasoning segmentation should mirror the cognitive stages of human visual search, where each step is a progressive refinement of thought toward the final object.
• LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Model
  28 Dec 2023 1 repository listed Syntology ran 4 of 14 samples · 10 unverified
  While LISA effectively bridges the gap between segmentation and large language models to enable reasoning segmentation, it poses certain limitations: unable to distinguish different instances of the target region, and…
• PixelLM: Pixel Reasoning with Large Multimodal Model
  4 Dec 2023 1 repository listed Syntology ran 3 of 4 samples · 1 unverified
  PixelLM excels across various pixel-level image reasoning and understanding tasks, outperforming well-established methods in multiple benchmarks, including MUSE, single- and multi-referring segmentation.

Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.