Panoptic Segmentation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

27 leaderboard tables shown for this task, 27 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 27 until expanded.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

37 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 37 until expanded.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 257 papers with code (462 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Mask R-CNN
  20 Mar 2017 179 repositories listed Syntology ran 42 of 140 samples · 98 unverified · 23 pointer-only (licence)
  Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance.
• End-to-End Object Detection with Transformers
  26 May 2020 37 repositories listed Syntology ran 59 of 92 samples · 33 unverified · 19 pointer-only (licence)
  We present a new method that views object detection as a direct set prediction problem.
• ResNeSt: Split-Attention Networks
  19 Apr 2020 36 repositories listed Syntology ran 8 of 48 samples · 40 unverified · 23 pointer-only (licence)
  It is well known that featuremap attention and multi-path representation are important for visual recognition.
• Visual Attention Network
  20 Feb 2022 21 repositories listed Syntology ran 0 of 6 samples · 6 unverified
  In this paper, we propose a novel linear attention named large kernel attention (LKA) to enable self-adaptive and long-range correlations in self-attention while avoiding its shortcomings.
• PVT v2: Improved Baselines with Pyramid Vision Transformer
  25 Jun 2021 18 repositories listed
  We hope this work will facilitate state-of-the-art Transformer researches in computer vision.
• SOLOv2: Dynamic and Fast Instance Segmentation
  23 Mar 2020 18 repositories listed Syntology ran 15 of 38 samples · 23 unverified · 24 pointer-only (licence)
  Importantly, we take one step further by dynamically learning the mask head of the object segmenter such that the mask head is conditioned on the location.
• Panoptic Feature Pyramid Networks
  8 Jan 2019 12 repositories listed Syntology ran 7 of 12 samples · 5 unverified
  In this work, we perform a detailed study of this minimally extended version of Mask R-CNN with FPN, which we refer to as Panoptic FPN, and show it is a robust and accurate baseline for both tasks.
• Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation
  6 Jun 2022 10 repositories listed Syntology ran 11 of 13 samples · 2 unverified · 13 pointer-only (licence)
  In this paper we present Mask DINO, a unified object detection and segmentation framework.
• Focal Modulation Networks
  22 Mar 2022 9 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  For semantic segmentation with UPerNet, FocalNet base at single-scale outperforms Swin by 2.
• Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation
  22 Nov 2019 9 repositories listed Syntology ran 3 of 9 samples · 6 unverified
  In this work, we introduce Panoptic-DeepLab, a simple, strong, and fast system for panoptic segmentation, aiming to establish a solid baseline for bottom-up methods that can achieve comparable performance of two-stage…
• Panoptic Segmentation
  3 Jan 2018 9 repositories listed
  We propose and study a task we name panoptic segmentation (PS).
• Hierarchical Multi-Scale Attention for Semantic Segmentation
  21 May 2020 8 repositories listed Syntology ran 1 of 9 samples · 8 unverified · 1 pointer-only (licence)
  Multi-scale inference is commonly used to improve the results of semantic segmentation.
• CenterMask : Real-Time Anchor-Free Instance Segmentation
  15 Nov 2019 8 repositories listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  We hope that CenterMask and VoVNetV2 can serve as a solid baseline of real-time instance segmentation and backbone network for various vision tasks, respectively.
• ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
  19 Mar 2018 8 repositories listed Syntology ran 4 of 10 samples · 6 unverified
  We introduce a fast and efficient convolutional neural network, ESPNet, for semantic segmentation of high resolution images under resource constraints.
• Dilated Neighborhood Attention Transformer
  29 Sep 2022 7 repositories listed
  These models typically employ localized attention mechanisms, such as the sliding-window Neighborhood Attention (NA) or Swin Transformer's Shifted Window Self Attention.
• Masked-attention Mask Transformer for Universal Image Segmentation
  2 Dec 2021 7 repositories listed Syntology ran 2 of 8 samples · 6 unverified
  While only the semantics of each task differ, current research focuses on designing specialized architectures for each task.
• FlexiViT: One Model for All Patch Sizes
  15 Dec 2022 6 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  Vision Transformers convert images to sequences by slicing them into patches.
• Mask2Former for Video Instance Segmentation
  20 Dec 2021 6 repositories listed Syntology ran 2 of 7 samples · 5 unverified
  We find Mask2Former also achieves state-of-the-art performance on video instance segmentation without modifying the architecture, the loss or even the training pipeline.
• Fully Convolutional Networks for Panoptic Segmentation
  1 Dec 2020 6 repositories listed
  In this paper, we present a conceptually simple, strong, and efficient framework for panoptic segmentation, called Panoptic FCN.
• DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution
  3 Jun 2020 6 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  In this paper, we explore this mechanism in the backbone design for object detection.
• Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
  17 Mar 2020 5 repositories listed Syntology ran 3 of 11 samples · 8 unverified · 1 pointer-only (licence)
  In this paper, we attempt to remove this constraint by factorizing 2D self-attention into two 1D self-attentions.
• Seamless Scene Segmentation
  3 May 2019 5 repositories listed Syntology ran 1 of 2 samples · 1 unverified
  In this work we introduce a novel, CNN-based architecture that can be trained end-to-end to deliver seamless scene segmentation results.
• PanopticNDT: Efficient and Robust Panoptic Mapping
  24 Sep 2023 4 repositories listed Syntology ran 0 of 12 samples · 12 unverified
  As the application scenarios of mobile robots are getting more complex and challenging, scene understanding becomes increasingly crucial.
• OneFormer: One Transformer to Rule Universal Image Segmentation
  10 Nov 2022 4 repositories listed Syntology ran 0 of 5 samples · 5 unverified
  However, such panoptic architectures do not truly unify image segmentation because they need to be trained individually on the semantic, instance, or panoptic segmentation to achieve the best performance.
• Expediting Large-Scale Vision Transformer for Dense Prediction without Fine-tuning
  3 Oct 2022 4 repositories listed Syntology ran 4 of 7 samples · 3 unverified
  Vision transformers have recently achieved competitive results across various vision tasks but still suffer from heavy computation costs when processing a large number of tokens.
• Cityscapes-Panoptic-Parts and PASCAL-Panoptic-Parts datasets for Scene Understanding
  16 Apr 2020 4 repositories listed Syntology ran 2 of 6 samples · 4 unverified
  In this technical report, we present two novel datasets for image scene understanding.
• PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation
  3 Apr 2020 4 repositories listed Syntology ran 0 of 5 samples · 5 unverified
  Instance segmentation is an important task for scene understanding.
• BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
  12 May 2018 4 repositories listed Syntology ran 0 of 2 samples · 2 unverified
  Datasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving.
• 4D Panoptic Scene Graph Generation
  16 May 2024 3 repositories listed Syntology ran 13 of 14 samples · 1 unverified · 10 pointer-only (licence)
  To facilitate research in this new area, we build a richly annotated PSG-4D dataset consisting of 3K RGB-D videos with a total of 1M frames, each of which is labeled with 4D panoptic segmentation masks as well as…
• Panoptic Video Scene Graph Generation
  28 Nov 2023 3 repositories listed Syntology ran 11 of 11 samples · 0 unverified · 3 pointer-only (licence)
  PVSG relates to the existing video scene graph generation (VidSGG) problem, which focuses on temporal interactions between humans and objects grounded with bounding boxes in videos.

Syntology lines on 26 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.