Browse State-of-the-Art › Multi-Object Tracking and Segmentation
Multi-Object Tracking and Segmentation
16 papers with code · 2 benchmarks · 3 datasets archive 2025-07-28
Multiple object tracking and segmentation requires detecting, tracking, and segmenting objects belonging to a set of given classes.
(Image and definition credit: Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation, NeurIPS 2021, Spotlight )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| BDD100K val (8 rows) | UNINEXT-H | Universal Instance Perception as Object Discovery and Retrieval | code | Syntology ran 3 of 4 samples · 1 unverified | Compare |
| KITTI MOTS (1 row) | EagerMOT | EagerMOT: 3D Multi-Object Tracking via Sensor Fusion | code | Syntology ran 0 of 4 samples · 4 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
3 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Most implemented papers archive 2025-07-28
16 shown of 16 papers with code (28 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.
-
12 May 2018 4 repositories listed Syntology ran 0 of 2 samples · 2 unverifiedDatasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving.
-
29 Apr 2021 3 repositories listed Syntology ran 0 of 4 samples · 4 unverifiedMulti-object tracking (MOT) enables mobile robots to perform well-informed motion planning and navigation by localizing surrounding objects in 3D space and time.
-
15 Nov 2021 2 repositories listedWe further show that D2Conv3D out-performs trivial extensions of existing dilated and deformable convolutions to 3D.
-
12 Mar 2023 1 repository listed Syntology ran 3 of 4 samples · 1 unverifiedAll instance perception tasks aim at finding certain objects specified by some queries such as category names, language expressions, and target annotations, but this complete field has been split into multiple…
-
1 Jan 2023 1 repository listedWe evaluate the proposed approach across three challenging tasks: video instance segmentation, multi-object tracking and segmentation, and video panoptic segmentation.
-
25 Sep 2022 1 repository listedMultiple existing benchmarks involve tracking and segmenting objects in video e.
-
15 Jul 2022 1 repository listedWe achieve state-of-the-art results for both tracking and segmentation in several publicly available datasets.
-
14 Jul 2022 1 repository listed Syntology ran 6 of 6 samples · 0 unverified · 1 pointer-only (licence)We present a unified method, termed Unicorn, that can simultaneously solve four tracking problems (SOT, MOT, VOS, MOTS) with a single network using the same model parameters.
-
2 Nov 2021 1 repository listed Syntology ran 3 of 4 samples · 1 unverifiedIn this paper, we present a novel method called PolyTrack for fast multi-object tracking and segmentation using bounding polygons.
-
5 Jul 2021 1 repository listed Syntology ran 6 of 17 samples · 11 unverifiedWe show how most tracking tasks can be solved within this framework, and that the same appearance model can be successfully used to obtain results that are competitive against specialised methods for most of the tasks…
-
22 Jun 2021 1 repository listed Syntology ran 0 of 5 samples · 5 unverifiedWe propose Prototypical Cross-Attention Network (PCAN), capable of leveraging rich spatio-temporal information for online multiple object tracking and segmentation.
-
1 Jan 2021 1 repository listedCurrent one-step multi-object tracking and segmentation (MOTS) methods lag behind recent two-step methods.
-
1 Jan 2021 1 repository listedIn contrast, we formulate a global method for MOTS over the space of assignments rather than detections: First, we find all top-k assignments of objects detected and segmented between any two consecutive frames and…
-
31 Aug 2020 1 repository listedOne affinity, for position and motion, is computed by using the GMPHD filter, and the other affinity, for appearance is computed by using the responses from a single object tracker such as a kernalized correlation…
-
3 Jul 2020 1 repository listedThe resulting online MOTS framework, named PointTrack, surpasses all the state-of-the-art methods including 3D tracking methods by large margins (5.
-
3 Jul 2020 1 repository listedIn this work, we present PointTrack++, an effective on-line framework for MOTS, which remarkably extends our recently proposed PointTrack framework.
Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections