Papers › Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Tracking
Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Tracking
Whye Kit Fong, Rohit Mohan, Juana Valeria Hurtado, Lubing Zhou, Holger Caesar, Oscar Beijbom, Abhinav Valada
Panoptic scene understanding and tracking of dynamic agents are essential for robots and automated vehicles to navigate in urban environments. As LiDARs provide accurate illumination-independent geometric depictions of the scene, performing these tasks using LiDAR point clouds provides reliable predictions. However, existing datasets lack diversity in the type of urban scenes and have a limited number of dynamic object instances which hinders both learning of these tasks as well as credible benchmarking of the developed methods. In this paper, we introduce the large-scale Panoptic nuScenes benchmark dataset that extends our popular nuScenes dataset with point-wise groundtruth annotations for semantic segmentation, panoptic segmentation, and panoptic tracking tasks. To facilitate comparison, we provide several strong baselines for each of these tasks on our proposed dataset. Moreover, we analyze the drawbacks of the existing metrics for panoptic tracking and propose the novel instance-centric PAT metric that addresses the concerns. We present exhaustive experiments that demonstrate the utility of Panoptic nuScenes compared to existing datasets and make the online evaluation server available at nuScenes.org. We believe that this extension will accelerate the research of novel methods for scene understanding of dynamic urban environments.
In Syntology View this paper on Syntology: its page in Syntology's graph, with its repositories and citations.
Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
1 archive task tag without a task page not shown.
Datasets
Introduced by this paper, per the archive.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Panoptic Segmentation | Panoptic nuScenes test | (AF)2-S3Net + CenterPoint | PQ | 76.8 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes test | (AF)2-S3Net + CenterPoint | RQ | 85.4 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes test | (AF)2-S3Net + CenterPoint | SQ | 89.5 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes test | (AF)2-S3Net + CenterPoint | mIoU | 78.8 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes val | PolarSeg-Panoptic | PQ | 63.4 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes val | PolarSeg-Panoptic | RQ | 75.3 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes val | PolarSeg-Panoptic | SQ | 83.9 | #1 of 1 | Archive leaderboard | report |
| Panoptic Segmentation | Panoptic nuScenes val | PolarSeg-Panoptic | mIoU | 66.9 | #1 of 1 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections