Datasets › Panoptic

Panoptic (CMU Panoptic Studio)

Introduced by Hanbyul Joo et al. in Panoptic Studio: A Massively Multiview System for Social Motion Capture1 Jan 2015 archive 2025-07-28

CMU Panoptic is a large scale dataset providing 3D pose annotations (1.5 millions) for multiple people engaging social activities. It contains 65 videos (5.5 hours) with multi-view annotations, but only 17 of them are in multi-person scenario and have the camera parameters.

Massively Multiview System

  • 480 VGA camera views
  • 30+ HD views
  • 10 RGB-D sensors
  • Hardware-based sync
  • Calibration
  • Interesting Scenes with Labels

Multiple people

  • Socially interacting groups
  • 3D body pose
  • 3D facial landmarks
  • Transcripts + speaker ID

Hardware setup

  • 480 VGA cameras, 640 x 480 resolution, 25 fps, synchronized among themselves using a hardware clock
  • 31 HD cameras, 1920 x 1080 resolution, 30 fps, synchronized among themselves using a hardware clock, timing aligned with VGA cameras
  • 10 Kinect Ⅱ Sensors. 1920 x 1080 (RGB), 512 x 424 (depth), 30 fps, timing aligned among themselves and other sensors 5 DLP Projectors. synchronized with HD cameras

Source: Single-Stage Multi-Person Pose Machines Image Source: http://domedb.perception.cs.cmu.edu/

Benchmarks archive 2025-07-28

All 4 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Syntology 1 newer paper was judged to report on this dataset's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): 3D Multi-Person Pose Estimation · Panoptic (1 judged, 0 placed), 3D Human Pose Estimation · Panoptic (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

First row (archive order)PaperCode
3D Multi-Person Pose Estimation Panoptic TesseTrack Average MPJPE (mm) 7.3 TesseTrack: End-to-End Learnable Multi-Person... — 20 Compare
3D Human Pose Estimation Panoptic TesseTrack Multi-View (5 views) Average MPJPE (mm) 7.3 TesseTrack: End-to-End Learnable Multi-Person... — 9 Compare
Head Pose Estimation Panoptic WRHP-6D-Opal Geodesic Error (GE) 7.45 On the representation and methodology for wide and short... pcr-upm/opal23_headpose 6 Compare
3D Human Pose Tracking Panoptic TesseTrack 3DMOTA 94.1 TesseTrack: End-to-End Learnable Multi-Person... — 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 29 · with a code link: 19 · where Syntology ran a sample: 10 (9 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (10 of 29 with a benchmark row: 9 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 29 of 29 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 131. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
RapidPoseTriangulation: Multi-view Multi-person Whole-body Human Pose Triangulation in a Millisecond 1 1 27 Mar 2025 not harvested
On the representation and methodology for wide and short range head pose estimation 1 4 11 Jan 2024 not harvested
Instance-aware Contrastive Learning for Occluded Human Mesh Reconstruction 1 2 1 Jan 2024 not harvested
IVT: An End-to-End Instance-guided Video Transformer for 3D Pose Estimation 0 1 6 Aug 2022 not harvested
Dynamic Graph Reasoning for Multi-person 3D Pose Estimation 0 1 22 Jul 2022 not harvested
Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection 1 1 22 Jul 2022 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (4 pointer-only for licence)
QuickPose: Real-time Multi-view Multi-person Pose Estimation in Crowded Scenes 0 1 22 Jul 2022 not harvested
VirtualPose: Learning Generalizable 3D Human Pose Models from Virtual Data 1 1 20 Jul 2022 not harvested
MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Pose 0 1 25 May 2022 not harvested
VTP: Volumetric Transformer for Multi-view Multi-person 3D Pose Estimation 0 1 25 May 2022 not harvested
Permutation-Invariant Relational Network for Multi-person 3D Pose Estimation 0 1 11 Apr 2022 not harvested
Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation 1 1 15 Mar 2022 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified
6D Rotation Representation For Unconstrained Head Pose Estimation 2 1 25 Feb 2022 official (archive's flag): 5 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (4 pointer-only for licence)
Direct Multi-view Multi-person 3D Pose Estimation 2 1 7 Nov 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images 1 1 13 Sep 2021 official: no sample here; runs from other or unrecorded repositories · 19 ran (of which 8 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 7 where Syntology's instrument failed) · 3 unverified
VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild 0 1 5 Aug 2021 not harvested
TesseTrack: End-to-End Learnable Multi-Person Articulated 3D Pose Tracking 0 4 16 Jun 2021 not harvested
Body Meshes as Points 1 1 6 May 2021 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo 1 1 6 Apr 2021 official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified
AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild 2 1 26 Oct 2020 official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Monocular, One-stage, Regression of Multiple 3D People 2 1 27 Aug 2020 not harvested
SMAP: Single-Shot Multi-Person Absolute 3D Pose Estimation 1 1 26 Aug 2020 not harvested
HMOR: Hierarchical Multi-Person Ordinal Relations for Monocular Multi-Person 3D Pose Estimation 0 1 1 Aug 2020 not harvested
Multi-person 3D Pose Estimation in Crowded Scenes Based on Multi-View Geometry 1 1 21 Jul 2020 official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose 4 1 20 May 2020 not harvested
VoxelPose: Towards Multi-Camera 3D Human Pose Estimation in Wild Environment 2 1 13 Apr 2020 not harvested
Light3DPose: Real-time Multi-Person 3D PoseEstimation from Multiple Views 0 1 6 Apr 2020 not harvested
Compressed Volumetric Heatmaps for Multi-Person 3D Pose Estimation 1 1 1 Apr 2020 not harvested
Learnable Triangulation of Human Pose 1 1 14 May 2019 16 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 0 violated, 15 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)

Dataset loaders archive 2025-07-28

2 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Custom (non-commercial)

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • Panoptic

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections