Datasets › Panoptic

Panoptic (CMU Panoptic Studio)

Introduced by Hanbyul Joo et al. in Panoptic Studio: A Massively Multiview System for Social Motion Capture1 Jan 2015 archive 2025-07-28

CMU Panoptic is a large scale dataset providing 3D pose annotations (1.5 millions) for multiple people engaging social activities. It contains 65 videos (5.5 hours) with multi-view annotations, but only 17 of them are in multi-person scenario and have the camera parameters.

Massively Multiview System

  • 480 VGA camera views
  • 30+ HD views
  • 10 RGB-D sensors
  • Hardware-based sync
  • Calibration
  • Interesting Scenes with Labels

Multiple people

  • Socially interacting groups
  • 3D body pose
  • 3D facial landmarks
  • Transcripts + speaker ID

Hardware setup

  • 480 VGA cameras, 640 x 480 resolution, 25 fps, synchronized among themselves using a hardware clock
  • 31 HD cameras, 1920 x 1080 resolution, 30 fps, synchronized among themselves using a hardware clock, timing aligned with VGA cameras
  • 10 Kinect Ⅱ Sensors. 1920 x 1080 (RGB), 512 x 424 (depth), 30 fps, timing aligned among themselves and other sensors 5 DLP Projectors. synchronized with HD cameras

Source: Single-Stage Multi-Person Pose Machines Image Source: http://domedb.perception.cs.cmu.edu/

Benchmarks archive 2025-07-28

All 4 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
3D Multi-Person Pose Estimation Panoptic TesseTrack Average MPJPE (mm) 7.3 TesseTrack: End-to-End Learnable Multi-Person... — 20 Compare
3D Human Pose Estimation Panoptic TesseTrack Multi-View (5 views) Average MPJPE (mm) 7.3 TesseTrack: End-to-End Learnable Multi-Person... — 9 Compare
Head Pose Estimation Panoptic WRHP-6D-Opal Geodesic Error (GE) 7.45 On the representation and methodology for wide and short... pcr-upm/opal23_headpose 6 Compare
3D Human Pose Tracking Panoptic TesseTrack 3DMOTA 94.1 TesseTrack: End-to-End Learnable Multi-Person... — 1 Compare

Papers archive 2025-07-28

29 shown of 29 papers with a leaderboard row on this dataset's benchmarks, newest first. The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset; the archive's count for this dataset is 131. The Syntology column is from Syntology's graph (read 2026-09-24), stated per sample; it is not part of any archive number.

DateSamples run Syntology
RapidPoseTriangulation: Multi-view Multi-person Whole-body Human Pose Triangulation in a Millisecond 1 1 27 Mar 2025 not harvested
On the representation and methodology for wide and short range head pose estimation 1 4 11 Jan 2024 not harvested
Instance-aware Contrastive Learning for Occluded Human Mesh Reconstruction 1 2 1 Jan 2024 not harvested
IVT: An End-to-End Instance-guided Video Transformer for 3D Pose Estimation 0 1 6 Aug 2022 not harvested
QuickPose: Real-time Multi-view Multi-person Pose Estimation in Crowded Scenes 0 1 22 Jul 2022 not harvested
Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection 1 1 22 Jul 2022 ran 0 of 4 samples (4 unverified; 4 pointer-only for licence)
Dynamic Graph Reasoning for Multi-person 3D Pose Estimation 0 1 22 Jul 2022 not harvested
VirtualPose: Learning Generalizable 3D Human Pose Models from Virtual Data 1 1 20 Jul 2022 not harvested
VTP: Volumetric Transformer for Multi-view Multi-person 3D Pose Estimation 0 1 25 May 2022 not harvested
MUG: Multi-human Graph Network for 3D Mesh Reconstruction from 2D Pose 0 1 25 May 2022 not harvested
Permutation-Invariant Relational Network for Multi-person 3D Pose Estimation 0 1 11 Apr 2022 not harvested
Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation 1 1 15 Mar 2022 ran 1 of 3 samples (2 unverified)
6D Rotation Representation For Unconstrained Head Pose Estimation 2 1 25 Feb 2022 ran 5 of 8 samples (3 unverified; 3 pointer-only for licence)
Direct Multi-view Multi-person 3D Pose Estimation 2 1 7 Nov 2021 ran 1 of 1 samples (0 unverified)
Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images 1 1 13 Sep 2021 ran 19 of 22 samples (3 unverified)
VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild 0 1 5 Aug 2021 not harvested
TesseTrack: End-to-End Learnable Multi-Person Articulated 3D Pose Tracking 0 4 16 Jun 2021 not harvested
Body Meshes as Points 1 1 6 May 2021 ran 1 of 7 samples (6 unverified)
Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo 1 1 6 Apr 2021 ran 6 of 9 samples (3 unverified)
AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild 2 1 26 Oct 2020 ran 3 of 3 samples (0 unverified; 3 pointer-only for licence)
Monocular, One-stage, Regression of Multiple 3D People 2 1 27 Aug 2020 not harvested
SMAP: Single-Shot Multi-Person Absolute 3D Pose Estimation 1 1 26 Aug 2020 not harvested
HMOR: Hierarchical Multi-Person Ordinal Relations for Monocular Multi-Person 3D Pose Estimation 0 1 1 Aug 2020 not harvested
Multi-person 3D Pose Estimation in Crowded Scenes Based on Multi-View Geometry 1 1 21 Jul 2020 ran 0 of 19 samples (19 unverified)
WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose 4 1 20 May 2020 not harvested
VoxelPose: Towards Multi-Camera 3D Human Pose Estimation in Wild Environment 2 1 13 Apr 2020 not harvested
Light3DPose: Real-time Multi-Person 3D PoseEstimation from Multiple Views 0 1 6 Apr 2020 not harvested
Compressed Volumetric Heatmaps for Multi-Person 3D Pose Estimation 1 1 1 Apr 2020 not harvested
Learnable Triangulation of Human Pose 1 1 14 May 2019 ran 1 of 17 samples (16 unverified)

Dataset loaders archive 2025-07-28

2 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Custom (non-commercial)

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • Panoptic

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections