Papers › Towards Robust and Smooth 3D Multi-Person Pose Estimation from Monocular Videos in the Wild

Towards Robust and Smooth 3D Multi-Person Pose Estimation from Monocular Videos in the Wild

15 Sep 2023ICCV 2023 1arXiv:2309.08644archive 2025-07-28

Sungchan Park, Eunyi You, Inhoe Lee, Joonseok Lee

3D pose estimation is an invaluable task in computer vision with various practical applications. Especially, 3D pose estimation for multi-person from a monocular video (3DMPPE) is particularly challenging and is still largely uncharted, far from applying to in-the-wild scenarios yet. We pose three unresolved issues with the existing methods: lack of robustness on unseen views during training, vulnerability to occlusion, and severe jittering in the output. As a remedy, we propose POTR-3D, the first realization of a sequence-to-sequence 2D-to-3D lifting model for 3DMPPE, powered by a novel geometry-aware data augmentation strategy, capable of generating unbounded data with a variety of views while caring about the ground plane and occlusions. Through extensive experiments, we verify that the proposed model and data augmentation robustly generalizes to diverse unseen views, robustly recovers the poses against heavy occlusions, and reliably generates more natural and smoother outputs. The effectiveness of our approach is verified not only by achieving the state-of-the-art performance on public benchmarks, but also by qualitative results on more challenging in-the-wild videos. Demo videos are available at https://www.youtube.com/@potr3d.

PaperPDFConference PDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Multi-Person Pose Estimation3D Multi-Person Pose Estimation (absolute)3D Multi-Person Pose Estimation (root-relative)3D Pose EstimationData AugmentationMulti-Person Pose EstimationPose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Multi-Person Pose Estimation (absolute) MuPoTS-3D POTR-3D 3DPCK 50.9 #1 of 14 Archive leaderboard report
3D Multi-Person Pose Estimation (root-relative) MuPoTS-3D POTR-3D 3DPCK 83.7 #8 of 20 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections