Papers › Geometric Pose Affordance: 3D Human Pose with Scene Constraints
Geometric Pose Affordance: 3D Human Pose with Scene Constraints
Zhe Wang, Liyan Chen, Shaurya Rathore, Daeyun Shin, Charless Fowlkes
Full 3D estimation of human pose from a single image remains a challenging task despite many recent advances. In this paper, we explore the hypothesis that strong prior information about scene geometry can be used to improve pose estimation accuracy. To tackle this question empirically, we have assembled a novel Geometric Pose Affordance dataset, consisting of multi-view imagery of people interacting with a variety of rich 3D environments. We utilized a commercial motion capture system to collect gold-standard estimates of pose and construct accurate geometric 3D CAD models of the scene itself. To inject prior knowledge of scene constraints into existing frameworks for pose estimation from images, we introduce a novel, view-based representation of scene geometry, a multi-layer depth map, which employs multi-hit ray tracing to concisely encode multiple surface entry and exit points along each camera view ray direction. We propose two different mechanisms for integrating multi-layer depth information pose estimation: input as encoded ray features used in lifting 2D pose to full 3D, and secondly as a differentiable loss that encourages learned models to favor geometrically consistent pose estimates. We show experimentally that these techniques can improve the accuracy of 3D pose estimates, particularly in the presence of occlusion and complex scene geometry.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Datasets
Introduced by this paper, per the archive.
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Human Pose Estimation | Geometric Pose Affordance | ResNet-F | MPJPE | 94.1 | #1 of 2 | Archive leaderboard | report |
| 3D Human Pose Estimation | Geometric Pose Affordance | ResNet-F | MPJPE (CA) | 85.6 | #1 of 2 | Archive leaderboard | report |
| 3D Human Pose Estimation | Geometric Pose Affordance | ResNet-F | MPJPE (CS) | 97.8 | #1 of 2 | Archive leaderboard | report |
| 3D Human Pose Estimation | Geometric Pose Affordance | ResNet-F | PCK | 82.9 | #1 of 2 | Archive leaderboard | report |
| 3D Human Pose Estimation | Geometric Pose Affordance | ResNet-F | PCK3D (CA) | 84.8 | #1 of 2 | Archive leaderboard | report |
| 3D Human Pose Estimation | Geometric Pose Affordance | ResNet-F | PCK3D (CS) | 82.0 | #1 of 2 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections