Papers › Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Prior

Occluded Human Body Capture with Self-Supervised Spatial-Temporal Motion Prior

12 Jul 2022arXiv:2207.05375archive 2025-07-28

Buzhen Huang, Yuan Shu, Jingyi Ju, Yangang Wang

Although significant progress has been achieved on monocular maker-less human motion capture in recent years, it is still hard for state-of-the-art methods to obtain satisfactory results in occlusion scenarios. There are two main reasons: the one is that the occluded motion capture is inherently ambiguous as various 3D poses can map to the same 2D observations, which always results in an unreliable estimation. The other is that no sufficient occluded human data can be used for training a robust model. To address the obstacles, our key-idea is to employ non-occluded human data to learn a joint-level spatial-temporal motion prior for occluded human with a self-supervised strategy. To further reduce the gap between synthetic and real occlusion data, we build the first 3D occluded motion dataset~(OcMotion), which can be used for both training and testing. We encode the motions in 2D maps and synthesize occlusions on non-occluded data for the self-supervised training. A spatial-temporal layer is then designed to learn joint-level correlations. The learned prior reduces the ambiguities of occlusions and is robust to diverse occlusion types, which is then adopted to assist the occluded human motion capture. Experimental results show that our method can generate accurate and coherent human motions from occluded videos with good generalization ability and runtime efficiency. The dataset and code are publicly available at \url{https://github.com/boycehbz/CHOMP}.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

boycehbz/chomp officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D Human Pose EstimationUnsupervised 3D Human Pose Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Human Pose Estimation 3DPW CHOMP MPJPE 83.7 #60 of 119 Archive leaderboard report
3D Human Pose Estimation 3DPW CHOMP MPVPE 110.1 #60 of 119 Archive leaderboard report
3D Human Pose Estimation 3DPW CHOMP PA-MPJPE 51.7 #60 of 119 Archive leaderboard report
Unsupervised 3D Human Pose Estimation Human3.6M CHOMP MPJPE 64.7 #2 of 12 Archive leaderboard report
Unsupervised 3D Human Pose Estimation Human3.6M CHOMP PA-MPJPE 40.1 #2 of 12 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections