Papers › VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, Christian Theobalt
We present the first real-time method to capture the full global 3D skeletal pose of a human in a stable, temporally consistent manner using a single RGB camera. Our method combines a new convolutional neural network (CNN) based pose regressor with kinematic skeleton fitting. Our novel fully-convolutional pose formulation regresses 2D and 3D joint positions jointly in real time and does not require tightly cropped input frames. A real-time kinematic skeleton fitting method uses the CNN output to yield temporally stable 3D global pose reconstructions on the basis of a coherent kinematic skeleton. This makes our approach the first monocular RGB method usable in real-time applications such as 3D character control---thus far, the only monocular methods for such applications employed specialized RGB-D cameras. Our method's accuracy is quantitatively on par with the best offline 3D monocular RGB pose estimation methods. Our results are qualitatively comparable to, and sometimes better than, results from monocular RGB-D approaches, such as the Kinect. However, we show that our approach is more broadly applicable than RGB-D solutions, i.e. it works for outdoor scenes, community videos, and low quality commodity RGB cameras.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| 3D Human Pose Estimation | MPI-INF-3DHP | VNect (Augm.) | AUC | 40.4 | #82 of 108 | Archive leaderboard | report |
| 3D Human Pose Estimation | MPI-INF-3DHP | VNect (Augm.) | MPJPE | 124.7 | #82 of 108 | Archive leaderboard | report |
| 3D Human Pose Estimation | MPI-INF-3DHP | VNect (Augm.) | PCK | 76.6 | #82 of 108 | Archive leaderboard | report |
| 3D Human Pose Estimation | MPI-INF-3DHP | VNect (ResNet 50 GT) | AUC | 41.6 | #96 of 108 | Archive leaderboard | report |
| 3D Human Pose Estimation | MPI-INF-3DHP | VNect (ResNet 50 GT) | PCK | 79.4 | #96 of 108 | Archive leaderboard | report |
| Pose Estimation | Leeds Sports Poses | VNect (ResNet 50) | PCK | 79.4 | #16 of 18 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections