Papers › SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning

SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning

7 Jul 2024arXiv:2407.05283archive 2025-07-28

Yi Feng, Zizhan Guo, Qijun Chen, Rui Fan

Unsupervised monocular depth estimation frameworks have shown promising performance in autonomous driving. However, existing solutions primarily rely on a simple convolutional neural network for ego-motion recovery, which struggles to estimate precise camera poses in dynamic, complicated real-world scenarios. These inaccurately estimated camera poses can inevitably deteriorate the photometric reconstruction and mislead the depth estimation networks with wrong supervisory signals. In this article, we introduce SCIPaD, a novel approach that incorporates spatial clues for unsupervised depth-pose joint learning. Specifically, a confidence-aware feature flow estimator is proposed to acquire 2D feature positional translations and their associated confidence levels. Meanwhile, we introduce a positional clue aggregator, which integrates pseudo 3D point clouds from DepthNet and 2D feature flows into homogeneous positional representations. Finally, a hierarchical positional embedding injector is proposed to selectively inject spatial clues into semantic features for robust camera pose decoding. Extensive experiments and analyses demonstrate the superior performance of our model compared to other state-of-the-art methods. Remarkably, SCIPaD achieves a reduction of 22.2% in average translation error and 34.8% in average angular error for camera pose estimation task on the KITTI Odometry dataset. Our source code is available at \url{https://mias.group/SCIPaD}.

PaperPDFCode

Code

fengyi233/SCIPaD officialpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Autonomous DrivingCamera Pose EstimationDepth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Camera Pose Estimation KITTI Odometry Benchmark SCIPaD Absolute Trajectory Error [m] 20.83 #2 of 7 Archive leaderboard report
Camera Pose Estimation KITTI Odometry Benchmark SCIPaD Average Rotational Error er[%] 3.17 #2 of 7 Archive leaderboard report
Camera Pose Estimation KITTI Odometry Benchmark SCIPaD Average Translational Error et[%] 8.63 #2 of 7 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD Delta < 1.25 0.918 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD Delta < 1.25^2 0.970 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD Delta < 1.25^3 0.985 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD RMSE 4.056 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD RMSE log 0.166 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD Resolution 640x192 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD Sq Rel 0.650 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD absolute relative error 0.090 #5 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) Delta < 1.25 0.897 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) Delta < 1.25^2 0.964 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) Delta < 1.25^3 0.983 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) Mono O #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) RMSE 4.391 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) RMSE log 0.175 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) Resolution 640x192 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) Sq Rel 0.732 #22 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised SCIPaD(M+640x192) absolute relative error 0.098 #22 of 55 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections