Papers › Monocular Depth Estimation through Virtual-world Supervision and Real-world SfM...

Monocular Depth Estimation through Virtual-world Supervision and Real-world SfM Self-Supervision

22 Mar 2021arXiv:2103.12209archive 2025-07-28

Akhil Gurram, Ahmet Faruk Tuna, Fengyi Shen, Onay Urfalioglu, Antonio M. López

Depth information is essential for on-board perception in autonomous driving and driver assistance. Monocular depth estimation (MDE) is very appealing since it allows for appearance and depth being on direct pixelwise correspondence without further calibration. Best MDE models are based on Convolutional Neural Networks (CNNs) trained in a supervised manner, i.e., assuming pixelwise ground truth (GT). Usually, this GT is acquired at training time through a calibrated multi-modal suite of sensors. However, also using only a monocular system at training time is cheaper and more scalable. This is possible by relying on structure-from-motion (SfM) principles to generate self-supervision. Nevertheless, problems of camouflaged objects, visibility changes, static-camera intervals, textureless areas, and scale ambiguity, diminish the usefulness of such self-supervision. In this paper, we perform monocular depth estimation by virtual-world supervision (MonoDEVS) and real-world SfM self-supervision. We compensate the SfM self-supervision limitations by leveraging virtual-world images with accurate semantic and depth supervision and addressing the virtual-to-real domain gap. Our MonoDEVSNet outperforms previous MDE CNNs trained on monocular and even stereo sequences.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

HMRC-AEL/MonoDEVSNet officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Autonomous DrivingDepth EstimationMonocular Depth Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Monocular Depth Estimation KITTI Eigen split MonoDELSNet Delta < 1.25 0.969 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split MonoDELSNet Delta < 1.25^2 0.996 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split MonoDELSNet Delta < 1.25^3 0.999 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split MonoDELSNet RMSE 2.101 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split MonoDELSNet RMSE log 0.082 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split MonoDELSNet Sq Rel 0.161 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split MonoDELSNet absolute relative error 0.053 #29 of 79 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised MonoDEVSNet Delta < 1.25 0.882 #30 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised MonoDEVSNet Delta < 1.25^2 0.962 #30 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised MonoDEVSNet RMSE 4.413 #30 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised MonoDEVSNet Sq Rel 0.703 #30 of 55 Archive leaderboard report
Monocular Depth Estimation KITTI Eigen split unsupervised MonoDEVSNet absolute relative error 0.101 #30 of 55 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections