Papers › M4Depth: Monocular depth estimation for autonomous vehicles in unseen environments

M4Depth: Monocular depth estimation for autonomous vehicles in unseen environments

20 May 2021arXiv:2105.09847archive 2025-07-28

Michaël Fonder, Damien Ernst, Marc Van Droogenbroeck

Estimating the distance to objects is crucial for autonomous vehicles when using depth sensors is not possible. In this case, the distance has to be estimated from on-board mounted RGB cameras, which is a complex task especially in environments such as natural outdoor landscapes. In this paper, we present a new method named M4Depth for depth estimation. First, we establish a bijective relationship between depth and the visual disparity of two consecutive frames and show how to exploit it to perform motion-invariant pixel-wise depth estimation. Then, we detail M4Depth which is based on a pyramidal convolutional neural network architecture where each level refines an input disparity map estimate by using two customized cost volumes. We use these cost volumes to leverage the visual spatio-temporal constraints imposed by motion and to make the network robust for varied scenes. We benchmarked our approach both in test and generalization modes on public datasets featuring synthetic camera trajectories recorded in a wide variety of outdoor scenes. Results show that our network outperforms the state of the art on these datasets, while also performing well on a standard depth estimation benchmark. The code of our method is publicly available at https://github.com/michael-fonder/M4Depth.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

michael-fonder/M4Depth officialmentioned in papermentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Autonomous VehiclesDepth EstimationMonocular Depth Estimation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Monocular Depth Estimation Mid-Air Dataset M4Depth-d6 (VMD) Abs Rel 0.1425 #2 of 6 Archive leaderboard report
Monocular Depth Estimation Mid-Air Dataset M4Depth-d6 (VMD) RMSE 8.8641 #2 of 6 Archive leaderboard report
Monocular Depth Estimation Mid-Air Dataset M4Depth-d6 (VMD) RMSE log 0.24571 #2 of 6 Archive leaderboard report
Monocular Depth Estimation Mid-Air Dataset M4Depth-d6 (VMD) SQ Rel 3.6798 #2 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections