Papers › Helvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimation

Helvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimation

27 Nov 2024CVPR 2025 1arXiv:2411.18335archive 2025-07-28

Mehdi Zayene, Jannik Endres, Albias Havolli, Charles Corbière, Salim Cherkaoui, Alexandre Kontouli, Alexandre Alahi

Despite progress in stereo depth estimation, omnidirectional imaging remains underexplored, mainly due to the lack of appropriate data. We introduce Helvipad, a real-world dataset for omnidirectional stereo depth estimation, featuring 40K video frames from video sequences across diverse environments, including crowded indoor and outdoor scenes with various lighting conditions. Collected using two 360{\deg} cameras in a top-bottom setup and a LiDAR sensor, the dataset includes accurate depth and disparity labels by projecting 3D point clouds onto equirectangular images. Additionally, we provide an augmented training set with an increased label density by using depth completion. We benchmark leading stereo depth estimation models for both standard and omnidirectional images. The results show that while recent stereo methods perform decently, a challenge persists in accurately estimating depth in omnidirectional imaging. To address this, we introduce necessary adaptations to stereo models, leading to improved performance.

PaperPDFConference PDFCode

Code

vita-epfl/Helvipad officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Depth CompletionDepth EstimationOmnnidirectional Stereo Depth EstimationStereo Depth Estimation

Datasets

Introduced by this paper, per the archive.

Helvipad

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Depth-LRCE 0.388 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Depth-MAE 1.720 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Depth-MARE 0.130 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Depth-RMSE 4.297 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Disp-LRCE 0.054 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Disp-MAE 0.188 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Disp-MARE 0.146 #2 of 5 Archive leaderboard report
Omnnidirectional Stereo Depth Estimation Helvipad 360-IGEV-Stereo Disp-RMSE 0.404 #2 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections