Papers › Cost Volume Pyramid Based Depth Inference for Multi-View Stereo

Cost Volume Pyramid Based Depth Inference for Multi-View Stereo

18 Dec 2019CVPR 2020 6arXiv:1912.08329archive 2025-07-28

Jiayu Yang, Wei Mao, Jose M. Alvarez, Miaomiao Liu

We propose a cost volume-based neural network for depth inference from multi-view images. We demonstrate that building a cost volume pyramid in a coarse-to-fine manner instead of constructing a cost volume at a fixed resolution leads to a compact, lightweight network and allows us inferring high resolution depth maps to achieve better reconstruction results. To this end, we first build a cost volume based on uniform sampling of fronto-parallel planes across the entire depth range at the coarsest resolution of an image. Then, given current depth estimate, we construct new cost volumes iteratively on the pixelwise depth residual to perform depth map refinement. While sharing similar insight with Point-MVSNet as predicting and refining depth iteratively, we show that working on cost volume pyramid can lead to a more compact, yet efficient network structure compared with the Point-MVSNet on 3D points. We further provide detailed analyses of the relation between (residual) depth sampling and image resolution, which serves as a principle for building compact cost volume pyramid. Experimental results on benchmark datasets show that our model can perform 6x faster and has similar performance as state-of-the-art methods. Code is available at https://github.com/JiayuYANG/CVP-MVSNet

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

JiayuYANG/CVP-MVSNet officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

3D ReconstructionPoint Clouds

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
3D Reconstruction DTU CVP-MVSNet Acc 0.296 #15 of 24 Archive leaderboard report
3D Reconstruction DTU CVP-MVSNet Comp 0.406 #15 of 24 Archive leaderboard report
3D Reconstruction DTU CVP-MVSNet Overall 0.351 #15 of 24 Archive leaderboard report
Point Clouds Tanks and Temples CVP-MVSNet Mean F1 (Intermediate) 54.03 #20 of 21 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections