Papers › Multi-view to Novel view: Synthesizing Novel Views with Self-Learned Confidence

Multi-view to Novel view: Synthesizing Novel Views with Self-Learned Confidence

5 Oct 2018Proceedings of the 15th European Conference on Computer Vision, 2018 10archive 2025-07-28

Shao-Hua Sun, Minyoung Huh, Yuan-Hong Liao, Ning Zhang, Joseph J. Lim

We address the task of multi-view novel view synthesis, where we are interested in synthesizing a target image with an arbitrary camera pose from given source images. We propose an end-to-end trainable framework that learns to exploit multiple viewpoints to synthesize a novel view without any 3D supervision. Specifically, our model consists of a flow prediction module and a pixel generation module to directly leverage information presented in source views as well as hallucinate missing pixels from statistical priors. To merge the predictions produced by the two modules given multi-view source images, we introduce a self-learned confidence aggregation mechanism. We evaluate our model on images rendered from 3D object models as well as real and synthesized scenes. We demonstrate that our model is able to achieve state-of-the-art results as well as progressively improve its predictions when more source images are available.

PaperPDFConference PDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Novel View Synthesis

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Novel View Synthesis KITTI Novel View Synthesis Multi-view to Novel View SSIM 0.626 #1 of 1 Archive leaderboard report
Novel View Synthesis ShapeNet Car Multi-view to Novel View SSIM 0.923 #1 of 1 Archive leaderboard report
Novel View Synthesis ShapeNet Chair Multi-view to Novel View SSIM 0.895 #1 of 1 Archive leaderboard report
Novel View Synthesis Synthia Novel View Synthesis Multi-view to Novel View SSIM 0.697 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections