Papers › Multi-view to Novel view: Synthesizing Novel Views with Self-Learned Confidence
Multi-view to Novel view: Synthesizing Novel Views with Self-Learned Confidence
Shao-Hua Sun, Minyoung Huh, Yuan-Hong Liao, Ning Zhang, Joseph J. Lim
We address the task of multi-view novel view synthesis, where we are interested in synthesizing a target image with an arbitrary camera pose from given source images. We propose an end-to-end trainable framework that learns to exploit multiple viewpoints to synthesize a novel view without any 3D supervision. Specifically, our model consists of a flow prediction module and a pixel generation module to directly leverage information presented in source views as well as hallucinate missing pixels from statistical priors. To merge the predictions produced by the two modules given multi-view source images, we introduce a self-learned confidence aggregation mechanism. We evaluate our model on images rendered from 3D object models as well as real and synthesized scenes. We demonstrate that our model is able to achieve state-of-the-art results as well as progressively improve its predictions when more source images are available.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Novel View Synthesis | KITTI Novel View Synthesis | Multi-view to Novel View | SSIM | 0.626 | #1 of 1 | Archive leaderboard | report |
| Novel View Synthesis | ShapeNet Car | Multi-view to Novel View | SSIM | 0.923 | #1 of 1 | Archive leaderboard | report |
| Novel View Synthesis | ShapeNet Chair | Multi-view to Novel View | SSIM | 0.895 | #1 of 1 | Archive leaderboard | report |
| Novel View Synthesis | Synthia Novel View Synthesis | Multi-view to Novel View | SSIM | 0.697 | #1 of 1 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections