{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/long-term-photometric-consistent-novel-view","title":"Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models","arxiv_id":"2304.10700","date":"2023-04-21","proceeding":"ICCV 2023 1","authors":["Jason J. Yu","Fereshteh Forghani","Konstantinos G. Derpanis","Marcus A. Brubaker"],"abstract":"Novel view synthesis from a single input image is a challenging task, where the goal is to generate a new view of a scene from a desired camera pose that may be separated by a large motion. The highly uncertain nature of this synthesis task due to unobserved elements within the scene (i.e. occlusion) and outside the field-of-view makes the use of generative models appealing to capture the variety of possible outputs. In this paper, we propose a novel generative model capable of producing a sequence of photorealistic images consistent with a specified camera trajectory, and a single starting image. Our approach is centred on an autoregressive conditional diffusion-based model capable of interpolating visible scene elements, and extrapolating unobserved regions in a view, in a geometrically consistent manner. Conditioning is limited to an image capturing a single camera view and the (relative) pose of the new camera view. To measure the consistency over a sequence of generated views, we introduce a new metric, the thresholded symmetric epipolar distance (TSED), to measure the number of consistent frame pairs in a sequence. While previous methods have been shown to produce high quality images and consistent semantics across pairs of views, we show empirically with our metric that they are often inconsistent with the desired camera poses. In contrast, we demonstrate that our method produces both photorealistic and view-consistent imagery.","url_abs":"https://arxiv.org/abs/2304.10700v2","url_pdf":"https://arxiv.org/pdf/2304.10700v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"long-term-photometric-consistent-novel-view","repo_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2304.10700","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.10700"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/YorkUCVIL/Photoconsistent-NVS","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5cd1926b97d76286","entry":"abs_cameras_freq_encoding","repo":"YorkUCVIL/Photoconsistent-NVS","repo_kind":"official","path":"src/utils/camera_tools.py","file_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS/blob/HEAD/src/utils/camera_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5cd1926b97d76286"}},{"code_sha256_prefix":"311b571d25fc1e2e","entry":"extract_keypoints","repo":"YorkUCVIL/Photoconsistent-NVS","repo_kind":"official","path":"src/colmap_utils.py","file_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS/blob/HEAD/src/colmap_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"311b571d25fc1e2e"}},{"code_sha256_prefix":"0441b9afe98cac2e","entry":"extract_matches","repo":"YorkUCVIL/Photoconsistent-NVS","repo_kind":"official","path":"src/colmap_utils.py","file_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS/blob/HEAD/src/colmap_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0441b9afe98cac2e"}},{"code_sha256_prefix":"f8298e1030668dc3","entry":"freq_enc","repo":"YorkUCVIL/Photoconsistent-NVS","repo_kind":"official","path":"src/utils/camera_tools.py","file_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS/blob/HEAD/src/utils/camera_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f8298e1030668dc3"}},{"code_sha256_prefix":"74f8a1934507ddd3","entry":"orb_to_blender","repo":"YorkUCVIL/Photoconsistent-NVS","repo_kind":"official","path":"dataset-data/extract-poses.py","file_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS/blob/HEAD/dataset-data/extract-poses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"74f8a1934507ddd3"}},{"code_sha256_prefix":"9aa2936fba4935ee","entry":"rel_camera_ray_encoding","repo":"YorkUCVIL/Photoconsistent-NVS","repo_kind":"official","path":"src/utils/camera_tools.py","file_url":"https://github.com/YorkUCVIL/Photoconsistent-NVS/blob/HEAD/src/utils/camera_tools.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9aa2936fba4935ee"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}