{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/coherentgs-sparse-novel-view-synthesis-with","title":"CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians","arxiv_id":"2403.19495","date":"2024-03-28","proceeding":null,"authors":["Avinash Paliwal","Wei Ye","Jinhui Xiong","Dmytro Kotovenko","Rakesh Ranjan","Vikas Chandra","Nima Khademi Kalantari"],"abstract":"The field of 3D reconstruction from images has rapidly evolved in the past few years, first with the introduction of Neural Radiance Field (NeRF) and more recently with 3D Gaussian Splatting (3DGS). The latter provides a significant edge over NeRF in terms of the training and inference speed, as well as the reconstruction quality. Although 3DGS works well for dense input images, the unstructured point-cloud like representation quickly overfits to the more challenging setup of extremely sparse input images (e.g., 3 images), creating a representation that appears as a jumble of needles from novel views. To address this issue, we propose regularized optimization and depth-based initialization. Our key idea is to introduce a structured Gaussian representation that can be controlled in 2D image space. We then constraint the Gaussians, in particular their position, and prevent them from moving independently during optimization. Specifically, we introduce single and multiview constraints through an implicit convolutional decoder and a total variation loss, respectively. With the coherency introduced to the Gaussians, we further constrain the optimization through a flow-based loss function. To support our regularized optimization, we propose an approach to initialize the Gaussians using monocular depth estimates at each input view. We demonstrate significant improvements compared to the state-of-the-art sparse-view NeRF-based approaches on a variety of scenes.","url_abs":"https://arxiv.org/abs/2403.19495v2","url_pdf":"https://arxiv.org/pdf/2403.19495v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"coherentgs-sparse-novel-view-synthesis-with","repo_url":"https://github.com/avinashpaliwal/coherentgs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"3d-reconstruction","task_name":"3D Reconstruction"},{"task_slug":"3dgs","task_name":"3DGS"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"nerf","task_name":"NeRF"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2403.19495","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.19495"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/avinashpaliwal/coherentgs","reach":null}],"summary":{"ran":3,"ran_honours":2,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"official":{"samples":7,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":8,"samples":[{"code_sha256_prefix":"b5772133bc86f36f","entry":"BasicPointCloud","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"b5772133bc86f36f"}},{"code_sha256_prefix":"9df2407dd5c165a9","entry":"Embedder","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"9df2407dd5c165a9"}},{"code_sha256_prefix":"5a8b1e0eb5ec2789","entry":"RGB2SH","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"5a8b1e0eb5ec2789"}},{"code_sha256_prefix":"259d976779732657","entry":"get_embedder","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"259d976779732657"}},{"code_sha256_prefix":"b488da571728b636","entry":"inverse_sigmoid","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"b488da571728b636"}},{"code_sha256_prefix":"a76d35a235d14f1d","entry":"up","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"a76d35a235d14f1d"}},{"code_sha256_prefix":"135b58bb824c06ca","entry":"GaussianModel","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"135b58bb824c06ca"}},{"code_sha256_prefix":"588ced6f51e372df","entry":"ImplicitDecoder","repo":"avinashpaliwal/coherentgs","repo_kind":"official","path":"scene/gaussian_model.py","file_url":"https://github.com/avinashpaliwal/coherentgs/blob/HEAD/scene/gaussian_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"588ced6f51e372df"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}