{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/splatfields-neural-gaussian-splats-for-sparse","title":"SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction","arxiv_id":"2409.11211","date":"2024-09-17","proceeding":null,"authors":["Marko Mihajlovic","Sergey Prokudin","Siyu Tang","Robert Maier","Federica Bogo","Tony Tung","Edmond Boyer"],"abstract":"Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method, gaining popularity due to its impressive reconstruction quality, real-time rendering capabilities, and compatibility with widely used visualization tools. However, the method requires a substantial number of input views to achieve high-quality scene reconstruction, introducing a significant practical bottleneck. This challenge is especially severe in capturing dynamic scenes, where deploying an extensive camera array can be prohibitively costly. In this work, we identify the lack of spatial autocorrelation of splat features as one of the factors contributing to the suboptimal performance of the 3DGS technique in sparse reconstruction settings. To address the issue, we propose an optimization strategy that effectively regularizes splat features by modeling them as the outputs of a corresponding implicit neural field. This results in a consistent enhancement of reconstruction quality across various scenarios. Our approach effectively handles static and dynamic cases, as demonstrated by extensive testing across different setups and scene complexities.","url_abs":"https://arxiv.org/abs/2409.11211v1","url_pdf":"https://arxiv.org/pdf/2409.11211v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"splatfields-neural-gaussian-splats-for-sparse","repo_url":"https://github.com/markomih/splatfields","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3dgs","task_name":"3DGS"},{"task_slug":"4d-reconstruction","task_name":"4D reconstruction"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.11211","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.11211"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/markomih/splatfields","reach":null}],"summary":{"ran":4,"ran_fixture":1,"ran_honours":5,"ran_draft_wrong":2,"unverified":7},"by_repo_kind":{"listed":{"samples":18,"ran":11,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":19,"samples":[{"code_sha256_prefix":"e61cc7bddc7d86e5","entry":"Embedder","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e61cc7bddc7d86e5"}},{"code_sha256_prefix":"ff83d06e72a107a2","entry":"Linear","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ff83d06e72a107a2"}},{"code_sha256_prefix":"08438c622b9a2549","entry":"Sine","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"08438c622b9a2549"}},{"code_sha256_prefix":"a10256972809fc78","entry":"SirenMLP","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a10256972809fc78"}},{"code_sha256_prefix":"8bec3035faa583da","entry":"exp_so3","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8bec3035faa583da"}},{"code_sha256_prefix":"5097b2d841c17f14","entry":"from_homogenous","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5097b2d841c17f14"}},{"code_sha256_prefix":"8d68829e9ebe344d","entry":"get_embedder","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8d68829e9ebe344d"}},{"code_sha256_prefix":"7325f65ee1e29543","entry":"get_expon_lr_func","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7325f65ee1e29543"}},{"code_sha256_prefix":"3af2cb1046724986","entry":"init_dct_basis","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3af2cb1046724986"}},{"code_sha256_prefix":"c1e505eec9aae423","entry":"searchForMaxIteration","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"c1e505eec9aae423"}},{"code_sha256_prefix":"12e2c2cbe5064e7b","entry":"skew","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"12e2c2cbe5064e7b"}},{"code_sha256_prefix":"d435e31a56bcb01d","entry":"to_homogenous","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"d435e31a56bcb01d"}},{"code_sha256_prefix":"46ae9697f6cb588d","entry":"FlowHead","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"46ae9697f6cb588d"}},{"code_sha256_prefix":"8e0bd50736c1783b","entry":"GeneralMLP","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8e0bd50736c1783b"}},{"code_sha256_prefix":"ceb4d941a3940ae6","entry":"SplatFields","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ceb4d941a3940ae6"}},{"code_sha256_prefix":"c83e03b69ec8e76a","entry":"SplatFieldsModel","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c83e03b69ec8e76a"}},{"code_sha256_prefix":"e79d60c41a96e8e9","entry":"exp_se3","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e79d60c41a96e8e9"}},{"code_sha256_prefix":"a99a761118ab28bc","entry":"rp_to_se3","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a99a761118ab28bc"}},{"code_sha256_prefix":"e4bf8d7bbc32d686","entry":"scaled_exp_se3","repo":"markomih/splatfields","repo_kind":"listed","path":"scene/deform_model.py","file_url":"https://github.com/markomih/splatfields/blob/HEAD/scene/deform_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e4bf8d7bbc32d686"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}