{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/representing-long-volumetric-video-with","title":"Representing Long Volumetric Video with Temporal Gaussian Hierarchy","arxiv_id":"2412.09608","date":"2024-12-12","proceeding":null,"authors":["Zhen Xu","Yinghao Xu","Zhiyuan Yu","Sida Peng","Jiaming Sun","Hujun Bao","Xiaowei Zhou"],"abstract":"This paper aims to address the challenge of reconstructing long volumetric videos from multi-view RGB videos. Recent dynamic view synthesis methods leverage powerful 4D representations, like feature grids or point cloud sequences, to achieve high-quality rendering results. However, they are typically limited to short (1~2s) video clips and often suffer from large memory footprints when dealing with longer videos. To solve this issue, we propose a novel 4D representation, named Temporal Gaussian Hierarchy, to compactly model long volumetric videos. Our key observation is that there are generally various degrees of temporal redundancy in dynamic scenes, which consist of areas changing at different speeds. Motivated by this, our approach builds a multi-level hierarchy of 4D Gaussian primitives, where each level separately describes scene regions with different degrees of content change, and adaptively shares Gaussian primitives to represent unchanged scene content over different temporal segments, thus effectively reducing the number of Gaussian primitives. In addition, the tree-like structure of the Gaussian hierarchy allows us to efficiently represent the scene at a particular moment with a subset of Gaussian primitives, leading to nearly constant GPU memory usage during the training or rendering regardless of the video length. Extensive experimental results demonstrate the superiority of our method over alternative methods in terms of training cost, rendering speed, and storage usage. To our knowledge, this work is the first approach capable of efficiently handling minutes of volumetric video data while maintaining state-of-the-art rendering quality. Our project page is available at: https://zju3dv.github.io/longvolcap.","url_abs":"https://arxiv.org/abs/2412.09608v1","url_pdf":"https://arxiv.org/pdf/2412.09608v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"representing-long-volumetric-video-with","repo_url":"https://github.com/dendenxu/fast-gaussian-rasterization","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":null,"task_name":"GPU"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2412.09608","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.09608"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dendenxu/fast-gaussian-rasterization","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":16},"by_repo_kind":{"official":{"samples":16,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"0f8fe090d005efe8","entry":"FORMAT_CUDART_ERROR","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/cuda_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/cuda_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f8fe090d005efe8"}},{"code_sha256_prefix":"1787a71af287b1ef","entry":"eval_shfs_4d_00","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/sh_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/sh_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1787a71af287b1ef"}},{"code_sha256_prefix":"39fe33843594b6cf","entry":"eval_shfs_4d_10","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/sh_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/sh_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"39fe33843594b6cf"}},{"code_sha256_prefix":"cc01764c972d1217","entry":"eval_shfs_4d_20","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/sh_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/sh_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cc01764c972d1217"}},{"code_sha256_prefix":"9da3d705ee4df35f","entry":"line","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/console_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/console_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9da3d705ee4df35f"}},{"code_sha256_prefix":"e70037d52fdf2b4f","entry":"load_shader_source","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/gl_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/gl_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e70037d52fdf2b4f"}},{"code_sha256_prefix":"4efe614e756cc631","entry":"normalize","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/math_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/math_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4efe614e756cc631"}},{"code_sha256_prefix":"2495f2bb0cc57462","entry":"normalize_sum","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/math_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/math_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2495f2bb0cc57462"}},{"code_sha256_prefix":"8c1aa0c6fe0ecaa2","entry":"path","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/console_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/console_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c1aa0c6fe0ecaa2"}},{"code_sha256_prefix":"5f771c4bdef631b9","entry":"point_padding","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/math_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/math_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5f771c4bdef631b9"}},{"code_sha256_prefix":"0a41221621cd471c","entry":"red","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/console_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/console_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0a41221621cd471c"}},{"code_sha256_prefix":"672c292014882d13","entry":"register_memory","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/cuda_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/cuda_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"672c292014882d13"}},{"code_sha256_prefix":"a39fb48b94ddfa97","entry":"rgb2sh0","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/gaussian_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/gaussian_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a39fb48b94ddfa97"}},{"code_sha256_prefix":"f29f26764ed7c042","entry":"sh02rgb","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/gaussian_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/gaussian_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f29f26764ed7c042"}},{"code_sha256_prefix":"9b018a4c2d6e5fb1","entry":"to_cuda","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/data_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b018a4c2d6e5fb1"}},{"code_sha256_prefix":"167e33b8202e20dc","entry":"unregister_memory","repo":"dendenxu/fast-gaussian-rasterization","repo_kind":"official","path":"fast_gauss/cuda_utils.py","file_url":"https://github.com/dendenxu/fast-gaussian-rasterization/blob/HEAD/fast_gauss/cuda_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"167e33b8202e20dc"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}