{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/voxgraf-fast-3d-aware-image-synthesis-with","title":"VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids","arxiv_id":"2206.07695","date":"2022-06-15","proceeding":null,"authors":["Katja Schwarz","Axel Sauer","Michael Niemeyer","Yiyi Liao","Andreas Geiger"],"abstract":"State-of-the-art 3D-aware generative models rely on coordinate-based MLPs to parameterize 3D radiance fields. While demonstrating impressive results, querying an MLP for every sample along each ray leads to slow rendering. Therefore, existing approaches often render low-resolution feature maps and process them with an upsampling network to obtain the final image. Albeit efficient, neural rendering often entangles viewpoint and content such that changing the camera pose results in unwanted changes of geometry or appearance. Motivated by recent results in voxel-based novel view synthesis, we investigate the utility of sparse voxel grid representations for fast and 3D-consistent generative modeling in this paper. Our results demonstrate that monolithic MLPs can indeed be replaced by 3D convolutions when combining sparse voxel grids with progressive growing, free space pruning and appropriate regularization. To obtain a compact representation of the scene and allow for scaling to higher voxel resolutions, our model disentangles the foreground object (modeled in 3D) from the background (modeled in 2D). In contrast to existing approaches, our method requires only a single forward pass to generate a full 3D scene. It hence allows for efficient rendering from arbitrary viewpoints while yielding 3D consistent results with high visual fidelity.","url_abs":"https://arxiv.org/abs/2206.07695v3","url_pdf":"https://arxiv.org/pdf/2206.07695v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"voxgraf-fast-3d-aware-image-synthesis-with","repo_url":"https://github.com/autonomousvision/voxgraf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-aware-image-synthesis","task_name":"3D-Aware Image Synthesis"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"neural-rendering","task_name":"Neural Rendering"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"}],"methods":[{"method_slug":"pruning","method_name":"Pruning"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2206.07695","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.07695"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/autonomousvision/voxgraf","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":4,"ran_draft_wrong":2,"ran":3,"unverified":9},"by_repo_kind":{"official":{"samples":18,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9cd07419f7c926f8","entry":"parse_tuple","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"dataset_tool.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/dataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":2,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9cd07419f7c926f8"}},{"code_sha256_prefix":"a2b45afa097b55b6","entry":"file_ext","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"dataset_tool.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/dataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a2b45afa097b55b6"}},{"code_sha256_prefix":"49c8102233908a49","entry":"inthroot","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"voxgraf-plenoxels/svox2/utils.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/voxgraf-plenoxels/svox2/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"49c8102233908a49"}},{"code_sha256_prefix":"1c02c1337d08c079","entry":"is_pow2","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"voxgraf-plenoxels/svox2/utils.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/voxgraf-plenoxels/svox2/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c02c1337d08c079"}},{"code_sha256_prefix":"dd1dc700e87f36cc","entry":"maybe_min","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"dataset_tool.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/dataset_tool.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dd1dc700e87f36cc"}},{"code_sha256_prefix":"d55cfd9164c67413","entry":"morton_code_3","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"voxgraf-plenoxels/svox2/utils.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/voxgraf-plenoxels/svox2/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d55cfd9164c67413"}},{"code_sha256_prefix":"d01b68a634f71551","entry":"parse_comma_separated_list","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"calc_metrics.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/calc_metrics.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d01b68a634f71551"}},{"code_sha256_prefix":"236de8614a178382","entry":"parse_range","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"gen_images.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/gen_images.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"236de8614a178382"}},{"code_sha256_prefix":"180016b9227381b1","entry":"parse_vec2","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"gen_images.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/gen_images.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"180016b9227381b1"}},{"code_sha256_prefix":"9d31d2c4cd16bb2d","entry":"ask_yes_no","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9d31d2c4cd16bb2d"}},{"code_sha256_prefix":"4085622951583da4","entry":"dense_upsample3d","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"training/networks_stylegan2_3d.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/training/networks_stylegan2_3d.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4085622951583da4"}},{"code_sha256_prefix":"2021a4f1692a03a9","entry":"denseconv3d","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"training/networks_stylegan2_3d.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/training/networks_stylegan2_3d.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2021a4f1692a03a9"}},{"code_sha256_prefix":"053fc534bc6bb989","entry":"format_time","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"053fc534bc6bb989"}},{"code_sha256_prefix":"77f4aa0649e7f404","entry":"format_time_brief","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77f4aa0649e7f404"}},{"code_sha256_prefix":"979632c2af742960","entry":"lerp","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"training/loss.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/training/loss.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"979632c2af742960"}},{"code_sha256_prefix":"6a0f2095bdd516ab","entry":"parse_tuple","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"gen_images.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/gen_images.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6a0f2095bdd516ab"}},{"code_sha256_prefix":"1cc7eac6b576629c","entry":"sample_line","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"gen_video.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/gen_video.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1cc7eac6b576629c"}},{"code_sha256_prefix":"b3cd891e5e082f92","entry":"sample_oval","repo":"autonomousvision/voxgraf","repo_kind":"official","path":"gen_video.py","file_url":"https://github.com/autonomousvision/voxgraf/blob/HEAD/gen_video.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b3cd891e5e082f92"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}