{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/text-to-3d-using-gaussian-splatting","title":"Text-to-3D using Gaussian Splatting","arxiv_id":"2309.16585","date":"2023-09-28","proceeding":"CVPR 2024 1","authors":["Zilong Chen","Feng Wang","Yikai Wang","Huaping Liu"],"abstract":"Automatic text-to-3D generation that combines Score Distillation Sampling (SDS) with the optimization of volume rendering has achieved remarkable progress in synthesizing realistic 3D objects. Yet most existing text-to-3D methods by SDS and volume rendering suffer from inaccurate geometry, e.g., the Janus issue, since it is hard to explicitly integrate 3D priors into implicit 3D representations. Besides, it is usually time-consuming for them to generate elaborate 3D models with rich colors. In response, this paper proposes GSGEN, a novel method that adopts Gaussian Splatting, a recent state-of-the-art representation, to text-to-3D generation. GSGEN aims at generating high-quality 3D objects and addressing existing shortcomings by exploiting the explicit nature of Gaussian Splatting that enables the incorporation of 3D prior. Specifically, our method adopts a progressive optimization strategy, which includes a geometry optimization stage and an appearance refinement stage. In geometry optimization, a coarse representation is established under 3D point cloud diffusion prior along with the ordinary 2D SDS optimization, ensuring a sensible and 3D-consistent rough shape. Subsequently, the obtained Gaussians undergo an iterative appearance refinement to enrich texture details. In this stage, we increase the number of Gaussians by compactness-based densification to enhance continuity and improve fidelity. With these designs, our approach can generate 3D assets with delicate details and accurate geometry. Extensive evaluations demonstrate the effectiveness of our method, especially for capturing high-frequency components. Our code is available at https://github.com/gsgen3d/gsgen","url_abs":"https://arxiv.org/abs/2309.16585v4","url_pdf":"https://arxiv.org/pdf/2309.16585v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"text-to-3d-using-gaussian-splatting","repo_url":"https://github.com/gsgen3d/gsgen","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-generation","task_name":"3D Generation"},{"task_slug":"text-to-3d","task_name":"Text to 3D"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2309.16585","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.16585"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/gsgen3d/gsgen","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":6,"unverified":3},"by_repo_kind":{"official":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"df8c9b471484cad6","entry":"alpha_center_anealing_init","repo":"gsgen3d/gsgen","repo_kind":"official","path":"gs/initialize.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/gs/initialize.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"df8c9b471484cad6"}},{"code_sha256_prefix":"8f894a708f8936ec","entry":"alpha_trunc_init","repo":"gsgen3d/gsgen","repo_kind":"official","path":"gs/initialize.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/gs/initialize.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8f894a708f8936ec"}},{"code_sha256_prefix":"547eacc3ba260181","entry":"depth_loss","repo":"gsgen3d/gsgen","repo_kind":"official","path":"utils/loss.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/utils/loss.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"547eacc3ba260181"}},{"code_sha256_prefix":"8572552b478ba17c","entry":"get_c2w_from_up_and_look_at","repo":"gsgen3d/gsgen","repo_kind":"official","path":"gs/debug.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/gs/debug.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8572552b478ba17c"}},{"code_sha256_prefix":"da4758eff656aed9","entry":"jacobian","repo":"gsgen3d/gsgen","repo_kind":"official","path":"gs/renderer.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/gs/renderer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"da4758eff656aed9"}},{"code_sha256_prefix":"3b3ae818c2d98bf9","entry":"step_check","repo":"gsgen3d/gsgen","repo_kind":"official","path":"gs/renderer.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/gs/renderer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3b3ae818c2d98bf9"}},{"code_sha256_prefix":"5cb4b7b53fae01f5","entry":"cov_init","repo":"gsgen3d/gsgen","repo_kind":"official","path":"gs/initialize.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/gs/initialize.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5cb4b7b53fae01f5"}},{"code_sha256_prefix":"994713b1838add46","entry":"get_image_loss","repo":"gsgen3d/gsgen","repo_kind":"official","path":"utils/loss.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/utils/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"994713b1838add46"}},{"code_sha256_prefix":"777d7588f77beee4","entry":"get_loss_fn","repo":"gsgen3d/gsgen","repo_kind":"official","path":"utils/loss.py","file_url":"https://github.com/gsgen3d/gsgen/blob/HEAD/utils/loss.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"777d7588f77beee4"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}