{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/3dtopia-large-text-to-3d-generation-model","title":"3DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors","arxiv_id":"2403.02234","date":"2024-03-04","proceeding":null,"authors":["Fangzhou Hong","Jiaxiang Tang","Ziang Cao","Min Shi","Tong Wu","Zhaoxi Chen","Shuai Yang","Tengfei Wang","Liang Pan","Dahua Lin","Ziwei Liu"],"abstract":"We present a two-stage text-to-3D generation system, namely 3DTopia, which generates high-quality general 3D assets within 5 minutes using hybrid diffusion priors. The first stage samples from a 3D diffusion prior directly learned from 3D data. Specifically, it is powered by a text-conditioned tri-plane latent diffusion model, which quickly generates coarse 3D samples for fast prototyping. The second stage utilizes 2D diffusion priors to further refine the texture of coarse 3D models from the first stage. The refinement consists of both latent and pixel space optimization for high-quality texture generation. To facilitate the training of the proposed system, we clean and caption the largest open-source 3D dataset, Objaverse, by combining the power of vision language models and large language models. Experiment results are reported qualitatively and quantitatively to show the performance of the proposed system. Our codes and models are available at https://github.com/3DTopia/3DTopia","url_abs":"https://arxiv.org/abs/2403.02234v2","url_pdf":"https://arxiv.org/pdf/2403.02234v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"3dtopia-large-text-to-3d-generation-model","repo_url":"https://github.com/3dtopia/3dtopia","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"3d-generation","task_name":"3D Generation"},{"task_slug":"text-to-3d","task_name":"Text to 3D"},{"task_slug":"texture-synthesis","task_name":"Texture Synthesis"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2403.02234","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.02234"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/3dtopia/3dtopia","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran_draft_wrong":2,"ran":4,"ran_violates":1,"ran_fixture":1,"ran_honours":2,"unverified":1},"by_repo_kind":{"official":{"samples":11,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9fcdaa6e423e8aa7","entry":"Normalize","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/model_2d.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/model_2d.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9fcdaa6e423e8aa7"}},{"code_sha256_prefix":"d9a1e81366d8796f","entry":"add_text","repo":"3dtopia/3dtopia","repo_kind":"official","path":"gradio_demo.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/gradio_demo.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d9a1e81366d8796f"}},{"code_sha256_prefix":"4cb732f513d69dfd","entry":"disabled_train","repo":"3dtopia/3dtopia","repo_kind":"official","path":"model/auto_regressive.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/model/auto_regressive.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4cb732f513d69dfd"}},{"code_sha256_prefix":"cb49209c125de1b4","entry":"get_timestep_embedding","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/model_2d.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/model_2d.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cb49209c125de1b4"}},{"code_sha256_prefix":"3bd7e0cdbd131fdb","entry":"make_beta_schedule","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/nn_2d.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/nn_2d.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3bd7e0cdbd131fdb"}},{"code_sha256_prefix":"0ea4e960ea54514c","entry":"make_ddim_timesteps","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/nn_2d.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/nn_2d.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"0ea4e960ea54514c"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/model_2d.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/model_2d.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"2b3fef7820d92838","entry":"normalize_vecs","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/renderer.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/renderer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2b3fef7820d92838"}},{"code_sha256_prefix":"c690dc12ba907f1b","entry":"torch_dot","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/renderer.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/renderer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c690dc12ba907f1b"}},{"code_sha256_prefix":"3b35283118777c77","entry":"transform_vectors","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/renderer.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/renderer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3b35283118777c77"}},{"code_sha256_prefix":"733817d8d0777c77","entry":"instantiate_from_config","repo":"3dtopia/3dtopia","repo_kind":"official","path":"module/nn_2d.py","file_url":"https://github.com/3dtopia/3dtopia/blob/HEAD/module/nn_2d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"733817d8d0777c77"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}