{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/it3d-improved-text-to-3d-generation-with","title":"IT3D: Improved Text-to-3D Generation with Explicit View Synthesis","arxiv_id":"2308.11473","date":"2023-08-22","proceeding":null,"authors":["YiWen Chen","Chi Zhang","Xiaofeng Yang","Zhongang Cai","Gang Yu","Lei Yang","Guosheng Lin"],"abstract":"Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as over-saturation, inadequate detailing, and unrealistic outputs. This study presents a novel strategy that leverages explicitly synthesized multi-view images to address these issues. Our approach involves the utilization of image-to-image pipelines, empowered by LDMs, to generate posed high-quality images based on the renderings of coarse 3D models. Although the generated images mostly alleviate the aforementioned issues, challenges such as view inconsistency and significant content variance persist due to the inherent generative nature of large diffusion models, posing extensive difficulties in leveraging these images effectively. To overcome this hurdle, we advocate integrating a discriminator alongside a novel Diffusion-GAN dual training strategy to guide the training of 3D models. For the incorporated discriminator, the synthesized multi-view images are considered real data, while the renderings of the optimized 3D models function as fake data. We conduct a comprehensive set of experiments that demonstrate the effectiveness of our method over baseline approaches.","url_abs":"https://arxiv.org/abs/2308.11473v1","url_pdf":"https://arxiv.org/pdf/2308.11473v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"it3d-improved-text-to-3d-generation-with","repo_url":"https://github.com/buaacyw/it3d-text-to-3d","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"3d-generation","task_name":"3D Generation"},{"task_slug":"text-to-3d","task_name":"Text to 3D"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.11473","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.11473"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/buaacyw/it3d-text-to-3d","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":3,"ran_draft_wrong":1,"unverified":6},"by_repo_kind":{"official":{"samples":10,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":10,"samples":[{"code_sha256_prefix":"fb07704f3a4c0430","entry":"biased_softplus","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"activation.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/activation.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fb07704f3a4c0430"}},{"code_sha256_prefix":"4951a3c8f9f7bc45","entry":"get_encoder","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"encoding.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/encoding.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"4951a3c8f9f7bc45"}},{"code_sha256_prefix":"670fe68b890c9792","entry":"normalize_2nd_moment","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"nerf/network_grid.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/nerf/network_grid.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"670fe68b890c9792"}},{"code_sha256_prefix":"f2952bdbf9446f24","entry":"unflatten_with_named_tensor","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"dpt.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/dpt.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f2952bdbf9446f24"}},{"code_sha256_prefix":"9d31d2c4cd16bb2d","entry":"ask_yes_no","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"9d31d2c4cd16bb2d"}},{"code_sha256_prefix":"053fc534bc6bb989","entry":"format_time","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"053fc534bc6bb989"}},{"code_sha256_prefix":"77f4aa0649e7f404","entry":"format_time_brief","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"dnnlib/util.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/dnnlib/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"77f4aa0649e7f404"}},{"code_sha256_prefix":"e243c3c7c7f3110a","entry":"forward_flex","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"dpt.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/dpt.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e243c3c7c7f3110a"}},{"code_sha256_prefix":"47594f898e209e22","entry":"forward_vit","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"dpt.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/dpt.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"47594f898e209e22"}},{"code_sha256_prefix":"b7f0e912438abda8","entry":"poisson_mesh_reconstruction","repo":"buaacyw/it3d-text-to-3d","repo_kind":"official","path":"meshutils.py","file_url":"https://github.com/buaacyw/it3d-text-to-3d/blob/HEAD/meshutils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b7f0e912438abda8"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}