{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/citydreamer-compositional-generative-model-of","title":"CityDreamer: Compositional Generative Model of Unbounded 3D Cities","arxiv_id":"2309.00610","date":"2023-09-01","proceeding":"CVPR 2024 1","authors":["Haozhe Xie","Zhaoxi Chen","Fangzhou Hong","Ziwei Liu"],"abstract":"3D city generation is a desirable yet challenging task, since humans are more sensitive to structural distortions in urban environments. Additionally, generating 3D cities is more complex than 3D natural scenes since buildings, as objects of the same class, exhibit a wider range of appearances compared to the relatively consistent appearance of objects like trees in natural scenes. To address these challenges, we propose \\textbf{CityDreamer}, a compositional generative model designed specifically for unbounded 3D cities. Our key insight is that 3D city generation should be a composition of different types of neural fields: 1) various building instances, and 2) background stuff, such as roads and green lands. Specifically, we adopt the bird's eye view scene representation and employ a volumetric render for both instance-oriented and stuff-oriented neural fields. The generative hash grid and periodic positional embedding are tailored as scene parameterization to suit the distinct characteristics of building instances and background stuff. Furthermore, we contribute a suite of CityGen Datasets, including OSM and GoogleEarth, which comprises a vast amount of real-world city imagery to enhance the realism of the generated 3D cities both in their layouts and appearances. CityDreamer achieves state-of-the-art performance not only in generating realistic 3D cities but also in localized editing within the generated cities.","url_abs":"https://arxiv.org/abs/2309.00610v3","url_pdf":"https://arxiv.org/pdf/2309.00610v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"citydreamer-compositional-generative-model-of","repo_url":"https://github.com/hzxie/CityDreamer","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"scene-generation","task_name":"Scene Generation"},{"task_slug":"model","task_name":"model"}],"methods":[],"datasets_introduced":[{"slug":"googleearth","name":"GoogleEarth","full_name":""},{"slug":"osm","name":"OSM","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/scene-generation-on-googleearth","task":"Scene Generation","dataset":"GoogleEarth","model":"CityDreamer","rank_in_archive_order":2,"of":5,"metrics":{"Camera Error":"0.060","Depth Error":"0.147","FID":"97.38","KID":"0.096"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2309.00610","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.00610"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hzxie/CityDreamer","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":1,"ran_draft_wrong":1,"unverified":7},"by_repo_kind":{"official":{"samples":9,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"806801bc58bb3023","entry":"collate_fn","repo":"hzxie/CityDreamer","repo_kind":"official","path":"utils/datasets.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/utils/datasets.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"806801bc58bb3023"}},{"code_sha256_prefix":"3137073275f8c21a","entry":"nonlinearity","repo":"hzxie/CityDreamer","repo_kind":"official","path":"models/vqgan.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/models/vqgan.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3137073275f8c21a"}},{"code_sha256_prefix":"93cb61d92976e7fe","entry":"affine_registration","repo":"hzxie/CityDreamer","repo_kind":"official","path":"metrics/camera_error.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/metrics/camera_error.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"93cb61d92976e7fe"}},{"code_sha256_prefix":"d200de1ccb86fa3f","entry":"get_colmap_cam_pose","repo":"hzxie/CityDreamer","repo_kind":"official","path":"metrics/camera_error.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/metrics/camera_error.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"d200de1ccb86fa3f"}},{"code_sha256_prefix":"90f9b7eddb796ec2","entry":"get_connectivity_index","repo":"hzxie/CityDreamer","repo_kind":"official","path":"metrics/urban_planning.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/metrics/urban_planning.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"90f9b7eddb796ec2"}},{"code_sha256_prefix":"b5d91bbfdb1eb2da","entry":"init_dist","repo":"hzxie/CityDreamer","repo_kind":"official","path":"utils/distributed.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/utils/distributed.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b5d91bbfdb1eb2da"}},{"code_sha256_prefix":"2d4d03c6f604240d","entry":"normalize","repo":"hzxie/CityDreamer","repo_kind":"official","path":"models/vqgan.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/models/vqgan.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"2d4d03c6f604240d"}},{"code_sha256_prefix":"45e61111a925688b","entry":"vgg16","repo":"hzxie/CityDreamer","repo_kind":"official","path":"losses/perceptual.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/losses/perceptual.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"45e61111a925688b"}},{"code_sha256_prefix":"396918e041c75412","entry":"vgg19","repo":"hzxie/CityDreamer","repo_kind":"official","path":"losses/perceptual.py","file_url":"https://github.com/hzxie/CityDreamer/blob/HEAD/losses/perceptual.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"396918e041c75412"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}