{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-unsupervised-learning-of-generative","title":"Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesis","arxiv_id":"1912.05237","date":"2019-12-11","proceeding":"CVPR 2020 6","authors":["Yiyi Liao","Katja Schwarz","Lars Mescheder","Andreas Geiger"],"abstract":"In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are learned directly from images. However, current image synthesis models operate in the 2D domain where disentangling 3D properties such as camera viewpoint or object pose is challenging. Furthermore, they lack an interpretable and controllable representation. Our key hypothesis is that the image generation process should be modeled in 3D space as the physical world surrounding us is intrinsically three-dimensional. We define the new task of 3D controllable image synthesis and propose an approach for solving it by reasoning both in 3D space and in the 2D image domain. We demonstrate that our model is able to disentangle latent 3D factors of simple multi-object scenes in an unsupervised fashion from raw images. Compared to pure 2D baselines, it allows for synthesizing scenes that are consistent wrt. changes in viewpoint or object pose. We further evaluate various 3D representations in terms of their usefulness for this challenging task.","url_abs":"https://arxiv.org/abs/1912.05237v2","url_pdf":"https://arxiv.org/pdf/1912.05237v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-unsupervised-learning-of-generative","repo_url":"https://github.com/autonomousvision/controllable_image_synthesis","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"object","task_name":"Object"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1912.05237","atlas_url":"https://app.syntology.ai/?focus=1912.05237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1912.05237"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/autonomousvision/controllable_image_synthesis","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":4},"by_repo_kind":{"official":{"samples":4,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5bd96fb5938773d4","entry":"actvn","repo":"autonomousvision/controllable_image_synthesis","repo_kind":"official","path":"controllable_gan/models/generator_2d.py","file_url":"https://github.com/autonomousvision/controllable_image_synthesis/blob/HEAD/controllable_gan/models/generator_2d.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5bd96fb5938773d4"}},{"code_sha256_prefix":"5a9ffd330cb523fd","entry":"dis2lineseg","repo":"autonomousvision/controllable_image_synthesis","repo_kind":"official","path":"controllable_gan/render/square.py","file_url":"https://github.com/autonomousvision/controllable_image_synthesis/blob/HEAD/controllable_gan/render/square.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5a9ffd330cb523fd"}},{"code_sha256_prefix":"c9469018b548dd02","entry":"project_cuboids","repo":"autonomousvision/controllable_image_synthesis","repo_kind":"official","path":"controllable_gan/render/square.py","file_url":"https://github.com/autonomousvision/controllable_image_synthesis/blob/HEAD/controllable_gan/render/square.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c9469018b548dd02"}},{"code_sha256_prefix":"e69dfbbffbdc9e1d","entry":"project_faces","repo":"autonomousvision/controllable_image_synthesis","repo_kind":"official","path":"controllable_gan/render/square.py","file_url":"https://github.com/autonomousvision/controllable_image_synthesis/blob/HEAD/controllable_gan/render/square.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e69dfbbffbdc9e1d"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}