{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/end-to-end-optimization-of-scene-layout-1","title":"End-to-End Optimization of Scene Layout","arxiv_id":"2007.11744","date":"2020-07-23","proceeding":"CVPR 2020 6","authors":["Andrew Luo","Zhoutong Zhang","Jiajun Wu","Joshua B. Tenenbaum"],"abstract":"We propose an end-to-end variational generative model for scene layout synthesis conditioned on scene graphs. Unlike unconditional scene layout generation, we use scene graphs as an abstract but general representation to guide the synthesis of diverse scene layouts that satisfy relationships included in the scene graph. This gives rise to more flexible control over the synthesis process, allowing various forms of inputs such as scene layouts extracted from sentences or inferred from a single color image. Using our conditional layout synthesizer, we can generate various layouts that share the same structure of the input example. In addition to this conditional generation design, we also integrate a differentiable rendering module that enables layout refinement using only 2D projections of the scene. Given a depth and a semantics map, the differentiable rendering module enables optimizing over the synthesized layout to fit the given input in an analysis-by-synthesis fashion. Experiments suggest that our model achieves higher accuracy and diversity in conditional scene synthesis and allows exemplar-based scene generation from various input forms.","url_abs":"https://arxiv.org/abs/2007.11744v1","url_pdf":"https://arxiv.org/pdf/2007.11744v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"end-to-end-optimization-of-scene-layout-1","repo_url":"https://github.com/aluo-x/3D_SLN","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"indoor-scene-reconstruction","task_name":"Indoor Scene Reconstruction"},{"task_slug":"indoor-scene-synthesis","task_name":"Indoor Scene Synthesis"},{"task_slug":"layout-generation","task_name":"Layout Generation"},{"task_slug":"neural-rendering","task_name":"Neural Rendering"},{"task_slug":"scene-generation","task_name":"Scene Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2007.11744","atlas_url":"https://app.syntology.ai/?focus=2007.11744","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.11744"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aluo-x/3D_SLN","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":10},"by_repo_kind":{"official":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"5177de12ba6d4684","entry":"calculate_model_losses","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"utils.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5177de12ba6d4684"}},{"code_sha256_prefix":"314bf1bcea60acb0","entry":"compute_rel","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"utils.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"314bf1bcea60acb0"}},{"code_sha256_prefix":"bae85abff818557f","entry":"get_cam_mat","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/diff_render.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/diff_render.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bae85abff818557f"}},{"code_sha256_prefix":"130906eb042774b8","entry":"get_nonspade_norm_layer","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/SPADE_related.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/SPADE_related.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"130906eb042774b8"}},{"code_sha256_prefix":"095a900bebc6eb1e","entry":"load_json","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/misc.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/misc.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"095a900bebc6eb1e"}},{"code_sha256_prefix":"2c077e742f417c7c","entry":"load_json","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"render/render_caller.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/render/render_caller.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"2c077e742f417c7c"}},{"code_sha256_prefix":"dd4fe4836e5846da","entry":"make_mlp","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/graph.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/graph.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"dd4fe4836e5846da"}},{"code_sha256_prefix":"fa02c91e2967d067","entry":"mesh_render_func","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/diff_render.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/diff_render.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"fa02c91e2967d067"}},{"code_sha256_prefix":"3649b4be81ae0915","entry":"padded_conv","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/SPADE_related.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/SPADE_related.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3649b4be81ae0915"}},{"code_sha256_prefix":"7a9aecca4b95627c","entry":"save_pkl","repo":"aluo-x/3D_SLN","repo_kind":"official","path":"models/diff_render.py","file_url":"https://github.com/aluo-x/3D_SLN/blob/HEAD/models/diff_render.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"7a9aecca4b95627c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}