{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/plan2scene-converting-floorplans-to-3d-scenes","title":"Plan2Scene: Converting Floorplans to 3D Scenes","arxiv_id":"2106.05375","date":"2021-06-09","proceeding":"CVPR 2021 1","authors":["Madhawa Vidanapathirana","Qirui Wu","Yasutaka Furukawa","Angel X. Chang","Manolis Savva"],"abstract":"We address the task of converting a floorplan and a set of associated photos of a residence into a textured 3D mesh model, a task which we call Plan2Scene. Our system 1) lifts a floorplan image to a 3D mesh model; 2) synthesizes surface textures based on the input photos; and 3) infers textures for unobserved surfaces using a graph neural network architecture. To train and evaluate our system we create indoor surface texture datasets, and augment a dataset of floorplans and photos from prior work with rectified surface crops and additional annotations. Our approach handles the challenge of producing tileable textures for dominant surfaces such as floors, walls, and ceilings from a sparse set of unaligned photos that only partially cover the residence. Qualitative and quantitative evaluations show that our system produces realistic 3D interior models, outperforming baseline approaches on a suite of texture quality metrics and as measured by a holistic user study.","url_abs":"https://arxiv.org/abs/2106.05375v1","url_pdf":"https://arxiv.org/pdf/2106.05375v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"plan2scene-converting-floorplans-to-3d-scenes","repo_url":"https://github.com/3dlg-hcvc/plan2scene","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"graph-neural-network","task_name":"Graph Neural Network"},{"task_slug":"plan2scene","task_name":"Plan2Scene"}],"methods":[{"method_slug":"graph-neural-network","method_name":"Graph Neural Network"}],"datasets_introduced":[{"slug":"rent3d-1","name":"Rent3D++","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/plan2scene-on-rent3d","task":"Plan2Scene","dataset":"Rent3D++","model":"Synth (CVPR 2021 version)","rank_in_archive_order":1,"of":1,"metrics":{"COLOR (All Surfaces)":"0.591","FID (All Surfaces)":"196.2","FREQ (All Surfaces)":"0.034","SUBS (All Surfaces)":"0.392","TILE (All Surfaces)":"17.6"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2106.05375","atlas_url":"https://app.syntology.ai/?focus=2106.05375","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.05375"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/3dlg-hcvc/plan2scene","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":3},"by_repo_kind":{"official":{"samples":3,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1e4082d40b32978e","entry":"get_least_key","repo":"3dlg-hcvc/plan2scene","repo_kind":"official","path":"code/src/plan2scene/crop_select/util.py","file_url":"https://github.com/3dlg-hcvc/plan2scene/blob/HEAD/code/src/plan2scene/crop_select/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1e4082d40b32978e"}},{"code_sha256_prefix":"927270063dc77461","entry":"get_transform","repo":"3dlg-hcvc/plan2scene","repo_kind":"official","path":"code/src/plan2scene/house_gen/geom_util.py","file_url":"https://github.com/3dlg-hcvc/plan2scene/blob/HEAD/code/src/plan2scene/house_gen/geom_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"927270063dc77461"}},{"code_sha256_prefix":"70aca5f5e4b4cf00","entry":"ray_test","repo":"3dlg-hcvc/plan2scene","repo_kind":"official","path":"code/src/plan2scene/house_gen/geom_util.py","file_url":"https://github.com/3dlg-hcvc/plan2scene/blob/HEAD/code/src/plan2scene/house_gen/geom_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"70aca5f5e4b4cf00"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}