{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/de-rendering-3d-objects-in-the-wild","title":"De-rendering 3D Objects in the Wild","arxiv_id":"2201.02279","date":"2022-01-06","proceeding":"CVPR 2022 1","authors":["Felix Wimbauer","Shangzhe Wu","Christian Rupprecht"],"abstract":"With increasing focus on augmented and virtual reality applications (XR) comes the demand for algorithms that can lift objects from images and videos into representations that are suitable for a wide variety of related 3D tasks. Large-scale deployment of XR devices and applications means that we cannot solely rely on supervised learning, as collecting and annotating data for the unlimited variety of objects in the real world is infeasible. We present a weakly supervised method that is able to decompose a single image of an object into shape (depth and normals), material (albedo, reflectivity and shininess) and global lighting parameters. For training, the method only relies on a rough initial shape estimate of the training objects to bootstrap the learning process. This shape supervision can come for example from a pretrained depth network or - more generically - from a traditional structure-from-motion pipeline. In our experiments, we show that the method can successfully de-render 2D images into a decomposed 3D representation and generalizes to unseen object categories. Since in-the-wild evaluation is difficult due to the lack of ground truth data, we also introduce a photo-realistic synthetic test set that allows for quantitative evaluation.","url_abs":"https://arxiv.org/abs/2201.02279v2","url_pdf":"https://arxiv.org/pdf/2201.02279v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"de-rendering-3d-objects-in-the-wild","repo_url":"https://github.com/brummi/derender3d","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2201.02279","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.02279"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/brummi/derender3d","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":11},"by_repo_kind":{"official":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"bfae1c7ebcfb4d8c","entry":"compute_shadow","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/image_formation_models.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/image_formation_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bfae1c7ebcfb4d8c"}},{"code_sha256_prefix":"fa8f0dbdb9969655","entry":"dump_yaml","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/utils.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fa8f0dbdb9969655"}},{"code_sha256_prefix":"be1c7090959b37e8","entry":"from_gamma_space","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/image_formation_models.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/image_formation_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"be1c7090959b37e8"}},{"code_sha256_prefix":"4dd724fba0f40265","entry":"get_set_path","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/dataloaders.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/dataloaders.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4dd724fba0f40265"}},{"code_sha256_prefix":"521cedf170be4833","entry":"is_image_file","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/dataloaders.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/dataloaders.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"521cedf170be4833"}},{"code_sha256_prefix":"c9d96366dfea8bc9","entry":"load_yaml","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/utils.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c9d96366dfea8bc9"}},{"code_sha256_prefix":"0c5ab402075cd7d5","entry":"mm_normalize","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/renderer/utils.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/renderer/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c5ab402075cd7d5"}},{"code_sha256_prefix":"93ba7714c2ce3acc","entry":"rand_posneg_range","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/renderer/utils.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/renderer/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"93ba7714c2ce3acc"}},{"code_sha256_prefix":"17ad8150640684d6","entry":"rand_range","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/renderer/utils.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/renderer/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"17ad8150640684d6"}},{"code_sha256_prefix":"3083b187271ca1a4","entry":"setup_runtime","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/utils.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3083b187271ca1a4"}},{"code_sha256_prefix":"84c2bb6acc6fec73","entry":"to_gamma_space","repo":"brummi/derender3d","repo_kind":"official","path":"derender3d/image_formation_models.py","file_url":"https://github.com/brummi/derender3d/blob/HEAD/derender3d/image_formation_models.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"84c2bb6acc6fec73"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}