{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/stylizednerf-consistent-3d-scene-stylization","title":"StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning","arxiv_id":"2205.12183","date":"2022-05-24","proceeding":"CVPR 2022 1","authors":["Yi-Hua Huang","Yue He","Yu-Jie Yuan","Yu-Kun Lai","Lin Gao"],"abstract":"3D scene stylization aims at generating stylized images of the scene from arbitrary novel views following a given set of style examples, while ensuring consistency when rendered from different views. Directly applying methods for image or video stylization to 3D scenes cannot achieve such consistency. Thanks to recently proposed neural radiance fields (NeRF), we are able to represent a 3D scene in a consistent way. Consistent 3D scene stylization can be effectively achieved by stylizing the corresponding NeRF. However, there is a significant domain gap between style examples which are 2D images and NeRF which is an implicit volumetric representation. To address this problem, we propose a novel mutual learning framework for 3D scene stylization that combines a 2D image stylization network and NeRF to fuse the stylization ability of 2D stylization network with the 3D consistency of NeRF. We first pre-train a standard NeRF of the 3D scene to be stylized and replace its color prediction module with a style network to obtain a stylized NeRF. It is followed by distilling the prior knowledge of spatial consistency from NeRF to the 2D stylization network through an introduced consistency loss. We also introduce a mimic loss to supervise the mutual learning of the NeRF style module and fine-tune the 2D stylization decoder. In order to further make our model handle ambiguities of 2D stylization results, we introduce learnable latent codes that obey the probability distributions conditioned on the style. They are attached to training samples as conditional inputs to better learn the style module in our novel stylized NeRF. Experimental results demonstrate that our method is superior to existing approaches in both visual quality and long-range consistency.","url_abs":"https://arxiv.org/abs/2205.12183v2","url_pdf":"https://arxiv.org/pdf/2205.12183v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stylizednerf-consistent-3d-scene-stylization","repo_url":"https://github.com/iglict/stylizednerf","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-stylization","task_name":"Image Stylization"},{"task_slug":"nerf","task_name":"NeRF"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2205.12183","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.12183"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/iglict/stylizednerf","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_draft_wrong":1,"ran_fixture":2,"ran_violates":1,"unverified":11},"by_repo_kind":{"official":{"samples":15,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"16679a24b9881031","entry":"adaptive_instance_normalization","repo":"iglict/stylizednerf","repo_kind":"official","path":"Style_function.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/Style_function.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"16679a24b9881031"}},{"code_sha256_prefix":"38eaf8511dc7bc9c","entry":"calc_mean_std","repo":"iglict/stylizednerf","repo_kind":"official","path":"Style_function.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/Style_function.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38eaf8511dc7bc9c"}},{"code_sha256_prefix":"1d6f8390d799f055","entry":"normalize","repo":"iglict/stylizednerf","repo_kind":"official","path":"load_llff.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/load_llff.py","link_basis":"harvester_set","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1d6f8390d799f055"}},{"code_sha256_prefix":"aa52acee18f54d38","entry":"viewmatrix","repo":"iglict/stylizednerf","repo_kind":"official","path":"load_llff.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/load_llff.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aa52acee18f54d38"}},{"code_sha256_prefix":"5e3dafa27d74cb58","entry":"cal_geometry","repo":"iglict/stylizednerf","repo_kind":"official","path":"rendering.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/rendering.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5e3dafa27d74cb58"}},{"code_sha256_prefix":"277f955e6caa9cfb","entry":"coral","repo":"iglict/stylizednerf","repo_kind":"official","path":"Style_function.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/Style_function.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"277f955e6caa9cfb"}},{"code_sha256_prefix":"e991990b383b4401","entry":"image_transform","repo":"iglict/stylizednerf","repo_kind":"official","path":"dataset.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e991990b383b4401"}},{"code_sha256_prefix":"1c3b4acc6042ef47","entry":"json_read_rgbd","repo":"iglict/stylizednerf","repo_kind":"official","path":"utils.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c3b4acc6042ef47"}},{"code_sha256_prefix":"9b7551cdc32913e0","entry":"ndc2world","repo":"iglict/stylizednerf","repo_kind":"official","path":"train_style_modules.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/train_style_modules.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"9b7551cdc32913e0"}},{"code_sha256_prefix":"36f5de7a0aae4a9b","entry":"ptstocam","repo":"iglict/stylizednerf","repo_kind":"official","path":"load_llff.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/load_llff.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"36f5de7a0aae4a9b"}},{"code_sha256_prefix":"c6f78245da55a3f8","entry":"read_ply","repo":"iglict/stylizednerf","repo_kind":"official","path":"utils.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c6f78245da55a3f8"}},{"code_sha256_prefix":"0c53cb3537bd258a","entry":"read_rgbd","repo":"iglict/stylizednerf","repo_kind":"official","path":"utils.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0c53cb3537bd258a"}},{"code_sha256_prefix":"a1d7be7500efae44","entry":"render","repo":"iglict/stylizednerf","repo_kind":"official","path":"rendering.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/rendering.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a1d7be7500efae44"}},{"code_sha256_prefix":"821d0b44eff38d97","entry":"render_style","repo":"iglict/stylizednerf","repo_kind":"official","path":"rendering.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/rendering.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"821d0b44eff38d97"}},{"code_sha256_prefix":"b9851df6a7434a2b","entry":"view_synthesis","repo":"iglict/stylizednerf","repo_kind":"official","path":"dataset.py","file_url":"https://github.com/iglict/stylizednerf/blob/HEAD/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b9851df6a7434a2b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}