{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/layered-neural-atlases-for-consistent-video","title":"Layered Neural Atlases for Consistent Video Editing","arxiv_id":"2109.11418","date":"2021-09-23","proceeding":null,"authors":["Yoni Kasten","Dolev Ofri","Oliver Wang","Tali Dekel"],"abstract":"We present a method that decomposes, or \"unwraps\", an input video into a set of layered 2D atlases, each providing a unified representation of the appearance of an object (or background) over the video. For each pixel in the video, our method estimates its corresponding 2D coordinate in each of the atlases, giving us a consistent parameterization of the video, along with an associated alpha (opacity) value. Importantly, we design our atlases to be interpretable and semantic, which facilitates easy and intuitive editing in the atlas domain, with minimal manual work required. Edits applied to a single 2D atlas (or input video frame) are automatically and consistently mapped back to the original video frames, while preserving occlusions, deformation, and other complex scene effects such as shadows and reflections. Our method employs a coordinate-based Multilayer Perceptron (MLP) representation for mappings, atlases, and alphas, which are jointly optimized on a per-video basis, using a combination of video reconstruction and regularization losses. By operating purely in 2D, our method does not require any prior 3D knowledge about scene geometry or camera poses, and can handle complex dynamic real world videos. We demonstrate various video editing applications, including texture mapping, video style transfer, image-to-video texture transfer, and segmentation/labeling propagation, all automatically produced by editing a single 2D atlas image.","url_abs":"https://arxiv.org/abs/2109.11418v1","url_pdf":"https://arxiv.org/pdf/2109.11418v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"layered-neural-atlases-for-consistent-video","repo_url":"https://github.com/thiagoambiel/NeuralAtlases","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"layered-neural-atlases-for-consistent-video","repo_url":"https://github.com/ykasten/layered-neural-atlases","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"style-transfer","task_name":"Style Transfer"},{"task_slug":"video-editing","task_name":"Video Editing"},{"task_slug":"video-reconstruction","task_name":"Video Reconstruction"},{"task_slug":"video-style-transfer","task_name":"Video Style Transfer"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2109.11418","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.11418"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/thiagoambiel/NeuralAtlases","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ykasten/layered-neural-atlases","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran_honours":1,"ran_draft_wrong":1,"unverified":15},"by_repo_kind":{"listed":{"samples":17,"ran":2,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"f6b944f50d3f15ae","entry":"count_parameters","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"implicit_neural_networks.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/implicit_neural_networks.py","link_basis":"harvester_set","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f6b944f50d3f15ae"}},{"code_sha256_prefix":"ab6aff4b59ac84d5","entry":"positionalEncoding_vec","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"implicit_neural_networks.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/implicit_neural_networks.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ab6aff4b59ac84d5"}},{"code_sha256_prefix":"e1f29854df55ad3e","entry":"bilinear_interpolate_numpy","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"evaluate.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/evaluate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e1f29854df55ad3e"}},{"code_sha256_prefix":"25aa1f949b3ee275","entry":"compute_consistency","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"unwrap_utils.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/unwrap_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25aa1f949b3ee275"}},{"code_sha256_prefix":"b517b213dc8155a1","entry":"get_colors","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"evaluate.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/evaluate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b517b213dc8155a1"}},{"code_sha256_prefix":"c19aa5a284101d2d","entry":"get_consistency_mask","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"unwrap_utils.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/unwrap_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c19aa5a284101d2d"}},{"code_sha256_prefix":"367ba68aacda929c","entry":"get_gradient_loss","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"loss_utils.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"367ba68aacda929c"}},{"code_sha256_prefix":"38ddfbd322efb739","entry":"get_optical_flow_loss_all","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"loss_utils.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38ddfbd322efb739"}},{"code_sha256_prefix":"3982f2b00a240333","entry":"get_rigidity_loss","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"loss_utils.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/loss_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3982f2b00a240333"}},{"code_sha256_prefix":"a240f3b65e0dfa51","entry":"interpolate_alpha","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"evaluate.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/evaluate.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a240f3b65e0dfa51"}},{"code_sha256_prefix":"a10bae5354360048","entry":"read_atlas","repo":"thiagoambiel/NeuralAtlases","repo_kind":"listed","path":"core/utils.py","file_url":"https://github.com/thiagoambiel/NeuralAtlases/blob/HEAD/core/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a10bae5354360048"}},{"code_sha256_prefix":"19927e7f348ee165","entry":"read_image","repo":"thiagoambiel/NeuralAtlases","repo_kind":"listed","path":"core/utils.py","file_url":"https://github.com/thiagoambiel/NeuralAtlases/blob/HEAD/core/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19927e7f348ee165"}},{"code_sha256_prefix":"0b08aabb315885e3","entry":"resize_flow","repo":"thiagoambiel/NeuralAtlases","repo_kind":"listed","path":"core/utils.py","file_url":"https://github.com/thiagoambiel/NeuralAtlases/blob/HEAD/core/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b08aabb315885e3"}},{"code_sha256_prefix":"d7946517af608ccf","entry":"squared_euclidean_norm","repo":"thiagoambiel/NeuralAtlases","repo_kind":"listed","path":"core/norms.py","file_url":"https://github.com/thiagoambiel/NeuralAtlases/blob/HEAD/core/norms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d7946517af608ccf"}},{"code_sha256_prefix":"dc4e34290b9bd09b","entry":"squared_taxicab_norm","repo":"thiagoambiel/NeuralAtlases","repo_kind":"listed","path":"core/norms.py","file_url":"https://github.com/thiagoambiel/NeuralAtlases/blob/HEAD/core/norms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dc4e34290b9bd09b"}},{"code_sha256_prefix":"cf36cb0ed2371553","entry":"taxicab_norm","repo":"thiagoambiel/NeuralAtlases","repo_kind":"listed","path":"core/norms.py","file_url":"https://github.com/thiagoambiel/NeuralAtlases/blob/HEAD/core/norms.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cf36cb0ed2371553"}},{"code_sha256_prefix":"39530fbf3996794c","entry":"warp_flow","repo":"ykasten/layered-neural-atlases","repo_kind":"listed","path":"unwrap_utils.py","file_url":"https://github.com/ykasten/layered-neural-atlases/blob/HEAD/unwrap_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"39530fbf3996794c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}