{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/univst-a-unified-framework-for-training-free","title":"UniVST: A Unified Framework for Training-free Localized Video Style Transfer","arxiv_id":"2410.20084","date":"2024-10-26","proceeding":null,"authors":["Quanjian Song","Mingbao Lin","Wengyi Zhan","Shuicheng Yan","Liujuan Cao","Rongrong Ji"],"abstract":"This paper presents UniVST, a unified framework for localized video style transfer based on diffusion model. It operates without the need for training, offering a distinct advantage over existing diffusion methods that transfer style across entire videos. The endeavors of this paper comprise: (1) A point-matching mask propagation strategy that leverages the feature maps from the DDIM inversion. This streamlines the model's architecture by obviating the need for tracking models. (2) A training-free AdaIN-guided video style transfer mechanism that operates at both the latent and attention levels. This balances content fidelity and style richness, mitigating the loss of localized details commonly associated with direct video stylization. (3) A sliding-window consistent smoothing scheme that harnesses optical flow within the pixel representation and refines predicted noise to update the latent space. This significantly enhances temporal consistency and diminishes artifacts in stylized video. Our proposed UniVST has been validated to be superior to existing methods in quantitative and qualitative metrics. It adeptly addresses the challenges of preserving the primary object's style while ensuring temporal consistency and detail preservation. Our code is available at https://github.com/QuanjianSong/UniVST.","url_abs":"https://arxiv.org/abs/2410.20084v3","url_pdf":"https://arxiv.org/pdf/2410.20084v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"univst-a-unified-framework-for-training-free","repo_url":"https://github.com/QuanjianSong/UniVST","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"style-transfer","task_name":"Style Transfer"},{"task_slug":"video-editing","task_name":"Video Editing"},{"task_slug":"video-style-transfer","task_name":"Video Style Transfer"}],"methods":[{"method_slug":"attention","method_name":"Attention"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2410.20084","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2410.20084"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/QuanjianSong/UniVST","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"unverified":12},"by_repo_kind":{"official":{"samples":12,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"9dc5ed9af1ae77a3","entry":"compute_optical_flow","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/cal_optica_flow.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/cal_optica_flow.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"9dc5ed9af1ae77a3"}},{"code_sha256_prefix":"1169106085f0f41b","entry":"ddim_inversion","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"inversion_tools/ddim_inversion.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/inversion_tools/ddim_inversion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1169106085f0f41b"}},{"code_sha256_prefix":"bf23aea5d38d1f03","entry":"ddim_loop","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"inversion_tools/ddim_inversion.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/inversion_tools/ddim_inversion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"bf23aea5d38d1f03"}},{"code_sha256_prefix":"f8fec9be80913739","entry":"ddim_loop_plus","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"inversion_tools/ddim_inversion.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/inversion_tools/ddim_inversion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f8fec9be80913739"}},{"code_sha256_prefix":"1f54bc9dcfec9407","entry":"load_ddim_latents_at_t","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/util.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1f54bc9dcfec9407"}},{"code_sha256_prefix":"b5d651334526030f","entry":"load_image","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/cal_optica_flow.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/cal_optica_flow.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b5d651334526030f"}},{"code_sha256_prefix":"3b0c2f3ede9c1b37","entry":"mask_propogation","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/mask_propagation.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/mask_propagation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3b0c2f3ede9c1b37"}},{"code_sha256_prefix":"531244cdc63cdb47","entry":"norm_mask","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/mask_propagation.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/mask_propagation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"531244cdc63cdb47"}},{"code_sha256_prefix":"ff721c733e7512f0","entry":"preprocess_image","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/cal_optica_flow.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/cal_optica_flow.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ff721c733e7512f0"}},{"code_sha256_prefix":"8bbe84a3f6d6e241","entry":"read_feature","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"src/mask_propagation.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/src/mask_propagation.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8bbe84a3f6d6e241"}},{"code_sha256_prefix":"cc4556fdffc74a1f","entry":"rf_inversion","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"inversion_tools/flow_inversion.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/inversion_tools/flow_inversion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cc4556fdffc74a1f"}},{"code_sha256_prefix":"04eae86d12fb5ffc","entry":"rf_solver","repo":"QuanjianSong/UniVST","repo_kind":"official","path":"inversion_tools/flow_inversion.py","file_url":"https://github.com/QuanjianSong/UniVST/blob/HEAD/inversion_tools/flow_inversion.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"04eae86d12fb5ffc"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}