{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/slicedit-zero-shot-video-editing-with-text-to","title":"Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slices","arxiv_id":"2405.12211","date":"2024-05-20","proceeding":null,"authors":["Nathaniel Cohen","Vladimir Kulikov","Matan Kleiner","Inbar Huberman-Spiegelglas","Tomer Michaeli"],"abstract":"Text-to-image (T2I) diffusion models achieve state-of-the-art results in image synthesis and editing. However, leveraging such pretrained models for video editing is considered a major challenge. Many existing works attempt to enforce temporal consistency in the edited video through explicit correspondence mechanisms, either in pixel space or between deep features. These methods, however, struggle with strong nonrigid motion. In this paper, we introduce a fundamentally different approach, which is based on the observation that spatiotemporal slices of natural videos exhibit similar characteristics to natural images. Thus, the same T2I diffusion model that is normally used only as a prior on video frames, can also serve as a strong prior for enhancing temporal consistency by applying it on spatiotemporal slices. Based on this observation, we present Slicedit, a method for text-based video editing that utilizes a pretrained T2I diffusion model to process both spatial and spatiotemporal slices. Our method generates videos that retain the structure and motion of the original video while adhering to the target text. Through extensive experiments, we demonstrate Slicedit's ability to edit a wide range of real-world videos, confirming its clear advantages compared to existing competing methods. Webpage: https://matankleiner.github.io/slicedit/","url_abs":"https://arxiv.org/abs/2405.12211v1","url_pdf":"https://arxiv.org/pdf/2405.12211v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"slicedit-zero-shot-video-editing-with-text-to","repo_url":"https://github.com/fallenshock/Slicedit","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"video-editing","task_name":"Video Editing"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2405.12211","atlas_url":"https://app.syntology.ai/?focus=2405.12211","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.12211"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fallenshock/Slicedit","reach":null}],"summary":{"ran_draft_wrong":3,"ran_honours":2,"ran_violates":1,"ran_fixture":3,"unverified":11},"by_repo_kind":{"official":{"samples":20,"ran":9,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"25ab067e0902f41f","entry":"add_margin","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"25ab067e0902f41f"}},{"code_sha256_prefix":"0bd3fc32cad6ecc6","entry":"calc_mu","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0bd3fc32cad6ecc6"}},{"code_sha256_prefix":"f10ef55e8b711ad5","entry":"encode_text","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f10ef55e8b711ad5"}},{"code_sha256_prefix":"48bf1963eb295892","entry":"get_variance","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"48bf1963eb295892"}},{"code_sha256_prefix":"cd5d5067de871c97","entry":"isinstance_str","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cd5d5067de871c97"}},{"code_sha256_prefix":"f5482a07e744dbc9","entry":"prepare_extended_QKV","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f5482a07e744dbc9"}},{"code_sha256_prefix":"f34768f578b617db","entry":"temporal_denoise","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f34768f578b617db"}},{"code_sha256_prefix":"b4c7235ec863b3ec","entry":"temporal_volume_denoise","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b4c7235ec863b3ec"}},{"code_sha256_prefix":"6fd0be0931229e05","entry":"tensor_to_pil","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6fd0be0931229e05"}},{"code_sha256_prefix":"7a3671581feafc24","entry":"create_video_from_frames","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7a3671581feafc24"}},{"code_sha256_prefix":"7be3c3d9f3cc6b46","entry":"image_grid","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7be3c3d9f3cc6b46"}},{"code_sha256_prefix":"2ae8041181b7a137","entry":"pred_noise_xy_func","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2ae8041181b7a137"}},{"code_sha256_prefix":"fca1391a5cb280dd","entry":"register_conv_injection","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fca1391a5cb280dd"}},{"code_sha256_prefix":"23e4bdeddbc7c01c","entry":"register_denoiser_xy","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"23e4bdeddbc7c01c"}},{"code_sha256_prefix":"b4506ee67589b117","entry":"register_extended_attention","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b4506ee67589b117"}},{"code_sha256_prefix":"5211e19ad1d3f310","entry":"register_n_keyframes","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5211e19ad1d3f310"}},{"code_sha256_prefix":"712a553bf52ae1a4","entry":"register_time","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"712a553bf52ae1a4"}},{"code_sha256_prefix":"a7822d3351721ee9","entry":"sample_xts_from_x0_and_eps","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a7822d3351721ee9"}},{"code_sha256_prefix":"dccfdcbb40353e0b","entry":"save_video","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dccfdcbb40353e0b"}},{"code_sha256_prefix":"32b283bd397c92d0","entry":"slicedit_ddpm_inversion_loop","repo":"fallenshock/Slicedit","repo_kind":"official","path":"Slicedit/inversion_utils.py","file_url":"https://github.com/fallenshock/Slicedit/blob/HEAD/Slicedit/inversion_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"32b283bd397c92d0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}