{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/edit-temporal-consistent-videos-with-image","title":"Edit Temporal-Consistent Videos with Image Diffusion Model","arxiv_id":"2308.09091","date":"2023-08-17","proceeding":null,"authors":["Yuanzhi Wang","Yong Li","Xiaoya Zhang","Xin Liu","Anbo Dai","Antoni B. Chan","Zhen Cui"],"abstract":"Large-scale text-to-image (T2I) diffusion models have been extended for text-guided video editing, yielding impressive zero-shot video editing performance. Nonetheless, the generated videos usually show spatial irregularities and temporal inconsistencies as the temporal characteristics of videos have not been faithfully modeled. In this paper, we propose an elegant yet effective Temporal-Consistent Video Editing (TCVE) method to mitigate the temporal inconsistency challenge for robust text-guided video editing. In addition to the utilization of a pretrained T2I 2D Unet for spatial content manipulation, we establish a dedicated temporal Unet architecture to faithfully capture the temporal coherence of the input video sequences. Furthermore, to establish coherence and interrelation between the spatial-focused and temporal-focused components, a cohesive spatial-temporal modeling unit is formulated. This unit effectively interconnects the temporal Unet with the pretrained 2D Unet, thereby enhancing the temporal consistency of the generated videos while preserving the capacity for video content manipulation. Quantitative experimental results and visualization results demonstrate that TCVE achieves state-of-the-art performance in both video temporal consistency and video editing capability, surpassing existing benchmarks in the field.","url_abs":"https://arxiv.org/abs/2308.09091v2","url_pdf":"https://arxiv.org/pdf/2308.09091v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"edit-temporal-consistent-videos-with-image","repo_url":"https://github.com/mdswyz/TCVE","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"video-editing","task_name":"Video Editing"},{"task_slug":"video-temporal-consistency","task_name":"Video Temporal Consistency"},{"task_slug":"model","task_name":"model"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.09091","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.09091"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mdswyz/TCVE","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"unverified":3},"by_repo_kind":{"official":{"samples":6,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"92b54c1bbde02ff0","entry":"Upsample_1d","repo":"mdswyz/TCVE","repo_kind":"official","path":"tcve/models/resnet.py","file_url":"https://github.com/mdswyz/TCVE/blob/HEAD/tcve/models/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"92b54c1bbde02ff0"}},{"code_sha256_prefix":"0b088617d5525751","entry":"get_noise_pred_single","repo":"mdswyz/TCVE","repo_kind":"official","path":"tcve/util.py","file_url":"https://github.com/mdswyz/TCVE/blob/HEAD/tcve/util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0b088617d5525751"}},{"code_sha256_prefix":"fb032d6fa7e6196d","entry":"next_step","repo":"mdswyz/TCVE","repo_kind":"official","path":"tcve/util.py","file_url":"https://github.com/mdswyz/TCVE/blob/HEAD/tcve/util.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fb032d6fa7e6196d"}},{"code_sha256_prefix":"0850e5c637d8792a","entry":"get_down_block","repo":"mdswyz/TCVE","repo_kind":"official","path":"tcve/models/unet_blocks.py","file_url":"https://github.com/mdswyz/TCVE/blob/HEAD/tcve/models/unet_blocks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0850e5c637d8792a"}},{"code_sha256_prefix":"4769563e659497ac","entry":"get_up_block","repo":"mdswyz/TCVE","repo_kind":"official","path":"tcve/models/unet_blocks.py","file_url":"https://github.com/mdswyz/TCVE/blob/HEAD/tcve/models/unet_blocks.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4769563e659497ac"}},{"code_sha256_prefix":"a0a4d94af120c56f","entry":"init_prompt","repo":"mdswyz/TCVE","repo_kind":"official","path":"tcve/util.py","file_url":"https://github.com/mdswyz/TCVE/blob/HEAD/tcve/util.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0a4d94af120c56f"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}