{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/towards-an-end-to-end-framework-for-flow","title":"Towards An End-to-End Framework for Flow-Guided Video Inpainting","arxiv_id":"2204.02663","date":"2022-04-06","proceeding":"CVPR 2022 1","authors":["Zhen Li","Cheng-Ze Lu","Jianhua Qin","Chun-Le Guo","Ming-Ming Cheng"],"abstract":"Optical flow, which captures motion information across frames, is exploited in recent video inpainting methods through propagating pixels along its trajectories. However, the hand-crafted flow-based processes in these methods are applied separately to form the whole inpainting pipeline. Thus, these methods are less efficient and rely heavily on the intermediate results from earlier stages. In this paper, we propose an End-to-End framework for Flow-Guided Video Inpainting (E$^2$FGVI) through elaborately designed three trainable modules, namely, flow completion, feature propagation, and content hallucination modules. The three modules correspond with the three stages of previous flow-based methods but can be jointly optimized, leading to a more efficient and effective inpainting process. Experimental results demonstrate that the proposed method outperforms state-of-the-art methods both qualitatively and quantitatively and shows promising efficiency. The code is available at https://github.com/MCG-NKU/E2FGVI.","url_abs":"https://arxiv.org/abs/2204.02663v2","url_pdf":"https://arxiv.org/pdf/2204.02663v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"towards-an-end-to-end-framework-for-flow","repo_url":"https://github.com/MCG-NKU/E2FGVI","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"towards-an-end-to-end-framework-for-flow","repo_url":"https://github.com/Dragoniss/minspore-phase2-E2FGVI","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"mindspore","reach":{"status":"ok"}}],"tasks":[{"task_slug":"hallucination","task_name":"Hallucination"},{"task_slug":"optical-flow-estimation","task_name":"Optical Flow Estimation"},{"task_slug":"seeing-beyond-the-visible","task_name":"Seeing Beyond the Visible"},{"task_slug":"video-inpainting","task_name":"Video Inpainting"}],"methods":[{"method_slug":"pixel-prediction","method_name":"Inpainting"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/seeing-beyond-the-visible-on-kitti360-ex","task":"Seeing Beyond the Visible","dataset":"KITTI360-EX","model":"E2FGVI","rank_in_archive_order":2,"of":7,"metrics":{"Average PSNR":"19.45"},"uses_additional_data":false},{"leaderboard":"/sota/video-inpainting-on-davis","task":"Video Inpainting","dataset":"DAVIS","model":"E2FGVI","rank_in_archive_order":2,"of":11,"metrics":{"Ewarp":"0.1315","PSNR":"33.01","SSIM":"0.9721","VFID":"0.116"},"uses_additional_data":false},{"leaderboard":"/sota/video-inpainting-on-hqvi-240p","task":"Video Inpainting","dataset":"HQVI (240p)","model":"E2FGVI","rank_in_archive_order":4,"of":7,"metrics":{"LPIPS":"0.0401","PSNR":"30.63","SSIM":"0.9427","VFID":"0.1885"},"uses_additional_data":false},{"leaderboard":"/sota/video-inpainting-on-youtube-vos","task":"Video Inpainting","dataset":"YouTube-VOS 2018","model":"E2FGVI","rank_in_archive_order":3,"of":10,"metrics":{"Ewarp":"0.0864","PSNR":"33.71","SSIM":"0.9700","VFID":"0.046"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2204.02663","atlas_url":"https://app.syntology.ai/?focus=2204.02663","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.02663"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/MCG-NKU/E2FGVI","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Dragoniss/minspore-phase2-E2FGVI","reach":{"status":"ok"}}],"summary":{"ran":2,"ran_fixture":2,"ran_draft_wrong":1,"unverified":1},"by_repo_kind":{"official":{"samples":6,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"10f2b19d708c1701","entry":"FusionFeedForward","repo":"MCG-NKU/E2FGVI","repo_kind":"official","path":"model/modules/tfocal_transformer.py","file_url":"https://github.com/MCG-NKU/E2FGVI/blob/HEAD/model/modules/tfocal_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"10f2b19d708c1701"}},{"code_sha256_prefix":"eeb100b4e1aafeeb","entry":"WindowAttention","repo":"MCG-NKU/E2FGVI","repo_kind":"official","path":"model/modules/tfocal_transformer.py","file_url":"https://github.com/MCG-NKU/E2FGVI/blob/HEAD/model/modules/tfocal_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"eeb100b4e1aafeeb"}},{"code_sha256_prefix":"e68e68741e8501f2","entry":"window_partition","repo":"MCG-NKU/E2FGVI","repo_kind":"official","path":"model/modules/tfocal_transformer.py","file_url":"https://github.com/MCG-NKU/E2FGVI/blob/HEAD/model/modules/tfocal_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"e68e68741e8501f2"}},{"code_sha256_prefix":"9805146660e3f049","entry":"window_partition_noreshape","repo":"MCG-NKU/E2FGVI","repo_kind":"official","path":"model/modules/tfocal_transformer.py","file_url":"https://github.com/MCG-NKU/E2FGVI/blob/HEAD/model/modules/tfocal_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"9805146660e3f049"}},{"code_sha256_prefix":"68e6c97609abe2ea","entry":"window_reverse","repo":"MCG-NKU/E2FGVI","repo_kind":"official","path":"model/modules/tfocal_transformer.py","file_url":"https://github.com/MCG-NKU/E2FGVI/blob/HEAD/model/modules/tfocal_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"68e6c97609abe2ea"}},{"code_sha256_prefix":"1e2c1178f8d5b6f2","entry":"TemporalFocalTransformerBlock","repo":"MCG-NKU/E2FGVI","repo_kind":"official","path":"model/modules/tfocal_transformer.py","file_url":"https://github.com/MCG-NKU/E2FGVI/blob/HEAD/model/modules/tfocal_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NOASSERTION","inline_ok":false,"mcp_get_code":{"code_sha256":"1e2c1178f8d5b6f2"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}