Video Inpainting

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

7 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

15 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 59 papers with code (130 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• ProPainter: Improving Propagation and Transformer for Video Inpainting
  7 Sep 2023 3 repositories listed Syntology ran 20 of 34 samples · 14 unverified · 16 pointer-only (licence)
  We also propose a mask-guided sparse video Transformer, which achieves high efficiency by discarding unnecessary and redundant tokens.
• Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformer
  21 Nov 2022 3 repositories listed
  In this paper, we propose the concept of online video inpainting for autonomous vehicles to expand the field of view, thereby enhancing scene visibility, perception, and system safety.
• INR-V: A Continuous Representation Space for Video-based Generative Tasks
  29 Oct 2022 3 repositories listed
  In this work, we evaluate the space learned by INR-V on diverse generative tasks such as video interpolation, novel video generation, video inversion, and video inpainting against the existing baselines.
• Exploiting Optical Flow Guidance for Transformer-Based Video Inpainting
  24 Jan 2023 2 repositories listed
  Transformers have been widely used for video processing owing to the multi-head self attention (MHSA) mechanism.
• Towards An End-to-End Framework for Flow-Guided Video Inpainting
  6 Apr 2022 2 repositories listed Syntology ran 5 of 6 samples · 1 unverified · 6 pointer-only (licence)
  Optical flow, which captures motion information across frames, is exploited in recent video inpainting methods through propagating pixels along its trajectories.
• Learning Joint Spatial-Temporal Transformations for Video Inpainting
  20 Jul 2020 2 repositories listed Syntology ran 1 of 7 samples · 6 unverified
  In this paper, we propose to learn a joint Spatial-Temporal Transformer Network (STTN) for video inpainting.
• DVI: Depth Guided Video Inpainting for Autonomous Driving
  17 Jul 2020 2 repositories listed Syntology ran 2 of 10 samples · 8 unverified
  To get clear street-view and photo-realistic simulation in autonomous driving, we present an automatic video inpainting algorithm that can remove traffic agents from videos and synthesize missing regions with the…
• Learnable Gated Temporal Shift Module for Deep Video Inpainting
  2 Jul 2019 2 repositories listed
  How to efficiently utilize temporal information to recover videos in a consistent way is the main issue for video inpainting problems.
• Deep Flow-Guided Video Inpainting
  8 May 2019 2 repositories listed Syntology ran 1 of 4 samples · 3 unverified
  Then the synthesized flow field is used to guide the propagation of pixels to fill up the missing regions in the video.
• Deep Video Inpainting
  5 May 2019 2 repositories listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Video inpainting aims to fill spatio-temporal holes with plausible content in a video.
• Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN
  23 Apr 2019 2 repositories listed
  Free-form video inpainting is a very challenging task that could be widely used for video editing such as text removal.
• SwapAnyone: Consistent and Realistic Video Synthesis for Swapping Any Person into Any Video
  12 Mar 2025 1 repository listed
  Video body-swapping aims to replace the body in an existing video with a new body from arbitrary sources, which has garnered more attention in recent years.
• VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control
  7 Mar 2025 1 repository listed
  Video inpainting, which aims to restore corrupted video content, has experienced substantial progress.
• DiffuEraser: A Diffusion Model for Video Inpainting
  17 Jan 2025 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Recent video inpainting algorithms integrate flow-based pixel propagation with transformer-based generation to leverage optical flow for restoring textures and objects using information from neighboring frames, while…
• Elevating Flow-Guided Video Inpainting with Reference Generation
  12 Dec 2024 1 repository listed
  Powered by a strong generative model, our method not only significantly enhances frame-level quality for object removal but also synthesizes new content in the missing areas based on user-provided text prompts.
• Advanced Video Inpainting Using Optical Flow-Guided Efficient Diffusion
  1 Dec 2024 1 repository listed
  Specifically, FloED employs a dual-branch architecture, where a flow branch first restores corrupted flow and a multi-scale flow adapter provides motion guidance to the main inpainting branch.
• MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion
  10 Oct 2024 1 repository listed Syntology ran 4 of 4 samples · 0 unverified
  The spatio-temporal complexity of video data presents significant challenges in tasks such as compression, generation, and inpainting.
• Replace Anyone in Videos
  30 Sep 2024 1 repository listed
  Furthermore, we implement an enriched visual guidance mechanism to enhance appearance alignment, a hybrid inpainting encoder to further preserve the detailed background information in the masked video, and a two-phase…
• StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videos
  11 Sep 2024 1 repository listed
  This paper presents a novel framework for converting 2D videos to immersive stereoscopic 3D, addressing the growing demand for 3D content in immersive experience.
• Depth-Aware Endoscopic Video Inpainting
  2 Jul 2024 1 repository listed
  Video inpainting fills in corrupted video content with plausible replacements.
• Video Inpainting Localization with Contrastive Learning
  25 Jun 2024 1 repository listed
  This letter proposes a simple yet effective forensic scheme for Video Inpainting LOcalization with ContrAstive Learning (ViLocal).
• Trusted Video Inpainting Localization via Deep Attentive Noise Learning
  19 Jun 2024 1 repository listed
  In this paper, we present a Trusted Video Inpainting Localization network (TruVIL) with excellent robustness and generalization ability.
• Raformer: Redundancy-Aware Transformer for Video Wire Inpainting
  24 Apr 2024 1 repository listed
  Video Wire Inpainting (VWI) is a prominent application in video inpainting, aimed at flawlessly removing wires in films or TV series, offering significant time and labor savings compared to manual frame-by-frame removal.
• VQ-NeRV: A Vector Quantized Neural Representation for Videos
  19 Mar 2024 1 repository listed
  This block incorporates a codebook mechanism to discretize the network's shallow residual features and inter-frame residual information effectively.
• CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibility
  18 Mar 2024 1 repository listed
  To this end, this paper proposes a novel text-guided video inpainting model that achieves better consistency, controllability and compatibility.
• Expression-aware video inpainting for HMD removal in XR applications
  25 Jan 2024 1 repository listed
  Our results demonstrate the remarkable capability of the proposed framework to remove HMDs from facial videos while maintaining the subject's facial expression and identity.
• Lumiere: A Space-Time Diffusion Model for Video Generation
  23 Jan 2024 1 repository listed Syntology ran 2 of 3 samples · 1 unverified
  We introduce Lumiere -- a text-to-video diffusion model designed for synthesizing videos that portray realistic, diverse and coherent motion -- a pivotal challenge in video synthesis.
• Towards Language-Driven Video Inpainting via Multimodal Large Language Models
  18 Jan 2024 1 repository listed Syntology ran 7 of 10 samples · 3 unverified · 10 pointer-only (licence)
  We introduce a new task -- language-driven video inpainting, which uses natural language instructions to guide the inpainting process.
• AVID: Any-Length Video Inpainting with Diffusion Model
  6 Dec 2023 1 repository listed
  Given a video, a masked region at its initial frame, and an editing prompt, it requires a model to do infilling at each frame following the editing guidance while keeping the out-of-mask region intact.
• BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models
  5 Dec 2023 1 repository listed Syntology ran 3 of 6 samples · 3 unverified
  Now text-to-image foundation models are widely applied to various downstream image synthesis tasks, such as controllable image generation and image editing, while downstream video synthesis tasks are less explored for…

Syntology lines on 11 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.