Papers › Copy-and-Paste Networks for Deep Video Inpainting

Copy-and-Paste Networks for Deep Video Inpainting

30 Aug 2019ICCV 2019 10arXiv:1908.11587archive 2025-07-28

Sungho Lee, Seoung Wug Oh, DaeYeun Won, Seon Joo Kim

We present a novel deep learning based algorithm for video inpainting. Video inpainting is a process of completing corrupted or missing regions in videos. Video inpainting has additional challenges compared to image inpainting due to the extra temporal information as well as the need for maintaining the temporal coherency. We propose a novel DNN-based framework called the Copy-and-Paste Networks for video inpainting that takes advantage of additional information in other frames of the video. The network is trained to copy corresponding contents in reference frames and paste them to fill the holes in the target frame. Our network also includes an alignment network that computes affine matrices between frames for the alignment, enabling the network to take information from more distant frames for robustness. Our method produces visually pleasing and temporally coherent results while running faster than the state-of-the-art optimization-based method. In addition, we extend our framework for enhancing over/under exposed frames in videos. Using this enhancement technique, we were able to significantly improve the lane detection accuracy on road videos.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image InpaintingLane DetectionVideo Inpainting

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Inpainting DAVIS CAP Ewarp 0.1533 #6 of 11 Archive leaderboard report
Video Inpainting DAVIS CAP PSNR 30.28 #6 of 11 Archive leaderboard report
Video Inpainting DAVIS CAP SSIM 0.9521 #6 of 11 Archive leaderboard report
Video Inpainting DAVIS CAP VFID 0.182 #6 of 11 Archive leaderboard report
Video Inpainting YouTube-VOS 2018 CAP Ewarp 0.1470 #6 of 10 Archive leaderboard report
Video Inpainting YouTube-VOS 2018 CAP PSNR 31.58 #6 of 10 Archive leaderboard report
Video Inpainting YouTube-VOS 2018 CAP SSIM 0.9607 #6 of 10 Archive leaderboard report
Video Inpainting YouTube-VOS 2018 CAP VFID 0.071 #6 of 10 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections