Papers › Video Frame Interpolation via Residue Refinement

Video Frame Interpolation via Residue Refinement

4 May 20202020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2020 5archive 2025-07-28

Haopeng Li, Yuan Yuan, Qi. Wang

Video frame interpolation achieves temporal super-resolution by generating smooth transitions between frames. Although great success has been achieved by deep neural networks, the synthesized images stills suffer from poor visual appearance and unsatisfactory artifacts. In this paper, we propose a novel network structure that leverages residue refinement and adaptive weight to synthesize in-between frames. The residue refinement technique is used for optical flow and image generation for higher accuracy and better visual appearance, while the adaptive weight map combines the forward and backward warped frames to reduce the artifacts. Moreover, all sub-modules in our method are implemented by U-Net with less depths, so the efficiency is guaranteed. Experiments on public datasets demonstrate the effectiveness and superiority of our method over the state-of-the-art approaches.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Optical Flow EstimationVideo Frame Interpolation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Frame Interpolation MSU Video Frame Interpolation RRIN LPIPS 0.072 #19 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation RRIN MS-SSIM 0.902 #19 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation RRIN PSNR 25.76 #19 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation RRIN SSIM 0.893 #19 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation RRIN VMAF 59.82 #19 of 24 Archive leaderboard report
Video Frame Interpolation UCF101 RRIN PSNR 34.93 #17 of 19 Archive leaderboard report
Video Frame Interpolation UCF101 RRIN SSIM 0.9496 #17 of 19 Archive leaderboard report
Video Frame Interpolation Vimeo90K RRIN PSNR 35.22 #13 of 23 Archive leaderboard report
Video Frame Interpolation Vimeo90K RRIN SSIM 0.9643 #13 of 23 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Concatenated Skip ConnectionConvolutionMax PoolingReLUU-Net

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections