Papers › A Unified Pyramid Recurrent Network for Video Frame Interpolation

A Unified Pyramid Recurrent Network for Video Frame Interpolation

7 Nov 2022CVPR 2023 1arXiv:2211.03456archive 2025-07-28

Xin Jin, Longhai Wu, Jie Chen, Youxin Chen, Jayoon Koo, Cheul-hee Hahm

Flow-guided synthesis provides a common framework for frame interpolation, where optical flow is estimated to guide the synthesis of intermediate frames between consecutive inputs. In this paper, we present UPR-Net, a novel Unified Pyramid Recurrent Network for frame interpolation. Cast in a flexible pyramid framework, UPR-Net exploits lightweight recurrent modules for both bi-directional flow estimation and intermediate frame synthesis. At each pyramid level, it leverages estimated bi-directional flow to generate forward-warped representations for frame synthesis; across pyramid levels, it enables iterative refinement for both optical flow and intermediate frame. In particular, we show that our iterative synthesis strategy can significantly improve the robustness of frame interpolation on large motion cases. Despite being extremely lightweight (1.7M parameters), our base version of UPR-Net achieves excellent performance on a large range of benchmarks. Code and trained models of our UPR-Net series are available at: https://github.com/srcn-ivl/UPR-Net.

PaperPDFConference PDFCode

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

srcn-ivl/upr-net officialmentioned in papermentioned on GitHubpytorchNOASSERTION report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Optical Flow EstimationVideo Frame Interpolation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Frame Interpolation MSU Video Frame Interpolation UPR-Net LARGE LPIPS 0.025 #5 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation UPR-Net LARGE MS-SSIM 0.962 #5 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation UPR-Net LARGE PSNR 29.73 #5 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation UPR-Net LARGE SSIM 0.951 #5 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation UPR-Net LARGE VMAF 71.34 #5 of 24 Archive leaderboard report
Video Frame Interpolation SNU-FILM (easy) UPR-Net LARGE PSNR 40.44 #4 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (easy) UPR-Net LARGE SSIM 0.9911 #4 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (extreme) UPR-Net LARGE PSNR 25.63 #5 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (extreme) UPR-Net LARGE SSIM 0.8641 #5 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (hard) UPR-Net LARGE PSNR 30.86 #6 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (hard) UPR-Net LARGE SSIM 0.9377 #6 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (medium) UPR-Net LARGE PSNR 36.29 #4 of 8 Archive leaderboard report
Video Frame Interpolation SNU-FILM (medium) UPR-Net LARGE SSIM 0.9801 #4 of 8 Archive leaderboard report
Video Frame Interpolation UCF101 UPR-Net LARGE PSNR 35.47 #2 of 19 Archive leaderboard report
Video Frame Interpolation UCF101 UPR-Net LARGE SSIM 0.9700 #2 of 19 Archive leaderboard report
Video Frame Interpolation Vimeo90K UPR-Net LARGE PSNR 36.42 #4 of 23 Archive leaderboard report
Video Frame Interpolation Vimeo90K UPR-Net LARGE SSIM 0.9815 #4 of 23 Archive leaderboard report
Video Frame Interpolation X4K1000FPS UPR-Net large PSNR 30.68 #8 of 20 Archive leaderboard report
Video Frame Interpolation X4K1000FPS UPR-Net large SSIM 0.9086 #8 of 20 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

BASE

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections