Papers › Frame-Recurrent Video Super-Resolution
Frame-Recurrent Video Super-Resolution
Mehdi S. M. Sajjadi, Raviteja Vemulapalli, Matthew Brown
Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current state-of-the-art methods process a batch of LR frames to generate a single high-resolution (HR) frame and run this scheme in a sliding window fashion over the entire video, effectively treating the problem as a large number of separate multi-frame super-resolution tasks. This approach has two main weaknesses: 1) Each input frame is processed and warped multiple times, increasing the computational cost, and 2) each output frame is estimated independently conditioned on the input frames, limiting the system's ability to produce temporally consistent results. In this work, we propose an end-to-end trainable frame-recurrent video super-resolution framework that uses the previously inferred HR estimate to super-resolve the subsequent frame. This naturally encourages temporally consistent results and reduces the computational cost by warping only one image in each step. Furthermore, due to its recurrent nature, the proposed method has the ability to assimilate a large number of previous frames without increased computational demands. Extensive evaluations and comparisons with previous methods validate the strengths of our approach and demonstrate that the proposed framework is able to significantly outperform the current state of the art.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
No code repository is listed for this paper in the archive or in Syntology's graph.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Super-Resolution | MSU Video Upscalers: Quality Enhancement | FRVSR | PSNR | 27.23 | #44 of 48 | Archive leaderboard | report |
| Video Super-Resolution | MSU Video Upscalers: Quality Enhancement | FRVSR | SSIM | 0.936 | #44 of 48 | Archive leaderboard | report |
| Video Super-Resolution | MSU Video Upscalers: Quality Enhancement | FRVSR | VMAF | 57.14 | #44 of 48 | Archive leaderboard | report |
| Video Super-Resolution | Vid4 - 4x upscaling - BD degradation | FRVSR | PSNR | 26.69 | #17 of 18 | Archive leaderboard | report |
| Video Super-Resolution | Vid4 - 4x upscaling - BD degradation | FRVSR | SSIM | 0.8103 | #17 of 18 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections