Papers › Deep Video Super-Resolution using HR Optical Flow Estimation

Deep Video Super-Resolution using HR Optical Flow Estimation

6 Jan 2020arXiv:2001.02129archive 2025-07-28

Longguang Wang, Yulan Guo, Li Liu, Zaiping Lin, Xinpu Deng, Wei An

Video super-resolution (SR) aims at generating a sequence of high-resolution (HR) frames with plausible and temporally consistent details from their low-resolution (LR) counterparts. The key challenge for video SR lies in the effective exploitation of temporal dependency between consecutive frames. Existing deep learning based methods commonly estimate optical flows between LR frames to provide temporal dependency. However, the resolution conflict between LR optical flows and HR outputs hinders the recovery of fine details. In this paper, we propose an end-to-end video SR network to super-resolve both optical flows and images. Optical flow SR from LR frames provides accurate temporal dependency and ultimately improves video SR performance. Specifically, we first propose an optical flow reconstruction network (OFRnet) to infer HR optical flows in a coarse-to-fine manner. Then, motion compensation is performed using HR optical flows to encode temporal dependency. Finally, compensated LR inputs are fed to a super-resolution network (SRnet) to generate SR results. Extensive experiments have been conducted to demonstrate the effectiveness of HR optical flows for SR performance improvement. Comparative results on the Vid4 and DAVIS-10 datasets show that our network achieves the state-of-the-art performance.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

LongguangWang/SOF-VSR officialmentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Motion CompensationOptical Flow EstimationSuper-ResolutionVideo Super-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x264 BSQ-rate over ERQA 4.981 #18 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x264 BSQ-rate over LPIPS 1.26 #18 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x264 BSQ-rate over MS-SSIM 0.764 #18 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x264 BSQ-rate over PSNR 6.058 #18 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x264 BSQ-rate over Subjective Score 1.273 #18 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x264 BSQ-rate over VMAF 1.083 #18 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x265 BSQ-rate over ERQA 18.545 #31 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x265 BSQ-rate over LPIPS 11.236 #31 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x265 BSQ-rate over MS-SSIM 4.558 #31 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x265 BSQ-rate over PSNR 9.07 #31 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x265 BSQ-rate over Subjective Score 2.244 #31 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + x265 BSQ-rate over VMAF 3.565 #31 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + vvenc BSQ-rate over ERQA 18.844 #40 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + vvenc BSQ-rate over LPIPS 11.273 #40 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + vvenc BSQ-rate over MS-SSIM 4.882 #40 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + vvenc BSQ-rate over PSNR 9.245 #40 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + vvenc BSQ-rate over Subjective Score 2.822 #40 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + vvenc BSQ-rate over VMAF 4.527 #40 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + aomenc BSQ-rate over ERQA 12.808 #41 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + aomenc BSQ-rate over LPIPS 4.82 #41 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + aomenc BSQ-rate over MS-SSIM 6.833 #41 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + aomenc BSQ-rate over PSNR 11.314 #41 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + aomenc BSQ-rate over Subjective Score 2.84 #41 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + aomenc BSQ-rate over VMAF 5.398 #41 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + uavs3e BSQ-rate over ERQA 5.299 #45 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + uavs3e BSQ-rate over LPIPS 4.23 #45 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + uavs3e BSQ-rate over MS-SSIM 6.82 #45 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + uavs3e BSQ-rate over PSNR 10.917 #45 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + uavs3e BSQ-rate over Subjective Score 3.196 #45 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BI + uavs3e BSQ-rate over VMAF 5.361 #45 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x264 BSQ-rate over ERQA 1.544 #47 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x264 BSQ-rate over LPIPS 1.262 #47 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x264 BSQ-rate over MS-SSIM 0.843 #47 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x264 BSQ-rate over PSNR 2.763 #47 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x264 BSQ-rate over VMAF 1.213 #47 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + uavs3e BSQ-rate over ERQA 11.458 #62 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + uavs3e BSQ-rate over LPIPS 4.007 #62 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + uavs3e BSQ-rate over MS-SSIM 3.566 #62 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + uavs3e BSQ-rate over PSNR 8.658 #62 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + uavs3e BSQ-rate over VMAF 6.596 #62 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x265 BSQ-rate over ERQA 13.098 #64 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x265 BSQ-rate over LPIPS 13.141 #64 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x265 BSQ-rate over MS-SSIM 1.825 #64 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x265 BSQ-rate over PSNR 3.274 #64 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + x265 BSQ-rate over VMAF 4.346 #64 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + aomenc BSQ-rate over ERQA 15.11 #74 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + aomenc BSQ-rate over LPIPS 4.034 #74 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + aomenc BSQ-rate over MS-SSIM 7.546 #74 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + aomenc BSQ-rate over PSNR 13.076 #74 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + aomenc BSQ-rate over VMAF 7.464 #74 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + vvenc BSQ-rate over ERQA 15.958 #75 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + vvenc BSQ-rate over LPIPS 13.494 #75 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + vvenc BSQ-rate over MS-SSIM 2.112 #75 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + vvenc BSQ-rate over PSNR 8.027 #75 of 85 Archive leaderboard report
Video Super-Resolution MSU Super-Resolution for Video Compression SOF-VSR-BD + vvenc BSQ-rate over VMAF 6.41 #75 of 85 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD 1 - LPIPS 0.895 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD ERQAv1.0 0.647 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD FPS 0.699 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD PSNR 25.986 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD QRCRv1.0 0.557 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD SSIM 0.831 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BD Subjective score 4.863 #21 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI 1 - LPIPS 0.904 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI ERQAv1.0 0.66 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI FPS 0.571 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI PSNR 29.381 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI QRCRv1.0 0.557 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI SSIM 0.872 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration SOF-VSR-BI Subjective score 4.805 #22 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Upscalers: Quality Enhancement SOF-VSR PSNR 27.14 #46 of 48 Archive leaderboard report
Video Super-Resolution MSU Video Upscalers: Quality Enhancement SOF-VSR SSIM 0.937 #46 of 48 Archive leaderboard report
Video Super-Resolution MSU Video Upscalers: Quality Enhancement SOF-VSR VMAF 56.45 #46 of 48 Archive leaderboard report
Video Super-Resolution Vid4 - 4x upscaling SOF-VSR PSNR 26 #17 of 27 Archive leaderboard report
Video Super-Resolution Vid4 - 4x upscaling SOF-VSR SSIM 0.772 #17 of 27 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections