Papers › Enhanced Correlation Matching based Video Frame Interpolation

Enhanced Correlation Matching based Video Frame Interpolation

17 Nov 2021arXiv:2111.08869archive 2025-07-28

Sungho Lee, Narae Choi, Woong Il Choi

We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of the network model according to resolution, the proposed scheme employs the recurrent pyramid architecture that shares the parameters among each pyramid layer for optical flow estimation. In the proposed flow estimation, the optical flows are recursively refined by tracing the location with maximum correlation. The forward warping based correlation matching enables to improve the accuracy of flow update by excluding incorrectly warped features around the occlusion area. Based on the final bi-directional flows, the intermediate frame at arbitrary temporal position is synthesized using the warping and blending network and it is further improved by refinement network. Experiment results demonstrate that the proposed scheme outperforms the previous works at 4K video data and low-resolution benchmark datasets as well in terms of objective and subjective quality with the smallest number of model parameters.

PaperPDF

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

4kOptical Flow EstimationVideo Frame Interpolation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Frame Interpolation Vimeo90K ECMNet PSNR 34.95 #17 of 23 Archive leaderboard report
Video Frame Interpolation Vimeo90K ECMNet SSIM 0.9749 #17 of 23 Archive leaderboard report
Video Frame Interpolation X4K1000FPS ECMNet PSNR 30.51 #9 of 20 Archive leaderboard report
Video Frame Interpolation X4K1000FPS ECMNet SSIM 0.8719 #9 of 20 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections