Papers › Video Frame Interpolation with Transformer

Video Frame Interpolation with Transformer

15 May 2022CVPR 2022 1arXiv:2205.07230archive 2025-07-28

Liying Lu, Ruizheng Wu, Huaijia Lin, Jiangbo Lu, Jiaya Jia

Video frame interpolation (VFI), which aims to synthesize intermediate frames of a video, has made remarkable progress with development of deep convolutional networks over past years. Existing methods built upon convolutional networks generally face challenges of handling large motion due to the locality of convolution operations. To overcome this limitation, we introduce a novel framework, which takes advantage of Transformer to model long-range pixel correlation among video frames. Further, our network is equipped with a novel cross-scale window-based attention mechanism, where cross-scale windows interact with each other. This design effectively enlarges the receptive field and aggregates multi-scale information. Extensive quantitative and qualitative experiments demonstrate that our method achieves new state-of-the-art results on various benchmarks.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

dvlab-research/vfiformer officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Video Frame Interpolation

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Frame Interpolation MSU Video Frame Interpolation VFIformer LPIPS 0.044 #9 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation VFIformer MS-SSIM 0.942 #9 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation VFIformer PSNR 28.34 #9 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation VFIformer SSIM 0.917 #9 of 24 Archive leaderboard report
Video Frame Interpolation MSU Video Frame Interpolation VFIformer VMAF 68.87 #9 of 24 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionBPEConvolutionDense ConnectionsDropoutLabel SmoothingLayer NormalizationLinear LayerMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionSoftmaxTransformer

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections