Papers › Video Frame Interpolation with Transformer
Video Frame Interpolation with Transformer
Liying Lu, Ruizheng Wu, Huaijia Lin, Jiangbo Lu, Jiaya Jia
Video frame interpolation (VFI), which aims to synthesize intermediate frames of a video, has made remarkable progress with development of deep convolutional networks over past years. Existing methods built upon convolutional networks generally face challenges of handling large motion due to the locality of convolution operations. To overcome this limitation, we introduce a novel framework, which takes advantage of Transformer to model long-range pixel correlation among video frames. Further, our network is equipped with a novel cross-scale window-based attention mechanism, where cross-scale windows interact with each other. This design effectively enlarges the receptive field and aggregates multi-scale information. Extensive quantitative and qualitative experiments demonstrate that our method achieves new state-of-the-art results on various benchmarks.
In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.
Code
Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.
Code Syntology ran Syntology
Not run by Syntology. Nothing on this page verifies that the listed code works.
Tasks
Results from the paper archive 2025-07-28
| Task | Dataset | Model | Metric | Value | Rank at snapshot | Leaderboard | Report |
|---|---|---|---|---|---|---|---|
| Video Frame Interpolation | MSU Video Frame Interpolation | VFIformer | LPIPS | 0.044 | #9 of 24 | Archive leaderboard | report |
| Video Frame Interpolation | MSU Video Frame Interpolation | VFIformer | MS-SSIM | 0.942 | #9 of 24 | Archive leaderboard | report |
| Video Frame Interpolation | MSU Video Frame Interpolation | VFIformer | PSNR | 28.34 | #9 of 24 | Archive leaderboard | report |
| Video Frame Interpolation | MSU Video Frame Interpolation | VFIformer | SSIM | 0.917 | #9 of 24 | Archive leaderboard | report |
| Video Frame Interpolation | MSU Video Frame Interpolation | VFIformer | VMAF | 68.87 | #9 of 24 | Archive leaderboard | report |
Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.
Methods
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections