Papers › TDAN: Temporally Deformable Alignment Network for Video Super-Resolution

TDAN: Temporally Deformable Alignment Network for Video Super-Resolution

7 Dec 2018arXiv:1812.02898archive 2025-07-28

Yapeng Tian, Yulun Zhang, Yun Fu, Chenliang Xu

Video super-resolution (VSR) aims to restore a photo-realistic high-resolution (HR) video frame from both its corresponding low-resolution (LR) frame (reference frame) and multiple neighboring frames (supporting frames). Due to varying motion of cameras or objects, the reference frame and each support frame are not aligned. Therefore, temporal alignment is a challenging yet important problem for VSR. Previous VSR methods usually utilize optical flow between the reference frame and each supporting frame to wrap the supporting frame for temporal alignment. Therefore, the performance of these image-level wrapping-based models will highly depend on the prediction accuracy of optical flow, and inaccurate optical flow will lead to artifacts in the wrapped supporting frames, which also will be propagated into the reconstructed HR video frame. To overcome the limitation, in this paper, we propose a temporal deformable alignment network (TDAN) to adaptively align the reference frame and each supporting frame at the feature level without computing optical flow. The TDAN uses features from both the reference frame and each supporting frame to dynamically predict offsets of sampling convolution kernels. By using the corresponding kernels, TDAN transforms supporting frames to align with the reference frame. To predict the HR video frame, a reconstruction network taking aligned frames and the reference frame is utilized. Experimental results demonstrate the effectiveness of the proposed TDAN-based VSR model.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

YapengTian/TDAN-VSR-CVPR-2020 mentioned on GitHubpytorchMIT report
YapengTian/TDAN_VSR mentioned on GitHubpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Optical Flow EstimationSuper-ResolutionVideo Super-Resolution

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN 1 - LPIPS 0.721 #12 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN ERQAv1.0 0.706 #12 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN FPS 0.493 #12 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN PSNR 30.244 #12 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN QRCRv1.0 0.609 #12 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN SSIM 0.883 #12 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TDAN Subjective score 5.454 #12 of 32 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections