Papers › iSeeBetter: Spatio-Temporal Video Super Resolution using Recurrent-Generative...

iSeeBetter: Spatio-Temporal Video Super Resolution using Recurrent-Generative Back-Projection Networks

21 Jun 2020Springer Journal of Computational Visual Media (CVM), Tsinghua University Press 2020 6archive 2025-07-28

Aman Chadha, John Britto, M. Mani Roja

Recently, learning-based models have enhanced the performance of single-image super-resolution (SISR). However, applying SISR successively to each video frame leads to a lack of temporal coherency. Convolutional neural networks (CNNs) outperform traditional approaches in terms of image quality metrics such as peak signal to noise ratio (PSNR) and structural similarity (SSIM). However, generative adversarial networks (GANs) offer a competitive advantage by being able to mitigate the issue of a lack of finer texture details, usually seen with CNNs when super-resolving at large upscaling factors. We present iSeeBetter, a novel GAN-based spatio-temporal approach to video super-resolution (VSR) that renders temporally consistent super-resolution videos. iSeeBetter extracts spatial and temporal information from the current and neighboring frames using the concept of recurrent back-projection networks as its generator. Furthermore, to improve the "naturality" of the super-resolved image while eliminating artifacts seen with traditional algorithms, we utilize the discriminator from super-resolution generative adversarial network (SRGAN). Although mean squared error (MSE) as a primary loss-minimization objective improves PSNR/SSIM, these metrics may not capture fine details in the image resulting in misrepresentation of perceptual quality. To address this, we use a four-fold (MSE, perceptual, adversarial, and total-variation (TV)) loss function. Our results demonstrate that iSeeBetter offers superior VSR fidelity and surpasses state-of-the-art performance.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image Super-ResolutionSSIMSuper-ResolutionVideo Super-Resolution

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter 1 - LPIPS 0.741 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter ERQAv1.0 0.748 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter FPS 0.045 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter PSNR 31.104 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter QRCRv1.0 0.629 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter SSIM 0.896 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration iSeeBetter Subjective score 6.809 #5 of 32 Archive leaderboard report
Video Super-Resolution MSU Video Upscalers: Quality Enhancement iSeeBetter PSNR 27.42 #47 of 48 Archive leaderboard report
Video Super-Resolution MSU Video Upscalers: Quality Enhancement iSeeBetter SSIM 0.939 #47 of 48 Archive leaderboard report
Video Super-Resolution MSU Video Upscalers: Quality Enhancement iSeeBetter VMAF 57.91 #47 of 48 Archive leaderboard report
Video Super-Resolution Vimeo90K iSeeBetter PSNR 40.17 #1 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationBottleneck Residual BlockConvolutionGlobal Average PoolingKaiming InitializationMax PoolingReLUResidual BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections