Papers › Imagen Video: High Definition Video Generation with Diffusion Models

Imagen Video: High Definition Video Generation with Diffusion Models

5 Oct 2022arXiv:2210.02303archive 2025-07-28

Jonathan Ho, William Chan, Chitwan Saharia, Jay Whang, Ruiqi Gao, Alexey Gritsenko, Diederik P. Kingma, Ben Poole, Mohammad Norouzi, David J. Fleet, Tim Salimans

We present Imagen Video, a text-conditional video generation system based on a cascade of video diffusion models. Given a text prompt, Imagen Video generates high definition videos using a base video generation model and a sequence of interleaved spatial and temporal video super-resolution models. We describe how we scale up the system as a high definition text-to-video model including design decisions such as the choice of fully-convolutional temporal and spatial super-resolution models at certain resolutions, and the choice of the v-parameterization of diffusion models. In addition, we confirm and transfer findings from previous work on diffusion-based image generation to the video generation setting. Finally, we apply progressive distillation to our video models with classifier-free guidance for fast, high quality sampling. We find Imagen Video not only capable of generating videos of high fidelity, but also having a high degree of controllability and world knowledge, including the ability to generate diverse videos and text animations in various artistic styles and with 3D object understanding. See https://imagen.research.google/video/ for samples.

PaperPDF

In Syntology View this paper on Syntology: its repositories, every harvested function with whether it ran, its licence and the call to fetch it.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image GenerationSuper-ResolutionVideo GenerationVideo Super-ResolutionVocal Bursts Intensity PredictionWorld Knowledge

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Generation LAION-400M Imagen original (constant=6) CLIP 25.19 #1 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen original (constant=6) CLIP R-Precision 92.12 #1 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen fully distilled (oscillate (15,1)) CLIP R-Precision 90.97 #2 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen distilled (constant=6) CLIP 25.29 #3 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen distilled (constant=6) CLIP R-Precision 90.88 #3 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen original (oscillate(15,1)) CLIP 25.03 #4 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen original (oscillate(15,1)) CLIP R-Precision 89.91 #4 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen fully distilled (constant=6) CLIP R-Precision 89.68 #5 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen distilled (oscillate (15,1)) CLIP 25.12 #6 of 6 Archive leaderboard report
Video Generation LAION-400M Imagen distilled (oscillate (15,1)) CLIP R-Precision 88.78 #6 of 6 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

BASEDiffusion

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections