Text-to-Video Generation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

14 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

2 subtasks in the archive's task tree.

Most implemented papers archive 2025-07-28

30 shown of 97 papers with code (201 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• ModelScope Text-to-Video Technical Report
  12 Aug 2023 5 repositories listed Syntology ran 11 of 16 samples · 5 unverified
  This paper introduces ModelScopeT2V, a text-to-video synthesis model that evolves from a text-to-image synthesis model (i.
• Latte: Latent Diffusion Transformer for Video Generation
  5 Jan 2024 4 repositories listed Syntology ran 10 of 13 samples · 3 unverified
  We propose a novel Latent Diffusion Transformer, namely Latte, for video generation.
• VideoComposer: Compositional Video Synthesis with Motion Controllability
  3 Jun 2023 4 repositories listed Syntology ran 5 of 21 samples · 16 unverified · 1 pointer-only (licence)
  The pursuit of controllability as a higher standard of visual content creation has yielded remarkable progress in customizable image synthesis.
• Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models
  18 Apr 2023 4 repositories listed Syntology ran 18 of 26 samples · 8 unverified · 1 pointer-only (licence)
  We first pre-train an LDM on images only; then, we turn the image generator into a video generator by introducing a temporal dimension to the latent space diffusion model and fine-tuning on encoded image sequences, i.
• StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter
  1 Dec 2023 3 repositories listed Syntology ran 13 of 23 samples · 10 unverified
  To address these challenges, we introduce StyleCrafter, a generic method that enhances pre-trained T2V models with a style control adapter, enabling video generation in any style by providing a reference image.
• VideoCrafter1: Open Diffusion Models for High-Quality Video Generation
  30 Oct 2023 3 repositories listed Syntology ran 7 of 12 samples · 5 unverified
  The I2V model is designed to produce videos that strictly adhere to the content of the provided reference image, preserving its content, structure, and style.
• Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
  22 Dec 2022 3 repositories listed Syntology ran 3 of 6 samples · 3 unverified
  To replicate the success of text-to-image (T2I) generation, recent works employ large-scale video datasets to train a text-to-video (T2V) generator.
• Open-Sora: Democratizing Efficient Video Production for All
  29 Dec 2024 2 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  To facilitate the development and accessibility of artificial visual intelligence, we created Open-Sora, an open-source video generation model designed to produce high-fidelity video content.
• CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer
  12 Aug 2024 2 repositories listed Syntology ran 7 of 7 samples · 0 unverified
  We present CogVideoX, a large-scale text-to-video generation model based on diffusion transformer, which can generate 10-second continuous videos aligned with text prompt, with a frame rate of 16 fps and resolution of…
• ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation
  26 Jun 2024 2 repositories listed Syntology ran 24 of 27 samples · 3 unverified
  We propose a novel text-to-video (T2V) generation benchmark, ChronoMagic-Bench, to evaluate the temporal and metamorphic capabilities of the T2V models (e.
• VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMs
  14 Jun 2024 2 repositories listed
  Despite their impressive capabilities, current Video-LMMs have not been evaluated for anomaly detection tasks, which is critical to their deployment in practical scenarios e.
• MotionClone: Training-Free Motion Cloning for Controllable Video Generation
  8 Jun 2024 2 repositories listed Syntology ran 6 of 15 samples · 9 unverified · 15 pointer-only (licence)
  Motion-based controllable video generation offers the potential for creating captivating visual content.
• MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators
  7 Apr 2024 2 repositories listed
  Recent advances in Text-to-Video generation (T2V) have achieved remarkable success in synthesizing high-quality general videos from textual descriptions.
• VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models
  17 Jan 2024 2 repositories listed Syntology ran 14 of 21 samples · 7 unverified · 21 pointer-only (licence)
  Based on this stronger coupling, we shift the distribution to higher quality without motion degradation by finetuning spatial modules with high-quality images, resulting in a generic high-quality video model.
• LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models
  26 Sep 2023 2 repositories listed Syntology ran 1 of 2 samples · 1 unverified
  To this end, we propose LaVie, an integrated video generation framework that operates on cascaded video latent diffusion models, comprising a base T2V model, a temporal interpolation model, and a video super-resolution…
• Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator
  25 Sep 2023 2 repositories listed Syntology ran 5 of 11 samples · 6 unverified
  Text-to-video is a rapidly growing research area that aims to generate a semantic, identical, and temporal coherence sequence of frames that accurately align with the input text prompt.
• Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videos
  3 Apr 2023 2 repositories listed Syntology ran 2 of 10 samples · 8 unverified
  Generating text-editable and pose-controllable character videos have an imperious demand in creating various digital human.
• VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation
  15 Mar 2023 2 repositories listed
  A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle…
• Make-A-Video: Text-to-Video Generation without Text-Video Data
  29 Sep 2022 2 repositories listed
  We propose Make-A-Video -- an approach for directly translating the tremendous recent progress in Text-to-Image (T2I) generation to Text-to-Video (T2V).
• MUGEN: A Playground for Video-Audio-Text Multimodal Understanding and GENeration
  17 Apr 2022 2 repositories listed
  Altogether, MUGEN can help progress research in many tasks in multimodal understanding and generation.
• VCapsBench: A Large-scale Fine-grained Benchmark for Video Caption Quality Evaluation
  29 May 2025 1 repository listed
  Video captions play a crucial role in text-to-video generation tasks, as their quality directly influences the semantic coherence and visual fidelity of the generated videos.
• InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPO
  23 May 2025 1 repository listed
  Instead of accumulating the entire generation history, the policy ranks and selects the top-K most contextually relevant tokens, allowing the model to maintain a fixed computational budget while preserving content…
• LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation
  17 May 2025 1 repository listed
  To this end, we present AIGVE-60K, a comprehensive dataset and benchmark for AI-Generated Video Evaluation, which features (i) comprehensive tasks, encompassing 3, 050 extensive prompts across 20 fine-grained task…
• On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices
  31 Mar 2025 1 repository listed
  These results show that On-device Sora enables efficient and high-quality video generation on resource-constrained mobile devices.
• VPO: Aligning Text-to-Video Generation Models with Prompt Optimization
  26 Mar 2025 1 repository listed
  First, we construct and refine a supervised fine-tuning (SFT) dataset based on principles of safety and alignment.
• RecTable: Fast Modeling Tabular Data with Rectified Flow
  26 Mar 2025 1 repository listed
  Score-based or diffusion models generate high-quality tabular data, surpassing GAN-based and VAE-based models.
• Protecting Your Video Content: Disrupting Automated Video-based LLM Annotations
  26 Mar 2025 1 repository listed
  Extensive experiments demonstrate that our video watermarking methods effectively protect video data by significantly reducing video annotation performance across various video-based LLMs, showcasing both stealthiness…
• Enabling Versatile Controls for Video Diffusion Models
  21 Mar 2025 1 repository listed
  Despite substantial progress in text-to-video generation, achieving precise and flexible control over fine-grained spatiotemporal attributes remains a significant unresolved challenge in video generation research.
• VideoUFO: A Million-Scale User-Focused Dataset for Text-to-Video Generation
  3 Mar 2025 1 repository listed
  The VideoUFO comprises over 1.
• VidCapBench: A Comprehensive Benchmark of Video Captioning for Controllable Text-to-Video Generation
  18 Feb 2025 1 repository listed
  The training of controllable text-to-video (T2V) models relies heavily on the alignment between videos and captions, yet little existing research connects video caption evaluation with T2V generation assessment.

Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.