Image to Video Generation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

7 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 38 papers with code (85 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Collaborative Neural Rendering using Anime Character Sheets
  12 Jul 2022 4 repositories listed
  Drawing images of characters with desired poses is an essential but laborious task in anime production.
• Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
  25 Nov 2023 3 repositories listed Syntology ran 0 of 4 samples · 4 unverified
  We then explore the impact of finetuning our base model on high-quality data and train a text-to-video model that is competitive with closed-source video generation.
• Open-Sora: Democratizing Efficient Video Production for All
  29 Dec 2024 2 repositories listed Syntology ran 0 of 3 samples · 3 unverified
  To facilitate the development and accessibility of artificial visual intelligence, we created Open-Sora, an open-source video generation model designed to produce high-fidelity video content.
• SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields
  5 Dec 2022 2 repositories listed
  3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability.
• Lifespan Age Transformation Synthesis
  21 Mar 2020 2 repositories listed
  Most existing aging methods are limited to changing the texture, overlooking transformations in head shape that occur during the human aging and growth process.
• Video Generation from Single Semantic Label Map
  11 Mar 2019 2 repositories listed
  This paper proposes the novel task of video generation conditioned on a SINGLE semantic label map, which provides a good balance between flexibility and quality in the generation process.
• Every Painting Awakened: A Training-free Framework for Painting-to-Animation Generation
  31 Mar 2025 1 repository listed
  Our approach introduces synthetic proxy images through two key innovations: (1) Dual-path score distillation: We employ a dual-path architecture to distill motion priors from both real and synthetic data, preserving…
• Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Model
  14 Mar 2025 1 repository listed
  We present Step-Video-TI2V, a state-of-the-art text-driven image-to-video generation model with 30B parameters, capable of generating videos up to 102 frames based on both text and image inputs.
• DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidance
  5 Mar 2025 1 repository listed
  In this work, we present DualDiff, a dual-branch conditional diffusion model designed to enhance driving scene generation across multiple views and video sequences.
• Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think
  2 Mar 2025 1 repository listed Syntology ran 6 of 15 samples · 9 unverified
  (3) With the above two-stage models excelling in motion controllability and degree, we decouple the relevant parameters associated with each type of motion ability and inject them into the base I2V-DM.
• Object-Centric Image to Video Generation with Language Guidance
  17 Feb 2025 1 repository listed
  Accurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events.
• Magic 1-For-1: Generating One Minute Video Clips within One Minute
  11 Feb 2025 1 repository listed
  The key idea is simple: factorize the text-to-video generation task into two separate easier tasks for diffusion step distillation, namely text-to-image generation and image-to-video generation.
• FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
  14 Jan 2025 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  We highlight the effectiveness and efficiency of FramePainter across various of editing signals: it domainantly outperforms previous state-of-the-art methods with far less training data, achieving highly seamless and…
• LTX-Video: Realtime Video Latent Diffusion
  30 Dec 2024 1 repository listed Syntology ran 0 of 9 samples · 9 unverified
  To address this, our VAE decoder is tasked with both latent-to-pixel conversion and the final denoising step, producing the clean result directly in pixel space.
• AniSora: Exploring the Frontiers of Animation Video Generation in the Sora Era
  13 Dec 2024 1 repository listed
  In this paper, we present a comprehensive system, AniSora, designed for animation video generation, which includes a data processing pipeline, a controllable generation model, and an evaluation benchmark.
• Identity-Preserving Text-to-Video Generation by Frequency Decomposition
  26 Nov 2024 1 repository listed
  We propose a hierarchical training strategy to leverage frequency information for identity preservation, transforming a vanilla pre-trained video generation model into an IPT2V model.
• VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models
  20 Nov 2024 1 repository listed
  Video generation has witnessed significant advancements, yet evaluating these models remains a challenge.
• EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
  15 Nov 2024 1 repository listed Syntology ran 1 of 5 samples · 4 unverified
  Recent work on human animation usually involves audio, pose, or movement maps conditions, thereby achieves vivid animation quality.
• Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances
  24 Oct 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  Current image watermarking methods are vulnerable to advanced image editing techniques enabled by large-scale text-to-image models.
• Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach
  4 Oct 2024 1 repository listed Syntology ran 7 of 10 samples · 3 unverified
  Diffusion models have revolutionized image generation, and their extension to video generation has shown promise.
• PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation
  27 Sep 2024 1 repository listed Syntology ran 2 of 2 samples · 0 unverified · 2 pointer-only (licence)
  We present PhysGen, a novel image-to-video generation method that converts a single image and an input condition (e.
• GenRec: Unifying Video Generation and Recognition with Diffusion Models
  27 Aug 2024 1 repository listed
  In this paper, we aim to investigate whether such priors derived from a generative process are suitable for video recognition, and eventually joint optimization of generation and recognition.
• MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  30 Jul 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  To fulfill this gap, we present MMTrail, a large-scale multi-modality video-language dataset incorporating more than 20M trailer clips with visual captions, and 2M high-quality clips with multimodal captions.
• MVOC: a training-free multiple video object composition method with diffusion models
  22 Jun 2024 1 repository listed
  Although image composition based on diffusion models has been highly successful, it is not straightforward to extend the achievement to video object composition tasks, which not only exhibit corresponding interaction…
• TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation
  12 Jun 2024 1 repository listed Syntology ran 5 of 5 samples · 0 unverified
  Video generation has many unique challenges beyond those of image generation.
• TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models
  25 Apr 2024 1 repository listed
  To guide video generation with the additional image input, we propose a "repeat-and-slide" strategy that modulates the reverse denoising process, allowing the frozen diffusion model to synthesize a video frame-by-frame…
• AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Tasks
  21 Mar 2024 1 repository listed Syntology ran 2 of 7 samples · 5 unverified
  AnyV2V can leverage any existing image editing tools to support an extensive array of video editing tasks, including prompt-based editing, reference-based style transfer, subject-driven editing, and identity…
• Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance
  21 Mar 2024 1 repository listed Syntology ran 1 of 5 samples · 4 unverified
  In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human…
• Mora: Enabling Generalist Video Generation via A Multi-Agent Framework
  20 Mar 2024 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Existing open-source methods struggle to achieve comparable performance, often hindered by ineffective agent collaboration and inadequate training data quality.
• Follow-Your-Click: Open-domain Regional Image Animation via Short Prompts
  13 Mar 2024 1 repository listed Syntology ran 5 of 9 samples · 4 unverified · 9 pointer-only (licence)
  Despite recent advances in image-to-video generation, better controllability and local animation are less explored.

Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.