Browse State-of-the-Art › Image to Video Generation
Image to Video Generation
38 papers with code · 0 benchmarks · 7 datasets archive 2025-07-28
Image to Video Generation refers to the task of generating a sequence of video frames based on a single still image or a set of still images. The goal is to produce a video that is coherent and consistent in terms of appearance, motion, and style, while also being temporally consistent, meaning that the generated video should look like a coherent sequence of frames that are temporally ordered. This task is typically tackled using deep generative models, such as Generative Adversarial Networks (GANs) or Variational Autoencoders (VAEs), that are trained on large datasets of videos. The models learn to generate plausible video frames that are conditioned on the input image, as well as on any other auxiliary information, such as a sound or text track.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
7 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
1 subtask in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 85 · with a code link: 38 · where Syntology ran a sample: 22 (18 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (22 of 85 tagged: 18 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 85 of 85, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Jul 2022 4 repositories listedDrawing images of characters with desired poses is an essential but laborious task in anime production.
-
25 Nov 2023 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)We then explore the impact of finetuning our base model on high-quality data and train a text-to-video model that is competitive with closed-source video generation.
-
29 Dec 2024 2 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)To facilitate the development and accessibility of artificial visual intelligence, we created Open-Sora, an open-source video generation model designed to produce high-fidelity video content.
-
5 Dec 2022 2 repositories listed3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability.
-
21 Mar 2020 2 repositories listedMost existing aging methods are limited to changing the texture, overlooking transformations in head shape that occur during the human aging and growth process.
-
11 Mar 2019 2 repositories listedThis paper proposes the novel task of video generation conditioned on a SINGLE semantic label map, which provides a good balance between flexibility and quality in the generation process.
-
31 Mar 2025 1 repository listedOur approach introduces synthetic proxy images through two key innovations: (1) Dual-path score distillation: We employ a dual-path architecture to distill motion priors from both real and synthetic data, preserving…
-
14 Mar 2025 1 repository listedWe present Step-Video-TI2V, a state-of-the-art text-driven image-to-video generation model with 30B parameters, capable of generating videos up to 102 frames based on both text and image inputs.
-
5 Mar 2025 1 repository listedIn this work, we present DualDiff, a dual-branch conditional diffusion model designed to enhance driving scene generation across multiple views and video sequences.
-
2 Mar 2025 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 15 harvested samples) · 4 pointer-only (licence)(3) With the above two-stage models excelling in motion controllability and degree, we decouple the relevant parameters associated with each type of motion ability and inject them into the base I2V-DM.
-
17 Feb 2025 1 repository listedAccurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events.
-
11 Feb 2025 1 repository listedThe key idea is simple: factorize the text-to-video generation task into two separate easier tasks for diffusion step distillation, namely text-to-image generation and image-to-video generation.
-
14 Jan 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We highlight the effectiveness and efficiency of FramePainter across various of editing signals: it domainantly outperforms previous state-of-the-art methods with far less training data, achieving highly seamless and…
-
30 Dec 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples)To address this, our VAE decoder is tasked with both latent-to-pixel conversion and the final denoising step, producing the clean result directly in pixel space.
-
13 Dec 2024 1 repository listedIn this paper, we present a comprehensive system, AniSora, designed for animation video generation, which includes a data processing pipeline, a controllable generation model, and an evaluation benchmark.
-
26 Nov 2024 1 repository listedWe propose a hierarchical training strategy to leverage frequency information for identity preservation, transforming a vanilla pre-trained video generation model into an IPT2V model.
-
20 Nov 2024 1 repository listedVideo generation has witnessed significant advancements, yet evaluating these models remains a challenge.
-
15 Nov 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)Recent work on human animation usually involves audio, pose, or movement maps conditions, thereby achieves vivid animation quality.
-
24 Oct 2024 1 repository listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Current image watermarking methods are vulnerable to advanced image editing techniques enabled by large-scale text-to-image models.
-
4 Oct 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)Diffusion models have revolutionized image generation, and their extension to video generation has shown promise.
-
27 Sep 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)We present PhysGen, a novel image-to-video generation method that converts a single image and an input condition (e. g., force and torque applied to an object in the image) to produce a realistic, physically plausible…
-
27 Aug 2024 1 repository listedIn this paper, we aim to investigate whether such priors derived from a generative process are suitable for video recognition, and eventually joint optimization of generation and recognition.
-
30 Jul 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)To fulfill this gap, we present MMTrail, a large-scale multi-modality video-language dataset incorporating more than 20M trailer clips with visual captions, and 2M high-quality clips with multimodal captions.
-
22 Jun 2024 1 repository listedAlthough image composition based on diffusion models has been highly successful, it is not straightforward to extend the achievement to video object composition tasks, which not only exhibit corresponding interaction…
-
12 Jun 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)Video generation has many unique challenges beyond those of image generation.
-
25 Apr 2024 1 repository listedTo guide video generation with the additional image input, we propose a "repeat-and-slide" strategy that modulates the reverse denoising process, allowing the frozen diffusion model to synthesize a video frame-by-frame…
-
21 Mar 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 7 harvested samples) · 2 pointer-only (licence)AnyV2V can leverage any existing image editing tools to support an extensive array of video editing tasks, including prompt-based editing, reference-based style transfer, subject-driven editing, and identity…
-
21 Mar 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples)In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human…
-
20 Mar 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)Existing open-source methods struggle to achieve comparable performance, often hindered by ineffective agent collaboration and inadequate training data quality.
-
13 Mar 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)Despite recent advances in image-to-video generation, better controllability and local animation are less explored.
-
6 Feb 2024 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 2 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 2 pointer-only (licence)
-
6 Dec 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (of 14 harvested samples)
-
29 Nov 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 2 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
21 Nov 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
24 Mar 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 4 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 2 pointer-only (licence)
-
7 Mar 2023 1 repository listed
-
6 Dec 2021 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 3 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples) · 1 pointer-only (licence)
-
GeoMan: Temporally Consistent Human Geometry Estimation using Image-to-Video Diffusion29 May 2025 0 repositories listed
-
ATI: Any Trajectory Instruction for Controllable Video Generation28 May 2025 0 repositories listed
-
Dynamic-I2V: Exploring Image-to-Video Generaion Models via Multimodal LLM26 May 2025 0 repositories listed
-
MotionPro: A Precise Motion Controller for Image-to-Video Generation26 May 2025 0 repositories listed
-
Hunyuan-Game: Industrial-grade Intelligent Game Creation Model20 May 2025 0 repositories listed
-
LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer20 May 2025 0 repositories listed
-
MG-Gen: Single Image to Motion Graphics Generation with Layer Decomposition3 Apr 2025 0 repositories listed
-
Towards Physically Plausible Video Generation via VLM Planning30 Mar 2025 0 repositories listed
-
EvAnimate: Event-conditioned Image-to-Video Generation for Human Animation24 Mar 2025 0 repositories listed
-
MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidance20 Mar 2025 0 repositories listed
-
I2V3D: Controllable image-to-video generation with 3D guidance12 Mar 2025 0 repositories listed
-
RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Control14 Feb 2025 0 repositories listed
-
VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generation11 Feb 2025 0 repositories listed
-
MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation6 Feb 2025 0 repositories listed
-
MotionAgent: Fine-grained Controllable Video Generation via Motion Field Agent5 Feb 2025 0 repositories listed
-
Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generation6 Jan 2025 0 repositories listed
-
I2VGuard: Safeguarding Images against Misuse in Diffusion-based Image-to-Video Models1 Jan 2025 0 repositories listed
-
Generative Video Propagation27 Dec 2024 0 repositories listed
-
SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults22 Dec 2024 0 repositories listed
-
TIV-Diffusion: Towards Object-Centric Movement for Text-driven Image to Video Generation13 Dec 2024 0 repositories listed
-
OmniDrag: Enabling Motion Control for Omnidirectional Image-to-Video Generation12 Dec 2024 0 repositories listed
-
MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation8 Dec 2024 0 repositories listed
-
Fleximo: Towards Flexible Text-to-Human Motion Video Generation29 Nov 2024 0 repositories listed
-
A Survey of Emerging Approaches and Advances in Video Generation9 Nov 2024 0 repositories listed
-
SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generation7 Nov 2024 0 repositories listed
-
TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation5 Nov 2024 0 repositories listed
-
MarDini: Masked Autoregressive Diffusion for Video Generation at Scale26 Oct 2024 0 repositories listed
-
FrameBridge: Improving Image-to-Video Generation with Bridge Models20 Oct 2024 0 repositories listed
-
Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attention14 Oct 2024 0 repositories listed
-
OSV: One Step is Enough for High-Quality Image to Video Generation17 Sep 2024 0 repositories listed
-
Factorized-Dreamer: Training A High-Quality Video Generator with Limited and Low-Quality Data19 Aug 2024 0 repositories listed
-
Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model22 Jun 2024 0 repositories listed
-
CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation4 Jun 2024 0 repositories listed
-
CamViG: Camera Aware Image-to-Video Generation with Multimodal Transformers21 May 2024 0 repositories listed
-
Dance Any Beat: Blending Beats with Visuals in Dance Video Generation15 May 2024 0 repositories listed
-
AniClipart: Clipart Animation with Text-to-Video Priors18 Apr 2024 0 repositories listed
-
TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models25 Mar 2024 0 repositories listed
-
Tuning-Free Noise Rectification for High Fidelity Image-to-Video Generation5 Mar 2024 0 repositories listed
-
AtomoVideo: High Fidelity Image-to-Video Generation4 Mar 2024 0 repositories listed
-
Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling29 Jan 2024 0 repositories listed
-
DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidance5 Dec 2023 0 repositories listed
-
Decouple Content and Motion for Conditional Image-to-Video Generation24 Nov 2023 0 repositories listed
-
MoVideo: Motion-Aware Video Generation with Diffusion Models19 Nov 2023 0 repositories listed
-
Dreamix: Video Diffusion Models are General Video Editors2 Feb 2023 0 repositories listed
-
Image-to-Video Generation via 3D Facial Dynamics31 May 2021 0 repositories listed
-
TiVGAN: Text to Image to Video Generation with Step-by-Step Evolutionary Generator4 Sep 2020 0 repositories listed
-
Self-Training for Domain Adaptive Scene Text Detection23 May 2020 0 repositories listed
Syntology lines on 22 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections