Image Animation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

30 shown of 52 papers with code (94 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
  10 Jul 2023 8 repositories listed Syntology ran 3 of 10 samples · 7 unverified
  Once trained, the motion module can be inserted into a personalized T2I model to form a personalized animation generator.
• MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
  27 Nov 2023 3 repositories listed Syntology ran 3 of 10 samples · 7 unverified
  Existing animation works typically employ the frame-warping technique to animate the reference image towards the target motion.
• First Order Motion Model for Image Animation
  29 Feb 2020 3 repositories listed Syntology ran 2 of 10 samples · 8 unverified
  To achieve this, we decouple appearance and motion information using a self-supervised formulation.
• UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation
  3 Jun 2024 2 repositories listed
  First, to reduce the optimization difficulty and ensure temporal coherence, we map the reference image along with the posture guidance and noise video into a common feature space by incorporating a unified video…
• Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditions
  3 Jan 2024 2 repositories listed Syntology ran 5 of 7 samples · 2 unverified
  This work presents Moonshot, a new video generation model that conditions simultaneously on multimodal inputs of image and text.
• DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
  18 Oct 2023 2 repositories listed Syntology ran 10 of 14 samples · 4 unverified
  Animating a still image offers an engaging visual experience.
• SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
  22 Nov 2022 2 repositories listed
  We present SadTalker, which generates 3D motion coefficients (head pose, expression) of the 3DMM from audio and implicitly modulates a novel 3D-aware face render for talking head generation.
• Image Animation with Perturbed Masks
  13 Nov 2020 2 repositories listed
  We present a novel approach for image-animation of a source image by a driving video, both depicting the same type of object.
• HyperMotion: DiT-Based Pose-Guided Human Image Animation of Complex Motions
  29 May 2025 1 repository listed
  Recent advances in diffusion models have significantly improved conditional video generation, particularly in the pose-guided human image animation task.
• Video-GPT via Next Clip Diffusion
  18 May 2025 1 repository listed
  However, the language sequence is not sufficient to describe spatial-temporal details in the visual world.
• MTVCrafter: 4D Motion Tokenization for Open-World Human Image Animation
  15 May 2025 1 repository listed
  To tackle this problem, we propose MTVCrafter (Motion Tokenization Video Crafter), the first framework that directly models raw 3D motion sequences (i.
• TT-DF: A Large-Scale Diffusion-Based Dataset and Benchmark for Human Body Forgery Detection
  13 May 2025 1 repository listed
  However, when it comes to human body forgery, there has been a persistent lack of datasets and detection methods, due to the later inception and complexity of human body generation methods.
• UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformer
  15 Apr 2025 1 repository listed
  Furthermore, we adopt a simple concatenation operation to integrate the reference appearance into the model and incorporate the pose information of the reference image for enhanced pose alignment.
• Optimizing 4D Gaussians for Dynamic Scene Video from Single Landscape Images
  4 Apr 2025 1 repository listed Syntology ran 1 of 2 samples · 1 unverified · 2 pointer-only (licence)
  To achieve realistic immersion in landscape images, fluids such as water and clouds need to move within the image while revealing new scenes from various camera perspectives.
• DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation
  27 Mar 2025 1 repository listed
  To address these issues, we propose DynamiCtrl, a novel framework for human animation in video DiT architecture.
• SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers
  15 Feb 2025 1 repository listed
  We present SkyReels-A1, a simple yet effective framework built upon video diffusion Transformer to facilitate portrait image animation.
• X-Dyna: Expressive Dynamic Human Image Animation
  17 Jan 2025 1 repository listed
  At the core of our approach is the Dynamics-Adapter, a lightweight module that effectively integrates reference appearance context into the spatial attentions of the diffusion backbone while preserving the capacity of…
• DisPose: Disentangling Pose Guidance for Controllable Human Image Animation
  12 Dec 2024 1 repository listed Syntology ran 5 of 18 samples · 13 unverified · 18 pointer-only (licence)
  Specifically, we generate a dense motion field from a sparse motion field and the reference image, which provides region-level dense guidance while maintaining the generalization of the sparse pose control.
• Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
  1 Dec 2024 1 repository listed Syntology ran 6 of 23 samples · 17 unverified
  Existing methodologies for animating portrait images face significant challenges, particularly in handling non-frontal perspectives, rendering dynamic objects around the portrait, and generating immersive, realistic…
• StableAnimator: High-Quality Identity-Preserving Human Image Animation
  26 Nov 2024 1 repository listed Syntology ran 1 of 11 samples · 10 unverified
  During inference, we propose a novel Hamilton-Jacobi-Bellman (HJB) equation-based optimization to further enhance the face quality.
• JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generation
  14 Nov 2024 1 repository listed
  Specifically, in the first stage, we introduce a decoupled facial representation framework that separates dynamic facial expressions from static 3D facial representations.
• Hallo2: Long-Duration and High-Resolution Audio-Driven Portrait Image Animation
  10 Oct 2024 1 repository listed Syntology ran 6 of 10 samples · 4 unverified
  To the best of our knowledge, Hallo2, proposed in this paper, is the first method to achieve 4K resolution and generate hour-long, audio-driven portrait image animations enhanced with textual prompts.
• Dormant: Defending against Pose-driven Human Image Animation
  22 Sep 2024 1 repository listed
  Dormant applies protective perturbation to one human image, preserving the visual similarity to the original but resulting in poor-quality video generation.
• HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation
  24 Jul 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  Notably, we introduce a rule-based camera trajectory generation method, enabling the synthetic pipeline to incorporate diverse and precise camera motion annotation, which can rarely be found in real-world data.
• Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Models
  22 Jul 2024 1 repository listed
  Diffusion models have achieved great progress in image animation due to powerful generative capabilities.
• EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditions
  11 Jul 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Through the implementation of a novel training strategy, EchoMimic is capable of generating portrait videos not only by audios and facial landmarks individually, but also by a combination of both audios and selected…
• LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
  3 Jul 2024 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Instead of following mainstream diffusion-based methods, we explore and extend the potential of the implicit-keypoint-based framework, which effectively balances computational efficiency and controllability.
• Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation
  13 Jun 2024 1 repository listed Syntology ran 3 of 3 samples · 0 unverified
  Moving away from traditional paradigms that rely on parametric models for intermediate facial representations, our innovative approach embraces the end-to-end diffusion paradigm and introduces a hierarchical…
• MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model
  30 May 2024 1 repository listed Syntology ran 3 of 6 samples · 3 unverified · 6 pointer-only (licence)
  We present MOFA-Video, an advanced controllable image animation method that generates video from the given image using various additional controllable signals (such as human landmarks reference, manual trajectories, and…
• MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion
  30 May 2024 1 repository listed
  In this paper, we propose MotionFollower, a lightweight score-guided diffusion model for video motion editing.

Syntology lines on 15 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.