Portrait Animation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

13 shown of 13 papers with code (32 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• MegActor-Σ: Unlocking Flexible Mixed-Modal Control in Portrait Animation with Diffusion Transformer
  27 Aug 2024 2 repositories listed
  To address this issue, we introduce MegActor-Σ: a mixed-modal conditional diffusion transformer (DiT), which can flexibly inject audio and visual modality control signals into portrait animation.
• MegActor: Harness the Power of Raw Video for Vivid Portrait Animation
  31 May 2024 2 repositories listed Syntology ran 9 of 17 samples · 8 unverified
  Despite raw driving videos contain richer information on facial expressions than intermediate representations such as landmarks in the field of portrait animation, they are seldom the subject of research.
• AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
  26 Mar 2024 2 repositories listed Syntology ran 6 of 11 samples · 5 unverified
  In this study, we propose AniPortrait, a novel framework for generating high-quality animation driven by audio and a reference portrait image.
• Hallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimization and Temporal Motion Modulation
  29 May 2025 1 repository listed
  Generating highly dynamic and photorealistic portrait animations driven by audio and skeletal motion remains challenging due to the need for precise lip synchronization, natural facial expressions, and high-fidelity…
• High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Model
  27 Feb 2025 1 repository listed Syntology ran 1 of 7 samples · 6 unverified
  We address this limitation by distinguishing these feature types through dedicated subspaces within the feature space of a pre-trained image-to-video diffusion model.
• SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers
  15 Feb 2025 1 repository listed
  We present SkyReels-A1, a simple yet effective framework built upon video diffusion Transformer to facilitate portrait image animation.
• GoHD: Gaze-oriented and Highly Disentangled Portrait Animation with Rhythmic Poses and Realistic Expression
  12 Dec 2024 1 repository listed
  Audio-driven talking head generation necessitates seamless integration of audio and visual data amidst the challenges posed by diverse input portraits and intricate correlations between audio and facial motions.
• LatentSync: Audio Conditioned Latent Diffusion Models for Lip Sync
  12 Dec 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Since we did not change the overall training framework of SyncNet, our experience can also be applied to other lip sync and audio-driven portrait animation methods that utilize SyncNet.
• Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
  1 Dec 2024 1 repository listed Syntology ran 6 of 23 samples · 17 unverified
  Existing methodologies for animating portrait images face significant challenges, particularly in handling non-frontal perspectives, rendering dynamic objects around the portrait, and generating immersive, realistic…
• JoyVASA: Portrait and Animal Image Animation with Diffusion-Based Audio-Driven Facial Dynamics and Head Motion Generation
  14 Nov 2024 1 repository listed
  Specifically, in the first stage, we introduce a decoupled facial representation framework that separates dynamic facial expressions from static 3D facial representations.
• EMOdiffhead: Continuously Emotional Control in Talking Head Generation via Diffusion
  11 Sep 2024 1 repository listed
  In response to this challenge, we propose EMOdiffhead, a novel method for emotional talking head video generation that not only enables fine-grained control of emotion categories and intensities but also enables…
• LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
  3 Jul 2024 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  Instead of following mainstream diffusion-based methods, we explore and extend the potential of the implicit-keypoint-based framework, which effectively balances computational efficiency and controllability.
• Fast Deep Matting for Portrait Animation on Mobile Phone
  26 Jul 2017 1 repository listed
  Finally, an automatic portrait animation system based on fast deep matting is built on mobile devices, which does not need any interaction and can realize real-time matting with 15 fps.

Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.