Browse State-of-the-Art › Portrait Animation
Portrait Animation
13 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
The person is looking directly at the camera to express his feelings, showcasing his emotions and sense of humor while speaking.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 32 · with a code link: 13 · where Syntology ran a sample: 6 (5 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (6 of 32 tagged: 5 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 32 of 32, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
27 Aug 2024 2 repositories listedTo address this issue, we introduce MegActor-Σ: a mixed-modal conditional diffusion transformer (DiT), which can flexibly inject audio and visual modality control signals into portrait animation.
-
31 May 2024 2 repositories listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 8 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 2 pointer-only (licence)Despite raw driving videos contain richer information on facial expressions than intermediate representations such as landmarks in the field of portrait animation, they are seldom the subject of research.
-
26 Mar 2024 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples)In this study, we propose AniPortrait, a novel framework for generating high-quality animation driven by audio and a reference portrait image.
-
29 May 2025 1 repository listedGenerating highly dynamic and photorealistic portrait animations driven by audio and skeletal motion remains challenging due to the need for precise lip synchronization, natural facial expressions, and high-fidelity…
-
27 Feb 2025 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)We address this limitation by distinguishing these feature types through dedicated subspaces within the feature space of a pre-trained image-to-video diffusion model.
-
15 Feb 2025 1 repository listedWe present SkyReels-A1, a simple yet effective framework built upon video diffusion Transformer to facilitate portrait image animation.
-
12 Dec 2024 1 repository listedAudio-driven talking head generation necessitates seamless integration of audio and visual data amidst the challenges posed by diverse input portraits and intricate correlations between audio and facial motions.
-
12 Dec 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Since we did not change the overall training framework of SyncNet, our experience can also be applied to other lip sync and audio-driven portrait animation methods that utilize SyncNet.
-
1 Dec 2024 1 repository listed Syntology official (archive's flag): 21 ran · 21 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 4 violated, 5 with no contract checked; 11 where Syntology's instrument failed) · 2 unverified (of 23 harvested samples) · 2 pointer-only (licence)Existing methodologies for animating portrait images face significant challenges, particularly in handling non-frontal perspectives, rendering dynamic objects around the portrait, and generating immersive, realistic…
-
14 Nov 2024 1 repository listedSpecifically, in the first stage, we introduce a decoupled facial representation framework that separates dynamic facial expressions from static 3D facial representations.
-
11 Sep 2024 1 repository listedIn response to this challenge, we propose EMOdiffhead, a novel method for emotional talking head video generation that not only enables fine-grained control of emotion categories and intensities but also enables…
-
3 Jul 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)Instead of following mainstream diffusion-based methods, we explore and extend the potential of the implicit-keypoint-based framework, which effectively balances computational efficiency and controllability.
-
26 Jul 2017 1 repository listedFinally, an automatic portrait animation system based on fast deep matting is built on mobile devices, which does not need any interaction and can realize real-time matting with 15 fps.
-
HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animation24 Mar 2025 0 repositories listedWe introduce HunyuanPortrait, a diffusion-based condition control method that employs implicit representations for highly controllable and lifelike portrait animation.
-
Teller: Real-Time Streaming Audio-Driven Portrait Animation with Autoregressive Motion Generation24 Mar 2025 0 repositories listedIn this work, we introduce the first autoregressive framework for real-time, audio-driven portrait animation, a.k.a, talking head.
-
MagicInfinite: Generating Infinite Talking Videos with Your Words and Voice7 Mar 2025 0 repositories listedWe present MagicInfinite, a novel diffusion Transformer (DiT) framework that overcomes traditional portrait animation limitations, delivering high-fidelity results across diverse character types-realistic humans…
-
FaceShot: Bring Any Character into Life2 Mar 2025 0 repositories listedIn this paper, we present FaceShot, a novel training-free portrait animation framework designed to bring any character into life from any driven video without fine-tuning or retraining.
-
Playmate: Flexible Control of Portrait Animation via 3D-Implicit Space Guided Diffusion11 Feb 2025 0 repositories listedRecent diffusion-based talking face generation models have demonstrated impressive potential in synthesizing videos that accurately match a speech audio clip with a given reference identity.
-
Joint Learning of Depth and Appearance for Portrait Image Animation15 Jan 2025 0 repositories listed2D portrait animation has experienced significant advancements in recent years.
-
MoEE: Mixture of Emotion Experts for Audio-Driven Portrait Animation3 Jan 2025 0 repositories listedThe generation of talking avatars has achieved significant advancements in precise audio synchronization.
-
MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animation1 Jan 2025 0 repositories listedRecent portrait animation methods have made significant strides in generating realistic lip synchronization.
-
MEMO: Memory-Guided Diffusion for Expressive Talking Video Generation5 Dec 2024 0 repositories listedRecent advances in video diffusion models have unlocked new potential for realistic audio-driven talking video generation.
-
Sonic: Shifting Focus to Global Audio Perception in Portrait Animation25 Nov 2024 0 repositories listedThe study of talking face generation mainly explores the intricacies of synchronizing facial movements and crafting visually appealing, temporally-coherent animations.
-
Takin-ADA: Emotion Controllable Audio-Driven Animation with Canonical and Landmark Loss Optimization18 Oct 2024 0 repositories listedExisting audio-driven facial animation methods face critical challenges, including expression leakage, ineffective subtle expression transfer, and imprecise audio-driven synchronization.
-
MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devices8 Jul 2024 0 repositories listedExisting neural head avatars methods have achieved significant progress in the image quality and motion range of portrait animation.
-
Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation4 Jun 2024 0 repositories listedWe present Follow-Your-Emoji, a diffusion-based framework for portrait animation, which animates a reference portrait with target landmark sequences.
-
Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animation31 Mar 2024 0 repositories listedIn this paper, we present Export3D, a one-shot 3D-aware portrait animation method that is able to control the facial expression and camera view of a given portrait image.
-
X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attention23 Mar 2024 0 repositories listedWe propose X-Portrait, an innovative conditional diffusion model tailored for generating expressive and temporally coherent portrait animation.
-
SingingHead: A Large-scale 4D Dataset for Singing Head Animation7 Dec 2023 0 repositories listedSinging, as a common facial movement second only to talking, can be regarded as a universal language across ethnicities and cultures, plays an important role in emotional communication, art, and entertainment.
-
MODA: Mapping-Once Audio-driven Portrait Animation with Dual Attentions19 Jul 2023 0 repositories listedAudio-driven portrait animation aims to synthesize portrait videos that are conditioned by given audio.
-
SPACE: Speech-driven Portrait Animation with Controllable Expression17 Nov 2022 0 repositories listed
-
PuppeteerGAN: Arbitrary Portrait Animation With Semantic-Aware Appearance Transformation1 Jun 2020 0 repositories listed
Syntology lines on 6 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections