3D Face Animation

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. A dash means no Syntology record for that paper, not a recorded non-run. Read from the graph 2026-09-24.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

6 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

1 subtask in the archive's task tree.

Parent tasks archive 2025-07-28

Most implemented papers archive 2025-07-28

25 shown of 25 papers with code (34 tagged with this task in all), ordered by repositories listed in the archive, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers without a page here are shown as plain text.

• Learning a model of facial shape and expression from 4D scans
  1 Nov 2017 9 repositories listed
  FLAME is low-dimensional but more expressive than the FaceWarehouse model and the Basel Face Model.
• Generating Holistic 3D Human Motion from Speech
  8 Dec 2022 3 repositories listed
  This work addresses the problem of generating 3D holistic body motions from human speech.
• EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation
  20 Mar 2023 2 repositories listed Syntology ran 4 of 7 samples · 3 unverified · 7 pointer-only (licence)
  Specifically, we introduce the emotion disentangling encoder (EDE) to disentangle the emotion and content in the speech by cross-reconstructed speech signals with different emotion labels.
• MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement
  16 Apr 2021 2 repositories listed Syntology ran 2 of 3 samples · 1 unverified · 3 pointer-only (licence)
  To improve upon existing models, we propose a generic audio-driven facial animation approach that achieves highly realistic motion synthesis results for the entire face.
• Learning an Animatable Detailed 3D Face Model from In-The-Wild Images
  7 Dec 2020 2 repositories listed
  Some methods produce faces that cannot be realistically animated because they do not model how wrinkles vary with expression.
• DiffusionTalker: Efficient and Compact Speech-Driven 3D Talking Head via Personalizer-Guided Distillation
  23 Mar 2025 1 repository listed
  We further propose a personalizer enhancer during distillation to enhance the influence of embeddings on facial animation.
• Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning
  18 Mar 2025 1 repository listed Syntology ran 0 of 3 samples · 3 unverified
  We begin by defining key capabilities for Physical AI reasoning, with a focus on physical common sense and embodied reasoning.
• EmoFace: Audio-driven Emotional 3D Face Animation
  17 Jul 2024 1 repository listed
  Our approach can generate facial expressions with multiple emotions, and has the ability to generate random yet natural blinks and eye movements, while maintaining accurate lip synchronization.
• LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example
  22 Mar 2024 1 repository listed
  To this end, we propose a method that can produce a highly stylized 3D face model with desired topology.
• MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Models
  14 Mar 2024 1 repository listed Syntology ran 1 of 1 samples · 0 unverified
  Gesture synthesis is a vital realm of human-computer interaction, with wide-ranging applications across various fields like film, robotics, and virtual reality.
• EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling
  31 Dec 2023 1 repository listed Syntology ran 4 of 4 samples · 0 unverified · 4 pointer-only (licence)
  We propose EMAGE, a framework to generate full-body human gestures from audio and masked gestures, encompassing facial, local body, hands, and global movements.
• FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models
  13 Dec 2023 1 repository listed
  We propose a new latent diffusion model for this task, operating in the expression space of neural parametric head models, to synthesize audio-driven realistic head sequences.
• FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusion
  20 Sep 2023 1 repository listed
  In addition, majority of the approaches focus on 3D vertex based datasets and methods that are compatible with existing facial animation pipelines with rigged characters is scarce.
• Speech-Driven 3D Face Animation with Composite and Regional Facial Movements
  10 Aug 2023 1 repository listed
  This paper emphasizes the importance of considering both the composite and regional natures of facial movements in speech-driven 3D face animation.
• SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces
  19 Jun 2023 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  To enhance the visual accuracy of generated lip movement while reducing the dependence on labeled data, we propose a novel framework SelfTalk, by involving self-supervision in a cross-modals network system to learn 3D…
• Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation
  2 Jun 2023 1 repository listed
  This paper presents a novel approach for generating 3D talking heads from raw audio inputs.
• MMFace4D: A Large-Scale Multi-Modal 4D Face Dataset for Audio-Driven 3D Face Animation
  17 Mar 2023 1 repository listed
  Upon MMFace4D, we construct a non-autoregressive framework for audio-driven 3D face animation.
• FaceXHuBERT: Text-less Speech-driven E(X)pressive 3D Facial Animation Synthesis Using Self-Supervised Speech Representation Learning
  9 Mar 2023 1 repository listed
  This paper presents FaceXHuBERT, a text-less speech-driven 3D facial animation generation method that allows to capture personalized and subtle cues in speech (e.
• CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
  6 Jan 2023 1 repository listed Syntology ran 2 of 13 samples · 11 unverified
  In this paper, we propose to cast speech-driven facial animation as a code query task in a finite proxy space of the learned codebook, which effectively promotes the vividness of the generated motions by reducing the…
• 3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation
  12 Sep 2022 1 repository listed Syntology ran 5 of 5 samples · 0 unverified · 5 pointer-only (licence)
  In contrast to the traditional avatar creation pipeline which is a costly process, contemporary generative approaches directly learn the data distribution from photographs.
• FaceFormer: Speech-Driven 3D Facial Animation with Transformers
  10 Dec 2021 1 repository listed Syntology ran 4 of 4 samples · 0 unverified
  Speech-driven 3D facial animation is challenging due to the complex geometry of human faces and the limited availability of 3D audio-visual data.
• FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning
  18 Aug 2021 1 repository listed Syntology ran 3 of 3 samples · 0 unverified · 3 pointer-only (licence)
  In this paper, we propose a talking face generation method that takes an audio signal as input and a short target video clip as reference, and synthesizes a photo-realistic video of the target face with natural lip…
• Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose
  24 Feb 2020 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  In this paper, we address this problem by proposing a deep neural network model that takes an audio signal A of a source person and a very short video V of a target person as input, and outputs a synthesized…
• Capture, Learning, and Synthesis of 3D Speaking Styles
  8 May 2019 1 repository listed Syntology ran 1 of 1 samples · 0 unverified · 1 pointer-only (licence)
  To address this, we introduce a unique 4D face dataset with about 29 minutes of 4D scans captured at 60 fps and synchronized audio from 12 speakers.
• 3D faces in motion: Fully automatic registration and statistical analysis
  24 Jun 2014 1 repository listed
  The resulting statistical analysis is applied to automatically generate realistic facial animations and to recognize dynamic facial expressions.

Syntology lines on 12 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. Read from the graph 2026-09-24.