Browse State-of-the-Art › Facial Action Unit Detection

Facial Action Unit Detection

21 papers with code · 3 benchmarks · 4 datasets archive 2025-07-28

Computer VisionMiscellaneousMusic

Facial action unit detection is the task of detecting action units from a video of a face - for example, lip tightening and cheek raising.

( Image credit: Self-supervised Representation Learning from Videos for Facial Action Unit Detection )

Description from the archive archive 2025-07-28.

Benchmarks archive 2025-07-28

3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): DISFA (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

4 datasets whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Papers archive 2025-07-28

archive papers tagged: 96 · with a code link: 21 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3 of 96 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 96 of 96, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.

  • We use the soft labels and the ground truth to train the student model.
  • 9 Mar 2024 2 repositories listed
    In conclusion, this paper provides valuable insights into the potential applications and challenges of MLLMs in human-centric computing.
  • 15 Aug 2023 2 repositories listed
    Anatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection.
  • While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair of AUs in each facial display.
  • 30 Mar 2021 2 repositories listed
    Recent work on Deep Learning in the area of face analysis has focused on supervised learning for specific tasks of interest (e. g. face recognition, facial landmark localization etc.)
  • 11 Jan 2017 2 repositories listed
    Limited annotated data available for the recognition of facial expression and action units embarrasses the training of deep networks, which can learn disentangled invariant features.
  • 1 Jun 2016 2 repositories listed
    Region learning (RL) and multi-label learning (ML) have recently attracted increasing attentions in the field of facial Action Unit (AU) detection.
  • 2 Oct 2024 1 repository listed
    Specifically, we explore the mechanism of self-attention weight distribution, in which the self-attention weight distribution of each AU is regarded as spatial distribution and is adaptively learned under the constraint…
  • 22 Jul 2024 1 repository listed
    First, the carefully designed normalization network struggles to directly remove the above task-irrelevant noise, by maintaining facial expression consistency but normalizing all original images to a common identity…
  • 15 Jul 2024 1 repository listed
    To fill this gap, we first show that subject identity in AU datasets creates shortcut learning for the model and leads to sub-optimal solutions to AU predictions.
  • Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions…
  • 7 Mar 2024 1 repository listed
    Facial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic.
  • 9 Feb 2024 1 repository listed
    For the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection.
  • 23 Aug 2023 1 repository listed
    The proposed FG-Net achieves a strong generalization ability for heatmap-based AU detection thanks to the generalizable and semantic-rich features extracted from the pre-trained generative model.
  • 17 Feb 2021 1 repository listed
    To automate parts of this process, we propose a Deep Learning-based method to detect EquiFACS units automatically from images.
  • 18 Mar 2020 1 repository listed
    Moreover, to extract precise local features, we propose an adaptive attention learning module to refine the attention map of each AU adaptively.
  • 24 Oct 2019 1 repository listed
    In this work, we propose a semi-supervised approach for AU recognition utilizing a large number of web face images without AU labels and a relatively small face dataset with AU annotations inspired by the co-training…
  • 1 Jun 2019 1 repository listed
    In this paper, we aim to learn discriminative representation for facial action unit (AU) detection from large amount of videos without manual annotations.
  • 25 Mar 2019 1 repository listed
    Due to the combination of source AU-related information and target AU-free information, the latent feature domain with transferred source label can be learned by maximizing the target-domain AU detection performance.
  • 15 Mar 2018 1 repository listed
    Facial action unit (AU) detection and face alignment are two highly correlated tasks since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection.
  • 25 Apr 2017 1 repository listed
    We then move to the novel setup of the FERA 2017 Challenge, in which we propose a multi-view extension of our approach that operates by first predicting the viewpoint from which the video was taken, and then evaluating…
  • FG 2025 TrustFAA: the First Workshop on Towards Trustworthy Facial Affect Analysis: Advancing Insights of Fairness, Explainability, and Safety (TrustFAA)
    5 Jun 2025 0 repositories listed
    With the increasing prevalence and deployment of Emotion AI-powered facial affect analysis (FAA) tools, concerns about the trustworthiness of these systems have become more prominent.
  • AU-TTT: Vision Test-Time Training model for Facial Action Unit Detection
    30 Mar 2025 0 repositories listed
    Facial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing.
  • Decoupled Doubly Contrastive Learning for Cross Domain Facial Action Unit Detection
    12 Mar 2025 0 repositories listed
    Despite the impressive performance of current vision-based facial action unit (AU) detection approaches, they are heavily susceptible to the variations across different domains and the cross-domain AU detection methods…
  • Towards Unified Facial Action Unit Recognition Framework by Large Language Models
    13 Sep 2024 0 repositories listed
    Facial Action Units (AUs) are of great significance in the realm of affective computing.
  • Towards End-to-End Explainable Facial Action Unit Recognition via Vision-Language Joint Learning
    1 Aug 2024 0 repositories listed
    Facial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis.
  • AUD-TGN: Advancing Action Unit Detection with Temporal Convolution and GPT-2 in Wild Audiovisual Contexts
    20 Mar 2024 0 repositories listed
    Leveraging the synergy of both audio data and visual data is essential for understanding human emotions and behaviors, especially in in-the-wild setting.
  • Leveraging Synthetic Data for Generalizable and Fair Facial Action Unit Detection
    15 Mar 2024 0 repositories listed
    Facial action unit (AU) detection is a fundamental block for objective facial expression analysis.
  • Contrastive Learning of Person-independent Representations for Facial Action Unit Detection
    6 Mar 2024 0 repositories listed
    Facial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations.
  • 2 Jan 2024 0 repositories listed
    Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer.
  • Boosting Facial Action Unit Detection Through Jointly Learning Facial Landmark Detection and Domain Separation and Reconstruction
    8 Oct 2023 0 repositories listed
  • Occlusion Aware Student Emotion Recognition based on Facial Action Unit Detection
    18 Jul 2023 0 repositories listed
  • Fighting over-fitting with quantization for learning deep neural networks on noisy labels
    21 Mar 2023 0 repositories listed
  • Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild
    19 Mar 2023 0 repositories listed
  • Local Region Perception and Relationship Learning Combined with Feature Fusion for Facial Action Unit Detection
    15 Mar 2023 0 repositories listed
  • Self-supervised Facial Action Unit Detection with Region and Relation Learning
    10 Mar 2023 0 repositories listed
  • Biomechanics-Guided Facial Action Unit Detection Through Force Modeling
    1 Jan 2023 0 repositories listed
  • ReactioNet: Learning High-Order Facial Behavior from Universal Stimulus-Reaction by Dyadic Relation Reasoning
    1 Jan 2023 0 repositories listed
  • FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection
    11 Nov 2022 0 repositories listed
  • Facial Action Unit Detection and Intensity Estimation from Self-supervised Representation
    28 Oct 2022 0 repositories listed
  • Global-to-local Expression-aware Embeddings for Facial Action Unit Detection
    27 Oct 2022 0 repositories listed
  • Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection
    25 Sep 2022 0 repositories listed
  • Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition
    17 Apr 2022 0 repositories listed
  • Weakly Supervised Regional and Temporal Learning for Facial Action Unit Recognition
    1 Apr 2022 0 repositories listed
  • Facial Action Unit Recognition Based on Transfer Learning
    25 Mar 2022 0 repositories listed
  • Facial Action Unit Recognition With Multi-models Ensembling
    24 Mar 2022 0 repositories listed
  • Multi-modal Multi-label Facial Action Unit Detection with Transformer
    24 Mar 2022 0 repositories listed
  • Multi-Order Networks for Action Unit Detection
    1 Feb 2022 0 repositories listed
  • Knowledge-Driven Self-Supervised Representation Learning for Facial Action Unit Recognition
    1 Jan 2022 0 repositories listed
  • Self-Supervised Regional and Temporal Auxiliary Tasks for Facial Action Unit Recognition
    30 Jul 2021 0 repositories listed
  • Exploiting Semantic Embedding and Visual Feature for Facial Action Unit Detection
    19 Jun 2021 0 repositories listed
  • Facial Action Unit Detection With Transformers
    19 Jun 2021 0 repositories listed
  • Hybrid Message Passing With Performance-Driven Structures for Facial Action Unit Detection
    19 Jun 2021 0 repositories listed
  • Exploring Adversarial Learning for Deep Semi-Supervised Facial Action Unit Recognition
    4 Jun 2021 0 repositories listed
  • Meta Auxiliary Learning for Facial Action Unit Detection
    14 May 2021 0 repositories listed
  • Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework
    29 Mar 2021 0 repositories listed
  • DeepFN: Towards Generalizable Facial Action Unit Recognition with Deep Face Normalization
    3 Mar 2021 0 repositories listed
  • Multi-Level Adaptive Region of Interest and Graph Learning for Facial Action Unit Recognition
    24 Feb 2021 0 repositories listed
  • PIAP-DF: Pixel-Interested and Anti Person-Specific Facial Action Unit Detection Net With Discrete Feedback Learning
    1 Jan 2021 0 repositories listed
  • Computational efficient deep neural network with difference attention maps for facial action unit detection
    24 Nov 2020 0 repositories listed
  • HiCOMEX: Facial Action Unit Recognition Based on Hierarchy Intensity Distribution and COMEX Relation Learning
    23 Sep 2020 0 repositories listed
  • Facial Action Unit Detection using 3D Facial Landmarks
    17 May 2020 0 repositories listed
  • Facial Action Unit Detection on ICU Data for Pain Assessment
    24 Apr 2020 0 repositories listed
  • GeoConv: Geodesic Guided Convolution for Facial Action Unit Recognition
    6 Mar 2020 0 repositories listed
  • Upper, Middle and Lower Region Learning for Facial Action Unit Detection
    10 Feb 2020 0 repositories listed
  • Facial Action Unit Detection via Adaptive Attention and Relation
    5 Jan 2020 0 repositories listed
  • Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection
    23 Oct 2019 0 repositories listed
  • Fast and Effective Adaptation of Facial Action Unit Detection Deep Model
    26 Sep 2019 0 repositories listed
  • Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection
    1 Jun 2019 0 repositories listed
  • Semantic Relationships Guided Representation Learning for Facial Action Unit Recognition
    22 Apr 2019 0 repositories listed
  • Learned 3D Shape Representations Using Fused Geometrically Augmented Images: Application to Facial Expression and Action Unit Detection
    8 Apr 2019 0 repositories listed
  • The Truth and Nothing but the Truth: Multimodal Analysis for Deception Detection
    11 Mar 2019 0 repositories listed
  • Facial Action Unit Detection Using Attention and Relation Learning
    10 Aug 2018 0 repositories listed
  • Transfer Learning for Action Unit Recognition
    19 Jul 2018 0 repositories listed
  • Expression Empowered ResiDen Network for Facial Action Unit Detection
    13 Jun 2018 0 repositories listed
  • Classifier Learning With Prior Probabilities for Facial Action Unit Recognition
    1 Jun 2018 0 repositories listed
  • Weakly Supervised Facial Action Unit Recognition Through Adversarial Training
    1 Jun 2018 0 repositories listed
  • The Intelligent ICU Pilot Study: Using Artificial Intelligence Technology for Autonomous Patient Monitoring
    25 Apr 2018 0 repositories listed
  • Deep Structure Inference Network for Facial Action Unit Recognition
    15 Mar 2018 0 repositories listed
  • Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition
    4 Mar 2018 0 repositories listed
  • Deep Facial Action Unit Recognition From Partially Labeled Data
    1 Oct 2017 0 repositories listed
  • Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection
    23 Sep 2017 0 repositories listed
  • Optimizing Filter Size in Convolutional Neural Networks for Facial Action Unit Recognition
    26 Jul 2017 0 repositories listed
  • Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognition
    17 Jul 2017 0 repositories listed
  • Improving Speech Related Facial Action Unit Recognition by Audiovisual Information Fusion
    29 Jun 2017 0 repositories listed
  • Learning with Privileged Information for Multi-Label Classification
    29 Mar 2017 0 repositories listed
  • FERA 2017 - Addressing Head Pose in the Third Facial Expression Recognition and Analysis Challenge
    14 Feb 2017 0 repositories listed
  • EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detection
    9 Feb 2017 0 repositories listed
  • Modeling Spatial and Temporal Cues for Multi-label Facial Action Unit Detection
    2 Aug 2016 0 repositories listed
  • Confidence Preserving Machine for Facial Action Unit Detection
    1 Dec 2015 0 repositories listed
  • Learning to Transfer: Transferring Latent Task Structures and Its Application to Person-Specific Facial Action Unit Detection
    1 Dec 2015 0 repositories listed
  • Multi-Conditional Latent Variable Model for Joint Facial Action Unit Detection
    1 Dec 2015 0 repositories listed
  • Time Series Classification using the Hidden-Unit Logistic Model
    16 Jun 2015 0 repositories listed
  • Joint Patch and Multi-Label Learning for Facial Action Unit Detection
    1 Jun 2015 0 repositories listed
  • Relative Facial Action Unit Detection
    1 May 2014 0 repositories listed
  • Selective Transfer Machine for Personalized Facial Action Unit Detection
    1 Jun 2013 0 repositories listed

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections