Papers › ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimation

ASMNet: a Lightweight Deep Neural Network for Face Alignment and Pose Estimation

27 Feb 2021arXiv:2103.00119archive 2025-07-28

Ali Pourramezan Fard, Hojjat Abdollahi, Mohammad Mahoor

Active Shape Model (ASM) is a statistical model of object shapes that represents a target structure. ASM can guide machine learning algorithms to fit a set of points representing an object (e.g., face) onto an image. This paper presents a lightweight Convolutional Neural Network (CNN) architecture with a loss function being assisted by ASM for face alignment and estimating head pose in the wild. We use ASM to first guide the network towards learning a smoother distribution of the facial landmark points. Inspired by transfer learning, during the training process, we gradually harden the regression problem and guide the network towards learning the original landmark points distribution. We define multi-tasks in our loss function that are responsible for detecting facial landmark points as well as estimating the face pose. Learning multiple correlated tasks simultaneously builds synergy and improves the performance of individual tasks. We compare the performance of our proposed model called ASMNet with MobileNetV2 (which is about 2 times bigger than ASMNet) in both the face alignment and pose estimation tasks. Experimental results on challenging datasets show that by using the proposed ASM assisted loss function, the ASMNet performance is comparable with MobileNetV2 in the face alignment task. In addition, for face pose estimation, ASMNet performs much better than MobileNetV2. ASMNet achieves an acceptable performance for facial landmark points detection and pose estimation while having a significantly smaller number of parameters and floating-point operations compared to many CNN-based models.

PaperPDFConference PDFCode

Code

aliprf/ASMNet officialtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Face AlignmentHead Pose EstimationPose EstimationTransfer Learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Face Alignment 300W MobileNetV2 NME_inter-ocular (%, Challenge) 7.35 #40 of 48 Archive leaderboard report
Face Alignment 300W MobileNetV2 NME_inter-ocular (%, Common) 3.88 #40 of 48 Archive leaderboard report
Face Alignment 300W MobileNetV2 NME_inter-ocular (%, Full) 4.59 #40 of 48 Archive leaderboard report
Face Alignment 300W ASMNet NME_inter-ocular (%, Challenge) 8.2 #42 of 48 Archive leaderboard report
Face Alignment 300W ASMNet NME_inter-ocular (%, Common) 4.82 #42 of 48 Archive leaderboard report
Face Alignment 300W ASMNet NME_inter-ocular (%, Full) 5.50 #42 of 48 Archive leaderboard report
Face Alignment WFLW MobileNetV2 NME (inter-ocular) 9.41 #32 of 36 Archive leaderboard report
Face Alignment WFLW ASMNet NME (inter-ocular) 10.77 #34 of 36 Archive leaderboard report
Head Pose Estimation COFW ASMNet MAE pitch (º) 2.72 #1 of 1 Archive leaderboard report
Head Pose Estimation COFW ASMNet MAE yaw (º) 2.91 #1 of 1 Archive leaderboard report
Head Pose Estimation WFLW ASMNet MAE mean (º) 2.70 #2 of 2 Archive leaderboard report
Head Pose Estimation WFLW ASMNet MAE pitch (º) 2.93 #2 of 2 Archive leaderboard report
Head Pose Estimation WFLW ASMNet MAE roll (º) 2.21 #2 of 2 Archive leaderboard report
Head Pose Estimation WFLW ASMNet MAE yaw (º) 2.97 #2 of 2 Archive leaderboard report
Pose Estimation 300W (Full) ASMNet MAE pitch (º) 1.80 #3 of 3 Archive leaderboard report
Pose Estimation 300W (Full) ASMNet MAE roll (º) 1.24 #3 of 3 Archive leaderboard report
Pose Estimation 300W (Full) ASMNet MAE yaw (º) 1.62 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionAverage PoolingBatch NormalizationConvolutionDepthwise ConvolutionDepthwise Separable ConvolutionInverted Residual BlockPointwise Convolution

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections